Search results

1 – 10 of over 1000
Open Access
Article
Publication date: 10 May 2022

Lai Ma

This paper examines the socio-political affordances of metrics in research evaluation and the consequences of epistemic injustice in research practices and recorded knowledge.

1637

Abstract

Purpose

This paper examines the socio-political affordances of metrics in research evaluation and the consequences of epistemic injustice in research practices and recorded knowledge.

Design/methodology/approach

First, the use of metrics is examined as a mechanism that promotes competition and social acceleration. Second, it is argued that the use of metrics in a competitive research culture reproduces systemic inequalities and leads to epistemic injustice. The conceptual analysis draws on works of Hartmut Rosa and Miranda Fricker, amongst others.

Findings

The use of metrics is largely driven by competition such as university rankings and league tables. Not only that metrics are not designed to enrich academic and research culture, they also suppress the visibility and credibility of works by minorities. As such, metrics perpetuate epistemic injustice in knowledge practices; at the same time, the reliability of metrics for bibliometric and scientometric studies is put into question.

Social implications

As metrics leverage who can speak and who will be heard, epistemic injustice is reflected in recorded knowledge and what we consider to be information.

Originality/value

This paper contributes to the discussion of metrics beyond bibliometric studies and research evaluation. It argues that metrics-induced competition is antithetical to equality and diversity in research practices.

Details

Journal of Documentation, vol. 78 no. 7
Type: Research Article
ISSN: 0022-0418

Keywords

Open Access
Book part
Publication date: 1 December 2022

Agnès Vandevelde-Rougale and Patricia Guerrero Morales

This chapter looks at the discursive dimension of the working environment in research and higher education organizations; more specifically at neoliberal managerial discourse and…

Abstract

This chapter looks at the discursive dimension of the working environment in research and higher education organizations; more specifically at neoliberal managerial discourse and at how it participates in shaping the way researchers, teachers and support staff perceive themselves and their experiences. It is based on a multiple case study and combines an intersectional and a socio-clinical approach. The empirical data is constituted by in-depth interviews with women conducted in Ireland and Chile, and includes some observations made in France. A thematic analysis of individual narratives of self-ascribed experiences of being bullied enables to look behind the veil drawn by managerial discourse, thus providing insights into power vectors and power domains contributing to workplace violence. It also shows that workplace bullying may reinforce identification to undervalued social categories. This contribution argues that neoliberal managerial discourse, by encouraging social representations of “neutral” individuals at work, or else celebrating their “diversity,” conceals power relations rooting on different social categories. This process influences one’s perception of one’s experience and its verbalization. At the same time, feeling assigned to one or more of undervalued social category can raise the perception of being bullied or discriminated against. While research has shown that only a minority of incidents of bullying and discrimination are reported within organizations, this contribution suggests that acknowledging the multiplicity and superposition of categories and their influence in shaping power relations could help secure a more collective and caring approach, and thus foster a safer work culture and atmosphere in research organizations.

Open Access
Article
Publication date: 28 March 2023

Ricardo Godinho Bilro, Sandra Maria Correia Loureiro and Pedro Souto

The purpose of this paper is to offer a comprehensive overview of current research on customer behavior in the business-to-business (B2B) context and propose a research agenda for…

10887

Abstract

Purpose

The purpose of this paper is to offer a comprehensive overview of current research on customer behavior in the business-to-business (B2B) context and propose a research agenda for future studies. Despite being a relatively recent area of interest for academics and practitioners, a literature review that synthesizes existing knowledge into coherent topics and outlines a research agenda for future research is still lacking.

Design/methodology/approach

Drawing on a systematic literature review of 219 papers and using a text-mining approach based on the Latent Dirichlet Allocation algorithm, this paper enhances the existing knowledge of B2B customer behavior and provides a descriptive analysis of the literature.

Findings

From this review, ten major research topics are found and analyzed. These topics were analyzed through the lens of the Theory, Context, Characteristics and Method framework, providing a summary of key findings from prior studies. Additionally, an integrative framework was developed, offering insights into future research directions.

Originality/value

This study presents a novel contribution to the field of B2B by providing a systematic review of the topic of customer behavior, filling a gap in the literature and offering a valuable resource for scholars and managers seeking to advance the field.

Details

Journal of Business & Industrial Marketing, vol. 38 no. 13
Type: Research Article
ISSN: 0885-8624

Keywords

Open Access
Article
Publication date: 14 July 2023

David S. Bedford, Markus Granlund and Kari Lukka

The authors examine how performance measurement systems (PMSs) and academic agency influence the meaning of research quality in practice. The worries are that the notion of…

Abstract

Purpose

The authors examine how performance measurement systems (PMSs) and academic agency influence the meaning of research quality in practice. The worries are that the notion of research quality is becoming too simplistically and narrowly determined by research quality's measurable proxies and that academics, especially manager-academics, do not sufficiently realise this risk. Whilst prior literature has covered the effects of performance measurement in the university sector broadly and how PMSs are mobilised locally, there is only little understanding of whether and how PMSs affect the meaning of research quality in practice.

Design/methodology/approach

The study is designed as a comparative case study of two university faculties in Finland. The role of conceptual analysis plays a notable role in the study, too.

Findings

The authors find that manager-academics of the two examined faculties have rather similar conceptual understandings of research quality. However, there were differences in the degree of slippage between the “espoused-meaning” of research quality and “meaning-in-practice” of research quality. The authors traced these differences to how the local PMS and manager-academics’ agency relate to one another within the context of increasing global and national performance pressures. The authors developed a tentative framework for the various “styles of agency”. This suggests how the relationship between the local PMS and manager-academics’ exerted agency shapes the “degrees of freedom” of the meaning of research quality in practice.

Originality/value

Given that research quality lies at the heart of academic work, the authors' paper indicates that exploring the three matters – performance measurement, the agency of manager-academics and the meaning of research quality in practice – in combination is crucial for the sustainability of the academe. The authors contribute to the literature by detailing the way in which local PMS and manager-academics' agency have material impacts on what research quality means in practice. The authors conclude by highlighting the pressing need for manager-academics to exercise the agency in efforts to safeguard a broad and pluralistic understanding of research quality in practice.

Details

Accounting, Auditing & Accountability Journal, vol. 36 no. 9
Type: Research Article
ISSN: 0951-3574

Keywords

Open Access
Book part
Publication date: 21 May 2024

Bianca Kramer and Jeroen Bosman

In academia, assessment is often narrow in its focus on research productivity, its application of a limited number of standardised metrics and its summative approach aimed at…

Abstract

In academia, assessment is often narrow in its focus on research productivity, its application of a limited number of standardised metrics and its summative approach aimed at selection. This approach, corresponding to an exclusive, subject-oriented concept of talent management, can be thought of as at odds with a broader view of the role of academic institutions as accelerating and improving science and scholarship and its societal impact. In recent years, open science practices as well as research integrity issues have increased awareness of the need for a more inclusive approach to assessment and talent management in academia, broadening assessment to reward the full spectrum of academic activities and, within that spectrum, deepening assessment by critically reflecting on the processes and indicators involved (both qualitative and quantitative). In terms of talent management, this would mean a move from research-focused assessment to assessment including all academic activities (including education, professional performance and leadership), a shift from focus on the individual to a focus on collaboration in teams (recognising contributions of both academic and support staff), increased attention for formative assessment and greater agency for those being evaluated, as well as around the data, tools and platforms used in assessment. Together, this represents a more inclusive, subject-oriented approach to talent management. Implementation of such changes requires involvement from university management, human resource management and academic and support staff at all career levels, and universities would benefit from participation in mutual learning initiatives currently taking shape in various regions of the world.

Open Access
Article
Publication date: 16 June 2022

Núria Bautista-Puig, Enrique Orduña-Malea and Carmen Perez-Esparrells

This study aims to analyse and evaluate the methodology followed by the Times Higher Education Impact Rankings (THE-IR), as well as the coverage obtained and the data offered by…

4588

Abstract

Purpose

This study aims to analyse and evaluate the methodology followed by the Times Higher Education Impact Rankings (THE-IR), as well as the coverage obtained and the data offered by this ranking, to determine if its methodology reflects the degree of sustainability of universities, and whether their results are accurate enough to be used as a data source for research and strategic decision-making.

Design/methodology/approach

A summative content analysis of the THE-IR methodology was conducted, paying special attention to the macro-structure (university score) and micro-structure (sustainable development goals [SDG] score) levels of the research-related metrics. Then, the data published by THE-IR in the 2019, 2020 and 2021 edition was collected via web scraping. After that, all the data was statistically analysed to find out performance rates, SDGs’ success rates and geographic distributions. Finally, a pairwise comparison of the THE-IR against the Times Higher Education World University Rankings (THE-WUR) was conducted to calculate overlap measures.

Findings

Severe inconsistencies in the THE-IR methodology have been found, offering a distorted view of sustainability in higher education institutions, allowing different strategic actions to participate in the ranking (interested, strategic, committed and outperformer universities). The observed growing number of universities from developing countries and the absence of world-class universities reflect an opportunity for less-esteemed institutions, which might have a chance to gain reputation based on their efforts towards sustainability, but from a flawed ranking which should be avoided for decision-making.

Practical implications

University managers can be aware of the THE-IR validity when demanding informed decisions. University ranking researchers and practitioners can access a detailed analysis of the THE-IR to determine its properties as a ranking and use raw data from THE-IR in other studies or reports. Policy makers can use the main findings of this work to avoid misinterpretations when developing public policies related to the evaluation of the contribution of universities to the SDGs. Otherwise, these results can help the ranking publisher to improve some of the inconsistencies found in this study.

Social implications

Given the global audience of the THE-IR, this work contributes to minimising the distorted vision that the THE-IR projects about sustainability in higher education institutions, and alerts governments, higher education bodies and policy makers to take precautions when making decisions based on this ranking.

Originality/value

To the best of the authors’ knowledge, this contribution is the first providing an analysis of the THE-IR’s methodology. The faults in the methodology, the coverage at the country-level and the overlap between THE-IR and THE-WUR have unveiled the existence of specific strategies in the participation of universities, of interest both for experts in university rankings and SDGs.

Details

International Journal of Sustainability in Higher Education, vol. 23 no. 8
Type: Research Article
ISSN: 1467-6370

Keywords

Open Access
Article
Publication date: 21 March 2022

Sergio Olavarrieta

Despite the general recommendation of using a combination of multiple criteria for research assessment and faculty promotion decisions, the raise of quantitative indicators is…

1633

Abstract

Purpose

Despite the general recommendation of using a combination of multiple criteria for research assessment and faculty promotion decisions, the raise of quantitative indicators is generating an emerging trend in Business Schools to use single journal impact factors (IFs) as key (unique) drivers for those relevant school decisions. This paper aims to investigate the effects of using single Web of Science (WoS)-based journal impact metrics when assessing research from two related disciplines: Business and Economics, and its potential impact for the strategic sustainability of a Business School.

Design/methodology/approach

This study collected impact indicators data for Business and Economics journals from the Clarivate Web of Science database. We concentrated on the IF indicators, the Eigenfactor and the article influence score (AIS). This study examined the correlations between these indicators and then ranked disciplines and journals using these different impact metrics.

Findings

Consistent with previous findings, this study finds positive correlations among these metrics. Then this study ranks the disciplines and journals using each impact metric, finding relevant and substantial differences, depending on the metric used. It is found that using AIS instead of the IF raises the relative ranking of Economics, while Business remains basically with the same rank.

Research limitations/implications

This study contributes to the research assessment literature by adding substantial evidence that given the sensitivity of journal rankings to particular indicators, the selection of a single impact metric for assessing research and hiring/promotion and tenure decisions is risky and too simplistic. This research shows that biases may be larger when assessment involves researchers from related disciplines – like Business and Economics – but with different research foundations and traditions.

Practical implications

Consistent with the literature, given the sensibility of journal rankings to particular indicators, the selection of a single impact metric for assessing research, assigning research funds and hiring/promotion and tenure decisions is risky and simplistic. However, this research shows that risks and biases may be larger when assessment involves researchers from related disciplines – like Business and Economics – but with different research foundations and trajectories. The use of multiple criteria is advised for such purposes.

Originality/value

This is an applied work using real data from WoS that addresses a practical case of comparing the use of different journal IFs to rank-related disciplines like Business and Economics, with important implications for faculty tenure and promotion committees and for research funds granting institutions and decision-makers.

Details

Journal of Economics, Finance and Administrative Science, vol. 27 no. 53
Type: Research Article
ISSN: 2218-0648

Keywords

Open Access
Article
Publication date: 31 March 2021

Colin Scott

This article addresses the relationship of universities to their changing regulatory environments internationally.

3260

Abstract

Purpose

This article addresses the relationship of universities to their changing regulatory environments internationally.

Design/methodology/approach

This article updates analysis published in 2004 exploring the contrasting modes of, and key trends in, regulation of higher education across eight OECD (Organisation for Economic Co-operation and Development) states. The article offers a wider analysis of the changing patterns of regulation rooted in mutuality, oversight, competition and design, and the implications for the management of higher education institutions.

Findings

Since 2004, higher education has seen more growth in oversight-based and competition-based regulation, but also some decentralization of regulation as an increasing cast of actors, many international and transnational in character, have asserted themselves in key aspects of the regulatory environment. This article explores the implications of these changes in the regulatory mix over higher education for the ways that universities manage their regulatory environment, arguing first, that there is significant evidence of meta-regulatory approaches to regulating universities, and second, that such a meta-regulatory approach is consistent with an emphasis on university autonomy, raising a challenge for universities in how to use the autonomy (variable by country) they do have to manage their environment.

Originality/value

This article offers an original analysis of how universities might most appropriately respond, deploying their autonomy, however variable, to address their external regulatory environment. The author suggests we might increasingly see the external regulatory environment as meta-regulatory in character and universities making more use of reflexive governance processes.

Details

Public Administration and Policy, vol. 24 no. 1
Type: Research Article
ISSN: 1727-2645

Keywords

Abstract

Collegiality is the modus operandi of universities. Collegiality is central to academic freedom and scientific quality. In this way, collegiality also contributes to the good functioning of universities’ contribution to society and democracy. In this concluding paper of the special issue on collegiality, we summarize the main findings and takeaways from our collective studies. We summarize the main challenges and contestations to collegiality and to universities, but also document lines of resistance, activation, and maintenance. We depict varieties of collegiality and conclude by emphasizing that future research needs to be based on an appreciation of this variation. We argue that it is essential to incorporate such a variation-sensitive perspective into discussions on academic freedom and scientific quality and highlight themes surfaced by the different studies that remain under-explored in extant literature: institutional trust, field-level studies of collegiality, and collegiality and communication. Finally, we offer some remarks on methodological and theoretical implications of this research and conclude by summarizing our research agenda in a list of themes.

Open Access
Article
Publication date: 16 January 2024

Jani Koskinen, Kai Kristian Kimppa, Janne Lahtiranta and Sami Hyrynsalmi

The competition in the academe has always been tough, but today, the academe seems to be more like an industry than an academic community as academics are evaluated through…

Abstract

Purpose

The competition in the academe has always been tough, but today, the academe seems to be more like an industry than an academic community as academics are evaluated through quantified and economic means.

Design/methodology/approach

This article leans on Heidegger’s thoughts on the essence of technology and his ontological view on being to show the dangers that lie in this quantification of researchers and research.

Findings

Despite the benefits that information systems (ISs) offer to people and research, it seems that technology has made it possible to objectify researchers and research. This has a negative impact on the academe and should thus be looked into especially by the IS field, which should note the problems that exist in its core. This phenomenon of quantified academics is clearly visible at academic quantification sites, where academics are evaluated using metrics that count their output. It seems that the essence of technology has disturbed the way research is valued by emphasising its quantifiable aspects. The study claims that it is important to look for other ways to evaluate researchers rather than trying to maximise research production, which has led to the flooding of articles that few have the time or interest to read.

Originality/value

This paper offers new insights into the current phenomenon of quantification of academics and underlines the need for critical changes if in order to achieve the academic culture that is desirable for future academics.

Details

Information Technology & People, vol. 37 no. 8
Type: Research Article
ISSN: 0959-3845

Keywords

1 – 10 of over 1000