Search results
1 – 10 of over 3000Despite the general recommendation of using a combination of multiple criteria for research assessment and faculty promotion decisions, the raise of quantitative indicators is…
Abstract
Purpose
Despite the general recommendation of using a combination of multiple criteria for research assessment and faculty promotion decisions, the raise of quantitative indicators is generating an emerging trend in Business Schools to use single journal impact factors (IFs) as key (unique) drivers for those relevant school decisions. This paper aims to investigate the effects of using single Web of Science (WoS)-based journal impact metrics when assessing research from two related disciplines: Business and Economics, and its potential impact for the strategic sustainability of a Business School.
Design/methodology/approach
This study collected impact indicators data for Business and Economics journals from the Clarivate Web of Science database. We concentrated on the IF indicators, the Eigenfactor and the article influence score (AIS). This study examined the correlations between these indicators and then ranked disciplines and journals using these different impact metrics.
Findings
Consistent with previous findings, this study finds positive correlations among these metrics. Then this study ranks the disciplines and journals using each impact metric, finding relevant and substantial differences, depending on the metric used. It is found that using AIS instead of the IF raises the relative ranking of Economics, while Business remains basically with the same rank.
Research limitations/implications
This study contributes to the research assessment literature by adding substantial evidence that given the sensitivity of journal rankings to particular indicators, the selection of a single impact metric for assessing research and hiring/promotion and tenure decisions is risky and too simplistic. This research shows that biases may be larger when assessment involves researchers from related disciplines – like Business and Economics – but with different research foundations and traditions.
Practical implications
Consistent with the literature, given the sensibility of journal rankings to particular indicators, the selection of a single impact metric for assessing research, assigning research funds and hiring/promotion and tenure decisions is risky and simplistic. However, this research shows that risks and biases may be larger when assessment involves researchers from related disciplines – like Business and Economics – but with different research foundations and trajectories. The use of multiple criteria is advised for such purposes.
Originality/value
This is an applied work using real data from WoS that addresses a practical case of comparing the use of different journal IFs to rank-related disciplines like Business and Economics, with important implications for faculty tenure and promotion committees and for research funds granting institutions and decision-makers.
Details
Keywords
Enrico Guarini, Francesca Magli and Andrea Francesconi
The purpose of this study is to analyse how academic staff cope with the new culture of performance measurement and assessment in universities. In particular, the study aims to…
Abstract
Purpose
The purpose of this study is to analyse how academic staff cope with the new culture of performance measurement and assessment in universities. In particular, the study aims to shed light on how external pressures related to measurement of research performance are translated into organisational and individual academic responses within the university and the extent to which these responses are related specifically to the operational features of performance measurement systems (PMS).
Design/methodology/approach
The study is based on a case study conducted in an Italian public university and based on interviews with a cross-disciplinary sample of faculty members.
Findings
The study provides insights into how linking financial incentives and career progression to research performance metrics at the system and organisational levels may have important reorientation effects on individual behaviours and epistemic consequences for the academic work.
Research limitations/implications
The study is based on interviews, so one limitation is related to the risk of researcher and interviewee personal bias. Moreover, this study is focused on one single case of a specific university setting, which cannot be fully representative of the experiences of others.
Originality/value
The study contributes to the literature on management accounting by exploring the factors that might explain why the unintended effects of PMS on academics’ behaviour reported by several studies might occur. From a practitioner’s point of view, it shows features of PMS that may produce unintended effects on academic activities. It also highlights the need to rethink PMS for the evaluation of university performance through the involvement of different stakeholders.
Details
Keywords
David S. Bedford, Markus Granlund and Kari Lukka
The authors examine how performance measurement systems (PMSs) and academic agency influence the meaning of research quality in practice. The worries are that the notion of…
Abstract
Purpose
The authors examine how performance measurement systems (PMSs) and academic agency influence the meaning of research quality in practice. The worries are that the notion of research quality is becoming too simplistically and narrowly determined by research quality's measurable proxies and that academics, especially manager-academics, do not sufficiently realise this risk. Whilst prior literature has covered the effects of performance measurement in the university sector broadly and how PMSs are mobilised locally, there is only little understanding of whether and how PMSs affect the meaning of research quality in practice.
Design/methodology/approach
The study is designed as a comparative case study of two university faculties in Finland. The role of conceptual analysis plays a notable role in the study, too.
Findings
The authors find that manager-academics of the two examined faculties have rather similar conceptual understandings of research quality. However, there were differences in the degree of slippage between the “espoused-meaning” of research quality and “meaning-in-practice” of research quality. The authors traced these differences to how the local PMS and manager-academics’ agency relate to one another within the context of increasing global and national performance pressures. The authors developed a tentative framework for the various “styles of agency”. This suggests how the relationship between the local PMS and manager-academics’ exerted agency shapes the “degrees of freedom” of the meaning of research quality in practice.
Originality/value
Given that research quality lies at the heart of academic work, the authors' paper indicates that exploring the three matters – performance measurement, the agency of manager-academics and the meaning of research quality in practice – in combination is crucial for the sustainability of the academe. The authors contribute to the literature by detailing the way in which local PMS and manager-academics' agency have material impacts on what research quality means in practice. The authors conclude by highlighting the pressing need for manager-academics to exercise the agency in efforts to safeguard a broad and pluralistic understanding of research quality in practice.
Details
Keywords
The publication oeuvre of a researcher carries great value when academic careers are assessed, and being recognised as a successful candidate is usually equated with being a…
Abstract
Purpose
The publication oeuvre of a researcher carries great value when academic careers are assessed, and being recognised as a successful candidate is usually equated with being a productive author. Yet, how publications are valued in the context of evaluating careers is so far an understudied topic. The paper aims to discuss these issues.
Design/methodology/approach
Through a content analysis of assessment reports in three disciplines – biomedicine, economics and history – this paper analyses how externalities are used to evaluate publication oeuvres. Externalities are defined as features such as reviews and bibliometric indicators, which can be assessed without evaluating the epistemological claims made in the actual text.
Findings
All three fields emphasise similar aspects when assessing: authorship, publication prestige, temporality of research, reputation within the field and boundary keeping. Yet, how these facets of quality are evaluated, and the means through which they are assessed differs between disciplines. Moreover, research fields orient themselves according to different temporal horizons, i.e. history looks to the past and economics to the future when research is evaluated.
Research limitations/implications
The complexities involved in the process of evaluating candidates are also reflected in the findings, and while the comparative approach taken effectively highlights domain specific differences it may also hide counter-narratives, and subtle intradisciplinary discussion on quality.
Originality/value
This study offers a novel perspective on how publications are valued when assessing academic careers. Especially striking is how research across different fields is evaluated through different time horizons. This finding is significant in the debate on more overarching and formal systems of research evaluation.
Details
Keywords
Even though every decision a leader makes carries an element of risk, no review on the topic of leadership and risk has appeared in highly-ranked management journals in the past…
Abstract
Purpose
Even though every decision a leader makes carries an element of risk, no review on the topic of leadership and risk has appeared in highly-ranked management journals in the past 20 years. This is in contrast to the discipline of psychology in which leadership and risk receives considerable attention, particularly in the field of heroism studies. In the context of the established body of research on the topic of leadership and risk in the discipline of psychology, this review therefore explores the research on leadership and risk in highly-ranked management studies’ journals.
Design/methodology/approach
The review was conducted in five stages. During phase 1, journal rankings were used as basis to determine which highly-ranked journals to include in the review. Phase 2 focused on identifying all relevant articles in the journals included in our review. We searched for articles published from 2000 to 2021 with the words “risk” or “danger” and “leader” or “leadership” in their abstracts. In phase 3, the author analysed the abstracts of the articles in depth to determine whether the keywords were included on the basis of an explicit scholarly reflection or research on leadership and risk. Phase 4 focused on analysing articles' treatment of leadership and risk, and assigning key words and key phrases. Finally, during phase 5 key words and key phrases were clustered together thematically.
Findings
This study analysis yielded six thematic clusters. The first two clusters – on risk appetite of followers and leaders – are closely related. In total, 12 journal articles explored these themes. The remaining thematic clusters contain four and seven articles each. These clusters are risk, creativity and innovation; risk and failure; risk in dangerous contexts; and risk and gender. Nine of the selected articles did not fit in any of the thematic clusters.
Originality/value
The review reveals a significant lack of research on leadership and risk in highly-ranked management studies’ journals. The author found that the topic of leadership and risk is approached in a binary fashion: successful leaders are viewed as using risk to drive innovation and unsuccessful leaders fail because of risk. The author argues that the heroic bias in leadership research could be partly blamed for this binarism. In practical terms, the author highlights that the growing importance of chief risk officers – leaders appointed to deal with company risk – indicates a clear need for research on leadership and risk in general management studies’ journals.
Details
Keywords
This paper examines the socio-political affordances of metrics in research evaluation and the consequences of epistemic injustice in research practices and recorded knowledge.
Abstract
Purpose
This paper examines the socio-political affordances of metrics in research evaluation and the consequences of epistemic injustice in research practices and recorded knowledge.
Design/methodology/approach
First, the use of metrics is examined as a mechanism that promotes competition and social acceleration. Second, it is argued that the use of metrics in a competitive research culture reproduces systemic inequalities and leads to epistemic injustice. The conceptual analysis draws on works of Hartmut Rosa and Miranda Fricker, amongst others.
Findings
The use of metrics is largely driven by competition such as university rankings and league tables. Not only that metrics are not designed to enrich academic and research culture, they also suppress the visibility and credibility of works by minorities. As such, metrics perpetuate epistemic injustice in knowledge practices; at the same time, the reliability of metrics for bibliometric and scientometric studies is put into question.
Social implications
As metrics leverage who can speak and who will be heard, epistemic injustice is reflected in recorded knowledge and what we consider to be information.
Originality/value
This paper contributes to the discussion of metrics beyond bibliometric studies and research evaluation. It argues that metrics-induced competition is antithetical to equality and diversity in research practices.
Details
Keywords
Predatory publishing is a growing and global issue infecting all scientific domains. Predatory publishers create counterfeit, not (properly) peer-reviewed journals to exploit the…
Abstract
Purpose
Predatory publishing is a growing and global issue infecting all scientific domains. Predatory publishers create counterfeit, not (properly) peer-reviewed journals to exploit the open access (OA) model in which the author pays. The plethora of predatory marketing journals along with the sophisticated deceptive practices of their publishers may create total confusion. One of the many highly likely risks of that bewilderment is when peer-reviewed, prestigious marketing journals cite these pseudo-marketing journals. This phenomenon is called citation contamination. This study aims to investigate the extent of citation contamination in the peer-reviewed marketing literature.
Design/methodology/approach
Using Google Scholar as a citation gathering tool, this study investigates references to four predatory marketing journals in 68 peer-reviewed marketing journals listed in the 2018 version of the Academic Journal Guide by the Chartered Association of Business Schools (CABSs).
Findings
Results indicate that 59 of the 68 CABS-ranked peer-reviewed marketing journals were, up to late January 2021, contaminated by at least one of the four sampled predatory journals. Together, these four pseudo-journals received (at least) 605 citations. Findings from nonparametric statistical procedures show that citation contamination occurred irrespective of the age of a journal or its 2019 Journal Impact Factor (JIF). They also point out that citation contamination happened independently from the fact that a journal is recognized by Clarivate Analytics or not.
Research limitations/implications
This study investigated citations to only four predatory marketing journals in only 68 CABS-listed peer-reviewed marketing journals.
Practical implications
These findings should sound an alarm to the entire marketing community (including academics and practitioners). To counteract citation contamination, recommendations are provided for researchers, practitioners, journal editors and academic and professional associations.
Originality/value
This study is the first to offer a systematic assessment of references to predatory journals in the peer-reviewed marketing literature.
Details
Keywords
Shashi, Piera Centobelli, Roberto Cerchione and Myriam Ertz
The purpose of this paper is to present a quantitatively supported explanation of the intellectual development, the schools of thought and the sub-areas of the food cold chain…
Abstract
Purpose
The purpose of this paper is to present a quantitatively supported explanation of the intellectual development, the schools of thought and the sub-areas of the food cold chain (FCC) research to derive meaningful avenues for future research.
Design/methodology/approach
This study builds on bibliometric analysis and network analysis to systematically evaluate a sample of 1,189 FCC articles published over the past 25 years. The descriptive statistics and science mapping approaches using co-citation analysis were performed with VOSviewer software.
Findings
The findings reveal a state-of-the-art overview of the top contributing and influential countries, authors, institutions and articles in the area of FCC research. A co-citation analysis, coupled with content analysis of most co-cited articles, uncovered four underlying research streams including: application of RFID technologies; production and operation planning models; postharvest waste, causes of postharvest wastage and perishable inventory ordering polices and models; and critical issues in FCC. Current research streams, clusters and their sub-themes provided meaningful discussions and insights into key areas for future research in FCC.
Originality/value
This study might reshape practitioners’, researchers’ and policy-makers’ views on the multifaceted areas and themes in the FCC research field, to harness FCC’s benefits at both strategic and tactical level. Finally, the research findings offer a roadmap for additional research to yield more practical and modeling insights that are much needed to enrich the field.
Details
Keywords
Jani Koskinen, Kai Kristian Kimppa, Janne Lahtiranta and Sami Hyrynsalmi
The competition in the academe has always been tough, but today, the academe seems to be more like an industry than an academic community as academics are evaluated through…
Abstract
Purpose
The competition in the academe has always been tough, but today, the academe seems to be more like an industry than an academic community as academics are evaluated through quantified and economic means.
Design/methodology/approach
This article leans on Heidegger’s thoughts on the essence of technology and his ontological view on being to show the dangers that lie in this quantification of researchers and research.
Findings
Despite the benefits that information systems (ISs) offer to people and research, it seems that technology has made it possible to objectify researchers and research. This has a negative impact on the academe and should thus be looked into especially by the IS field, which should note the problems that exist in its core. This phenomenon of quantified academics is clearly visible at academic quantification sites, where academics are evaluated using metrics that count their output. It seems that the essence of technology has disturbed the way research is valued by emphasising its quantifiable aspects. The study claims that it is important to look for other ways to evaluate researchers rather than trying to maximise research production, which has led to the flooding of articles that few have the time or interest to read.
Originality/value
This paper offers new insights into the current phenomenon of quantification of academics and underlines the need for critical changes if in order to achieve the academic culture that is desirable for future academics.
Details
Keywords
Murniati Mukhlisin, Nurizal Ismail and Reza Jamilah Fikri
This study aims to analyse whether theories and views of classical Islamic scholars are widely adopted as references in Islamic accounting and finance (IAF), Islamic economics…
Abstract
Purpose
This study aims to analyse whether theories and views of classical Islamic scholars are widely adopted as references in Islamic accounting and finance (IAF), Islamic economics (IE) and Islamic business management (IBM) research studies as part of their contribution to solving current economic and financial problems.
Design/methodology/approach
The research adopts a qualitative meta-analysis methodology using NVivo 12 with selected data from 474 international journal articles published between 1981 and 2021. The study considers 172 IAF articles, 111 IE articles and 191 IBM articles.
Findings
The results of the study show that the use of theories and views of classical Islamic scholars is not widespread among the examined research papers. The findings show that 90% of researchers tend to acquire modern economics, management, psychological and sociological theories instead of classical theories. Both modern and classical theories have been discussed in the studied articles namely agency theory, stakeholders' theory, ḥisbah (accountability), maqāṣid al-Sharīʿah (objectives of Islamic law) and waʿd (unilateral promise). The gaps prevail not only in the taxonomy of terms but also in the choice of paradigm references. It is found that 66% of the 474 journal articles adopt a positivist paradigm, followed by interpretivism (19%), post-structuralism (9%) and critical orientation (6%).
Research limitations/implications
This paper considers only ABS ranking journal articles. Future research may consider other journal articles from different ranking groups such as Scopus or Thomson & Reuters.
Practical implications
The paper sheds light on how Islamic educational institutions can develop strategies for the Integration of Knowledge (IOK) in their curriculum.
Social implications
This paper helps to shape the Muslims' way of thinking within an Islamic worldview which will lead to an Islamic way of expressing knowledge, skill and behaviour.
Originality/value
This paper contributes to the model of IOK that has been deliberated among Islamic universities, especially those that develop IAF, IE and IBM studies.
Details