Search results

1 – 10 of over 3000
Open Access
Article
Publication date: 21 March 2022

Sergio Olavarrieta

Despite the general recommendation of using a combination of multiple criteria for research assessment and faculty promotion decisions, the raise of quantitative indicators is…

1529

Abstract

Purpose

Despite the general recommendation of using a combination of multiple criteria for research assessment and faculty promotion decisions, the raise of quantitative indicators is generating an emerging trend in Business Schools to use single journal impact factors (IFs) as key (unique) drivers for those relevant school decisions. This paper aims to investigate the effects of using single Web of Science (WoS)-based journal impact metrics when assessing research from two related disciplines: Business and Economics, and its potential impact for the strategic sustainability of a Business School.

Design/methodology/approach

This study collected impact indicators data for Business and Economics journals from the Clarivate Web of Science database. We concentrated on the IF indicators, the Eigenfactor and the article influence score (AIS). This study examined the correlations between these indicators and then ranked disciplines and journals using these different impact metrics.

Findings

Consistent with previous findings, this study finds positive correlations among these metrics. Then this study ranks the disciplines and journals using each impact metric, finding relevant and substantial differences, depending on the metric used. It is found that using AIS instead of the IF raises the relative ranking of Economics, while Business remains basically with the same rank.

Research limitations/implications

This study contributes to the research assessment literature by adding substantial evidence that given the sensitivity of journal rankings to particular indicators, the selection of a single impact metric for assessing research and hiring/promotion and tenure decisions is risky and too simplistic. This research shows that biases may be larger when assessment involves researchers from related disciplines – like Business and Economics – but with different research foundations and traditions.

Practical implications

Consistent with the literature, given the sensibility of journal rankings to particular indicators, the selection of a single impact metric for assessing research, assigning research funds and hiring/promotion and tenure decisions is risky and simplistic. However, this research shows that risks and biases may be larger when assessment involves researchers from related disciplines – like Business and Economics – but with different research foundations and trajectories. The use of multiple criteria is advised for such purposes.

Originality/value

This is an applied work using real data from WoS that addresses a practical case of comparing the use of different journal IFs to rank-related disciplines like Business and Economics, with important implications for faculty tenure and promotion committees and for research funds granting institutions and decision-makers.

Details

Journal of Economics, Finance and Administrative Science, vol. 27 no. 53
Type: Research Article
ISSN: 2218-0648

Keywords

Open Access
Article
Publication date: 3 February 2020

Enrico Guarini, Francesca Magli and Andrea Francesconi

The purpose of this study is to analyse how academic staff cope with the new culture of performance measurement and assessment in universities. In particular, the study aims to…

3440

Abstract

Purpose

The purpose of this study is to analyse how academic staff cope with the new culture of performance measurement and assessment in universities. In particular, the study aims to shed light on how external pressures related to measurement of research performance are translated into organisational and individual academic responses within the university and the extent to which these responses are related specifically to the operational features of performance measurement systems (PMS).

Design/methodology/approach

The study is based on a case study conducted in an Italian public university and based on interviews with a cross-disciplinary sample of faculty members.

Findings

The study provides insights into how linking financial incentives and career progression to research performance metrics at the system and organisational levels may have important reorientation effects on individual behaviours and epistemic consequences for the academic work.

Research limitations/implications

The study is based on interviews, so one limitation is related to the risk of researcher and interviewee personal bias. Moreover, this study is focused on one single case of a specific university setting, which cannot be fully representative of the experiences of others.

Originality/value

The study contributes to the literature on management accounting by exploring the factors that might explain why the unintended effects of PMS on academics’ behaviour reported by several studies might occur. From a practitioner’s point of view, it shows features of PMS that may produce unintended effects on academic activities. It also highlights the need to rethink PMS for the evaluation of university performance through the involvement of different stakeholders.

Details

Qualitative Research in Accounting & Management, vol. 17 no. 1
Type: Research Article
ISSN: 1176-6093

Keywords

Open Access
Article
Publication date: 14 July 2023

David S. Bedford, Markus Granlund and Kari Lukka

The authors examine how performance measurement systems (PMSs) and academic agency influence the meaning of research quality in practice. The worries are that the notion of…

Abstract

Purpose

The authors examine how performance measurement systems (PMSs) and academic agency influence the meaning of research quality in practice. The worries are that the notion of research quality is becoming too simplistically and narrowly determined by research quality's measurable proxies and that academics, especially manager-academics, do not sufficiently realise this risk. Whilst prior literature has covered the effects of performance measurement in the university sector broadly and how PMSs are mobilised locally, there is only little understanding of whether and how PMSs affect the meaning of research quality in practice.

Design/methodology/approach

The study is designed as a comparative case study of two university faculties in Finland. The role of conceptual analysis plays a notable role in the study, too.

Findings

The authors find that manager-academics of the two examined faculties have rather similar conceptual understandings of research quality. However, there were differences in the degree of slippage between the “espoused-meaning” of research quality and “meaning-in-practice” of research quality. The authors traced these differences to how the local PMS and manager-academics’ agency relate to one another within the context of increasing global and national performance pressures. The authors developed a tentative framework for the various “styles of agency”. This suggests how the relationship between the local PMS and manager-academics’ exerted agency shapes the “degrees of freedom” of the meaning of research quality in practice.

Originality/value

Given that research quality lies at the heart of academic work, the authors' paper indicates that exploring the three matters – performance measurement, the agency of manager-academics and the meaning of research quality in practice – in combination is crucial for the sustainability of the academe. The authors contribute to the literature by detailing the way in which local PMS and manager-academics' agency have material impacts on what research quality means in practice. The authors conclude by highlighting the pressing need for manager-academics to exercise the agency in efforts to safeguard a broad and pluralistic understanding of research quality in practice.

Details

Accounting, Auditing & Accountability Journal, vol. 36 no. 9
Type: Research Article
ISSN: 0951-3574

Keywords

Open Access
Article
Publication date: 18 September 2017

Björn Hammarfelt

The publication oeuvre of a researcher carries great value when academic careers are assessed, and being recognised as a successful candidate is usually equated with being a…

3612

Abstract

Purpose

The publication oeuvre of a researcher carries great value when academic careers are assessed, and being recognised as a successful candidate is usually equated with being a productive author. Yet, how publications are valued in the context of evaluating careers is so far an understudied topic. The paper aims to discuss these issues.

Design/methodology/approach

Through a content analysis of assessment reports in three disciplines – biomedicine, economics and history – this paper analyses how externalities are used to evaluate publication oeuvres. Externalities are defined as features such as reviews and bibliometric indicators, which can be assessed without evaluating the epistemological claims made in the actual text.

Findings

All three fields emphasise similar aspects when assessing: authorship, publication prestige, temporality of research, reputation within the field and boundary keeping. Yet, how these facets of quality are evaluated, and the means through which they are assessed differs between disciplines. Moreover, research fields orient themselves according to different temporal horizons, i.e. history looks to the past and economics to the future when research is evaluated.

Research limitations/implications

The complexities involved in the process of evaluating candidates are also reflected in the findings, and while the comparative approach taken effectively highlights domain specific differences it may also hide counter-narratives, and subtle intradisciplinary discussion on quality.

Originality/value

This study offers a novel perspective on how publications are valued when assessing academic careers. Especially striking is how research across different fields is evaluated through different time horizons. This finding is significant in the debate on more overarching and formal systems of research evaluation.

Details

Aslib Journal of Information Management, vol. 69 no. 5
Type: Research Article
ISSN: 2050-3806

Keywords

Open Access
Article
Publication date: 8 April 2022

Willem Fourie

Even though every decision a leader makes carries an element of risk, no review on the topic of leadership and risk has appeared in highly-ranked management journals in the past…

4940

Abstract

Purpose

Even though every decision a leader makes carries an element of risk, no review on the topic of leadership and risk has appeared in highly-ranked management journals in the past 20 years. This is in contrast to the discipline of psychology in which leadership and risk receives considerable attention, particularly in the field of heroism studies. In the context of the established body of research on the topic of leadership and risk in the discipline of psychology, this review therefore explores the research on leadership and risk in highly-ranked management studies’ journals.

Design/methodology/approach

The review was conducted in five stages. During phase 1, journal rankings were used as basis to determine which highly-ranked journals to include in the review. Phase 2 focused on identifying all relevant articles in the journals included in our review. We searched for articles published from 2000 to 2021 with the words “risk” or “danger” and “leader” or “leadership” in their abstracts. In phase 3, the author analysed the abstracts of the articles in depth to determine whether the keywords were included on the basis of an explicit scholarly reflection or research on leadership and risk. Phase 4 focused on analysing articles' treatment of leadership and risk, and assigning key words and key phrases. Finally, during phase 5 key words and key phrases were clustered together thematically.

Findings

This study analysis yielded six thematic clusters. The first two clusters – on risk appetite of followers and leaders – are closely related. In total, 12 journal articles explored these themes. The remaining thematic clusters contain four and seven articles each. These clusters are risk, creativity and innovation; risk and failure; risk in dangerous contexts; and risk and gender. Nine of the selected articles did not fit in any of the thematic clusters.

Originality/value

The review reveals a significant lack of research on leadership and risk in highly-ranked management studies’ journals. The author found that the topic of leadership and risk is approached in a binary fashion: successful leaders are viewed as using risk to drive innovation and unsuccessful leaders fail because of risk. The author argues that the heroic bias in leadership research could be partly blamed for this binarism. In practical terms, the author highlights that the growing importance of chief risk officers – leaders appointed to deal with company risk – indicates a clear need for research on leadership and risk in general management studies’ journals.

Details

Leadership & Organization Development Journal, vol. 43 no. 4
Type: Research Article
ISSN: 0143-7739

Keywords

Open Access
Article
Publication date: 10 May 2022

Lai Ma

This paper examines the socio-political affordances of metrics in research evaluation and the consequences of epistemic injustice in research practices and recorded knowledge.

1530

Abstract

Purpose

This paper examines the socio-political affordances of metrics in research evaluation and the consequences of epistemic injustice in research practices and recorded knowledge.

Design/methodology/approach

First, the use of metrics is examined as a mechanism that promotes competition and social acceleration. Second, it is argued that the use of metrics in a competitive research culture reproduces systemic inequalities and leads to epistemic injustice. The conceptual analysis draws on works of Hartmut Rosa and Miranda Fricker, amongst others.

Findings

The use of metrics is largely driven by competition such as university rankings and league tables. Not only that metrics are not designed to enrich academic and research culture, they also suppress the visibility and credibility of works by minorities. As such, metrics perpetuate epistemic injustice in knowledge practices; at the same time, the reliability of metrics for bibliometric and scientometric studies is put into question.

Social implications

As metrics leverage who can speak and who will be heard, epistemic injustice is reflected in recorded knowledge and what we consider to be information.

Originality/value

This paper contributes to the discussion of metrics beyond bibliometric studies and research evaluation. It argues that metrics-induced competition is antithetical to equality and diversity in research practices.

Details

Journal of Documentation, vol. 78 no. 7
Type: Research Article
ISSN: 0022-0418

Keywords

Open Access
Article
Publication date: 6 August 2021

Salim Moussa

Predatory publishing is a growing and global issue infecting all scientific domains. Predatory publishers create counterfeit, not (properly) peer-reviewed journals to exploit the…

17045

Abstract

Purpose

Predatory publishing is a growing and global issue infecting all scientific domains. Predatory publishers create counterfeit, not (properly) peer-reviewed journals to exploit the open access (OA) model in which the author pays. The plethora of predatory marketing journals along with the sophisticated deceptive practices of their publishers may create total confusion. One of the many highly likely risks of that bewilderment is when peer-reviewed, prestigious marketing journals cite these pseudo-marketing journals. This phenomenon is called citation contamination. This study aims to investigate the extent of citation contamination in the peer-reviewed marketing literature.

Design/methodology/approach

Using Google Scholar as a citation gathering tool, this study investigates references to four predatory marketing journals in 68 peer-reviewed marketing journals listed in the 2018 version of the Academic Journal Guide by the Chartered Association of Business Schools (CABSs).

Findings

Results indicate that 59 of the 68 CABS-ranked peer-reviewed marketing journals were, up to late January 2021, contaminated by at least one of the four sampled predatory journals. Together, these four pseudo-journals received (at least) 605 citations. Findings from nonparametric statistical procedures show that citation contamination occurred irrespective of the age of a journal or its 2019 Journal Impact Factor (JIF). They also point out that citation contamination happened independently from the fact that a journal is recognized by Clarivate Analytics or not.

Research limitations/implications

This study investigated citations to only four predatory marketing journals in only 68 CABS-listed peer-reviewed marketing journals.

Practical implications

These findings should sound an alarm to the entire marketing community (including academics and practitioners). To counteract citation contamination, recommendations are provided for researchers, practitioners, journal editors and academic and professional associations.

Originality/value

This study is the first to offer a systematic assessment of references to predatory journals in the peer-reviewed marketing literature.

Details

South Asian Journal of Marketing, vol. 2 no. 1
Type: Research Article
ISSN: 2719-2377

Keywords

Open Access
Article
Publication date: 13 November 2020

Shashi, Piera Centobelli, Roberto Cerchione and Myriam Ertz

The purpose of this paper is to present a quantitatively supported explanation of the intellectual development, the schools of thought and the sub-areas of the food cold chain…

9337

Abstract

Purpose

The purpose of this paper is to present a quantitatively supported explanation of the intellectual development, the schools of thought and the sub-areas of the food cold chain (FCC) research to derive meaningful avenues for future research.

Design/methodology/approach

This study builds on bibliometric analysis and network analysis to systematically evaluate a sample of 1,189 FCC articles published over the past 25 years. The descriptive statistics and science mapping approaches using co-citation analysis were performed with VOSviewer software.

Findings

The findings reveal a state-of-the-art overview of the top contributing and influential countries, authors, institutions and articles in the area of FCC research. A co-citation analysis, coupled with content analysis of most co-cited articles, uncovered four underlying research streams including: application of RFID technologies; production and operation planning models; postharvest waste, causes of postharvest wastage and perishable inventory ordering polices and models; and critical issues in FCC. Current research streams, clusters and their sub-themes provided meaningful discussions and insights into key areas for future research in FCC.

Originality/value

This study might reshape practitioners’, researchers’ and policy-makers’ views on the multifaceted areas and themes in the FCC research field, to harness FCC’s benefits at both strategic and tactical level. Finally, the research findings offer a roadmap for additional research to yield more practical and modeling insights that are much needed to enrich the field.

Details

Supply Chain Management: An International Journal, vol. 26 no. 1
Type: Research Article
ISSN: 1359-8546

Keywords

Open Access
Article
Publication date: 16 January 2024

Jani Koskinen, Kai Kristian Kimppa, Janne Lahtiranta and Sami Hyrynsalmi

The competition in the academe has always been tough, but today, the academe seems to be more like an industry than an academic community as academics are evaluated through…

Abstract

Purpose

The competition in the academe has always been tough, but today, the academe seems to be more like an industry than an academic community as academics are evaluated through quantified and economic means.

Design/methodology/approach

This article leans on Heidegger’s thoughts on the essence of technology and his ontological view on being to show the dangers that lie in this quantification of researchers and research.

Findings

Despite the benefits that information systems (ISs) offer to people and research, it seems that technology has made it possible to objectify researchers and research. This has a negative impact on the academe and should thus be looked into especially by the IS field, which should note the problems that exist in its core. This phenomenon of quantified academics is clearly visible at academic quantification sites, where academics are evaluated using metrics that count their output. It seems that the essence of technology has disturbed the way research is valued by emphasising its quantifiable aspects. The study claims that it is important to look for other ways to evaluate researchers rather than trying to maximise research production, which has led to the flooding of articles that few have the time or interest to read.

Originality/value

This paper offers new insights into the current phenomenon of quantification of academics and underlines the need for critical changes if in order to achieve the academic culture that is desirable for future academics.

Details

Information Technology & People, vol. 37 no. 8
Type: Research Article
ISSN: 0959-3845

Keywords

Open Access
Article
Publication date: 21 September 2022

Murniati Mukhlisin, Nurizal Ismail and Reza Jamilah Fikri

This study aims to analyse whether theories and views of classical Islamic scholars are widely adopted as references in Islamic accounting and finance (IAF), Islamic economics…

3371

Abstract

Purpose

This study aims to analyse whether theories and views of classical Islamic scholars are widely adopted as references in Islamic accounting and finance (IAF), Islamic economics (IE) and Islamic business management (IBM) research studies as part of their contribution to solving current economic and financial problems.

Design/methodology/approach

The research adopts a qualitative meta-analysis methodology using NVivo 12 with selected data from 474 international journal articles published between 1981 and 2021. The study considers 172 IAF articles, 111 IE articles and 191 IBM articles.

Findings

The results of the study show that the use of theories and views of classical Islamic scholars is not widespread among the examined research papers. The findings show that 90% of researchers tend to acquire modern economics, management, psychological and sociological theories instead of classical theories. Both modern and classical theories have been discussed in the studied articles namely agency theory, stakeholders' theory, ḥisbah (accountability), maqāṣid al-Sharīʿah (objectives of Islamic law) and waʿd (unilateral promise). The gaps prevail not only in the taxonomy of terms but also in the choice of paradigm references. It is found that 66% of the 474 journal articles adopt a positivist paradigm, followed by interpretivism (19%), post-structuralism (9%) and critical orientation (6%).

Research limitations/implications

This paper considers only ABS ranking journal articles. Future research may consider other journal articles from different ranking groups such as Scopus or Thomson & Reuters.

Practical implications

The paper sheds light on how Islamic educational institutions can develop strategies for the Integration of Knowledge (IOK) in their curriculum.

Social implications

This paper helps to shape the Muslims' way of thinking within an Islamic worldview which will lead to an Islamic way of expressing knowledge, skill and behaviour.

Originality/value

This paper contributes to the model of IOK that has been deliberated among Islamic universities, especially those that develop IAF, IE and IBM studies.

Details

ISRA International Journal of Islamic Finance, vol. 14 no. 3
Type: Research Article
ISSN: 0128-1976

Keywords

1 – 10 of over 3000