To read the full version of this content please select one of the options below:

Bemused by bibliometrics: using citation analysis to evaluate research quality

Nicholas Joint (Andersonian Library, University of Strathclyde, Glasgow, UK)

Library Review

ISSN: 0024-2535

Article publication date: 23 May 2008

Abstract

Purpose

The purpose of this paper is to examine the way in which library and information science (LIS) issues have been handled in the formulation of recent UK Higher Education policy concerned with research quality evaluation.

Design/methodology/approach

A chronological review of decision making about digital rights arrangements for the 2008 Research Assessment Exercise (RAE), and of recent announcements about the new shape of metrics‐based assessment in the Research Excellence Framework, which supersedes the RAE. Against this chronological framework, the likely nature of LIS practitioner reactions to the flow of decision making is suggested.

Findings

It was found that a weak grasp of LIS issues by decision makers undermines the process whereby effective research evaluation models are created. LIS professional opinion should be sampled before key decisions are made.

Research limitations/implications

This paper makes no sophisticated comments on the complex research issues underlying advanced bibliometric research evaluation models. It does point out that sophisticated and expensive bibliometric consultancies arrive at many conclusions about metrics‐based research assessment that are common knowledge amongst LIS practitioners.

Practical implications

Practical difficulties arise when one announces a decision to move to a new and specific type of research evaluation indicator before one has worked out anything very specific about that indicator.

Originality/value

In this paper, the importance of information management issues to the mainstream issues of government and public administration is underlined. The most valuable conclusion of this paper is that, because LIS issues are now at the heart of democratic decision making, LIS practitioners and professionals should be given some sort of role in advising on such matters.

Keywords

Citation

Joint, N. (2008), "Bemused by bibliometrics: using citation analysis to evaluate research quality", Library Review, Vol. 57 No. 5, pp. 346-357. https://doi.org/10.1108/00242530810875131

Publisher

:

Emerald Group Publishing Limited

Copyright © 2008, Emerald Group Publishing Limited