Quantitative deconstruction of citation impact indicators

A.J. Nederhof (Center for Science and Technology Studies (CWTS), Leiden University, Leiden, The Netherlands)
M.S. Visser (Center for Science and Technology Studies (CWTS), Leiden University, Leiden, The Netherlands)

Journal of Documentation

ISSN: 0022-0418

Publication date: 1 December 2004


In two case studies of research units, reference values used to benchmark research performance appeared to show contradictory results: the average citation level in the subfields (FCSm) increased world‐wide, while the citation level of the journals (JCSm) decreased, where concomitant changes were expected. Explanations were sought in: a shift in preference of document types; a change in publication preference for subfields; and changes in journal coverage. Publishing in newly covered journals with a low impact had a negative effect on impact ratios. However, the main factor behind the increase in FCSm was the distribution of articles across the five‐year block periods that were studied. Publication in lower impact journals produced a lagging JCSm. Actual values of JCSm, FCSm, and citations per publication (CPP) values are not very informative either about research performance, or about the development of impact over time in a certain subfield with block indicators. Normalized citation impact indicators are free from such effects and should be consulted primarily in research performance assessments.



Nederhof, A. and Visser, M. (2004), "Quantitative deconstruction of citation impact indicators", Journal of Documentation, Vol. 60 No. 6, pp. 658-672. https://doi.org/10.1108/00220410410568142

Download as .RIS



Emerald Group Publishing Limited

Copyright © 2004, Emerald Group Publishing Limited

Please note you might not have access to this content

You may be able to access this content by login via Shibboleth, Open Athens or with your Emerald account.
If you would like to contact us about accessing this content, click the button and fill out the form.
To rent this content from Deepdyve, please click the button.