Analysing the relationship between altmetric attention score (AAS) and citation: a correlational study

Abstract

Purpose

The purpose of this study is to assess the value of altmetrics or other indicators, showcasing the impact of academic output, which is seen too often correlated with the citation count.

Design/methodology/approach

This study considered three reputed journals of Library and Information Science (LIS) published by Elsevier. A total of 1,164 articles were found in these journals from 2016 to 2020 and the relationships between altmetric attention scores (AAS) and citations were examined. The analysis was extended to compare the grouped data set based on percentile ranks of AAS like top 50%, top 25%, top 10% and top 1%.

Findings

Using Spearman correlation analysis, the findings reveal a positive correlation between AAS and citations with different significant levels for all articles, and articles with AAS, as well as for normalized AAS in the top 50%, top 25%, top 10% and top 1% data set. For the three journals International Journal of Information Management (IJIM), Journal of Informetrics (JIF) and Library and Information Science Research (LISR), a significant positive correlation is observed across all data sets. But an unexpected result was observed: in the case of the top 50% of articles for the IJIM and JIF showed no significant correlation but the LISR journal showed a positive correlation for the whole data set. This journal though has fewer articles in comparison to the other two.

Research limitations/implications

A source item that is highly cited may not be having high social media attention as reflected in the findings. This demarcates AAS with citations implying various factors on which these measurements are dependent. The study distinguishes these metrics lucidly. There is not a single guideline or uniformity in assessing the correlation found. But the problem is that the interpretation of the correlation strength affects the conclusion of the study. Moreover, this study will be a role model as a draft for librarians to select relevant journals for their libraries and will facilitate authors in the choice of the publication outlets for their papers, particularly concerning the journals that have both visibility and research impact.

Originality/value

The study reported devising a comprehensive tool to validate AAS as a measure of scholarly impact to include appropriate social media sources and verify its relationship with other metrics. To the best of the authors’ knowledge, this paper is the first attempt to discover the correlation between AAS and citations for the highly impactful LIS journal published by Elsevier. The empirical evidence lies in the citation and altmetric data extracted from the dimension database.

Citation

Borgohain, D.J., Yuvaraj, M. and Verma, M.K. (2024), "Analysing the relationship between altmetric attention score (AAS) and citation: a correlational study", Information Discovery and Delivery, Vol. 52 No. 1, pp. 11-22. https://doi.org/10.1108/IDD-05-2022-0035