Original Article

Comparison of altmetrics with conventional bibliometrics in the surgical literature

Authors: Shashank R Thyarala, Gerard T Flaherty.

ABSTRACT

Background: The impact of a research publication has traditionally been quantified by its citation count. Newer bibliometric indices such as Altmetric Attention Score (AAS) and article page views are emerging as supplementary measures to quantify the academic influence of research.

Objective: The aim of the current study was to interrogate the relationship between novel and traditional bibliometric indices for research published in a leading surgical journal and evaluate the role
of these newer indices in measuring the impact of surgical research.

Methods: All articles published in JAMA Surgery between 1 January 2019 and 1 September 2021 were
examined. The literature database PubMed was used to identify all articles published within the specified time period. Cumulative citation count (Web of Science), AAS and article page views were retrieved from the journal website. Statistical analysis using the Spearman rank correlation coefficient (r) was performed on Minitab 19.

Results: A total of 1,071 articles were retrieved for further analysis. The correlation (95% CI) between ranks for all articles was 0.635 (0.594-0.673) for AAS and citation scores, 0.680 (0.642-0.714) for citations and article page views, and 0.813 (0.788-0.835) for AAS and article page views.

Conclusions: We demonstrated a strong correlation between citations and AAS for articles published in a leading surgical journal. The inter-year correlation between 2019 and 2021 was similar, suggesting that AAS could be predictive of future citations. AAS may be useful in evaluating the wider societal impact of the surgical literature and could serve to promote greater public engagement in surgical research.

Keywords: Altmetrics; Bibliometrics; Surgical Research; Citations; Social Media; Citations.

Citations: IEJSME 2022 16 (2): 6-8

DOI: https://doi.org/10.56026/imu.16.2.6