Novel bibliometric scores for evaluating research quality and output: a correlation study with established indexes.
BACKGROUND
Novel bibliometric indexes (commonly known as altmetrics) are gaining interest within the scientific community and might represent an important alternative measure of research quality and output.


OBJECTIVE
We evaluate how these new metrics correlate with established bibliometric indexes such as the impact factor (IF), currently used as a measure of scientific production as well as a criterion for scientific research funding, and how they might be helpful in assessing the impact of research.


METHODS
We calculated altmetrics scores for all the articles published at our institution during a single year and examined the correlation between altmetrics scores and IFs as a measure of research quality and impact in all departments.


RESULTS
For all articles from the various departments published in a single year, the altmetrics score and the sum of all IFs showed a strong and significant correlation (Spearman's rho 0.88). The correlation was significant also when the major components of altmetrics, including Facebook, Twitter and Mendeley, were analyzed. The implementation of altmetrics has been found to be easy and effective at both the researcher and librarian levels.


CONCLUSIONS
The novel bibliographic index altmetrics is consistent and reliable and can complement or be considered a valid alternative to standard bibliometric indexes to benchmark output and quality of research for academic and funding purposes.
Center for Scientific Documentation, Fondazione IRCCS Policlinico San Matteo, Pavia - Italy.|ALMT-ALL Metrics Team, Fondazione IRCCS Policlinico San Matteo, Pavia - Italy.
Valeria
V
Scotti
Service of Biometry & Statistics Unit, Fondazione IRCCS Policlinico San Matteo, Pavia - Italy.|ALMT-ALL Metrics Team, Fondazione IRCCS Policlinico San Matteo, Pavia - Italy.
Annalisa
A
De Silvestri
Service of Biometry & Statistics Unit, Fondazione IRCCS Policlinico San Matteo, Pavia - Italy.|ALMT-ALL Metrics Team, Fondazione IRCCS Policlinico San Matteo, Pavia - Italy.
Luigia
L
Scudeller
Center for Scientific Documentation, Fondazione IRCCS Policlinico San Matteo, Pavia - Italy.
Paola
P
Abele
Center for Scientific Documentation, Fondazione IRCCS Policlinico San Matteo, Pavia - Italy.
Funda
F
Topuz
Center for Scientific Documentation, Fondazione IRCCS Policlinico San Matteo, Pavia - Italy.
Moreno
M
Curti
D015706:Bibliometrics; D006801:Humans; D055811:Journal Impact Factor; D011643:Publishing / Q000592:standards* / Q000706:statistics & numerical data; D012106:Research / Q000592:standards