A method for the automated, reliable retrieval of publication-citation records.
BACKGROUND
Publication records and citation indices often are used to evaluate academic performance. For this reason, obtaining or computing them accurately is important. This can be difficult, largely due to a lack of complete knowledge of an individual's publication list and/or lack of time available to manually obtain or construct the publication-citation record. While online publication search engines have somewhat addressed these problems, using raw search results can yield inaccurate estimates of publication-citation records and citation indices.


METHODS
In this paper, we present a new, automated method that produces estimates of an individual's publication-citation record from an individual's name and a set of domain-specific vocabulary that may occur in the individual's publication titles. Because this vocabulary can be harvested directly from a research web page or online (partial) publication list, our method delivers an easy way to obtain estimates of a publication-citation record and the relevant citation indices. Our method works by applying a series of stringent name and content filters to the raw publication search results returned by an online publication search engine. In this paper, our method is run using Google Scholar, but the underlying filters can be easily applied to any existing publication search engine. When compared against a manually constructed data set of individuals and their publication-citation records, our method provides significant improvements over raw search results. The estimated publication-citation records returned by our method have an average sensitivity of 98% and specificity of 72% (in contrast to raw search result specificity of less than 10%). When citation indices are computed using these records, the estimated indices are within of the true value 10%, compared to raw search results which have overestimates of, on average, 75%.


CONCLUSIONS
These results confirm that our method provides significantly improved estimates over raw search results, and these can either be used directly for large-scale (departmental or university) analysis or further refined manually to quickly give accurate publication-citation records.
Ruths
Derek
D
Department of Computer Science, McGill University, Montreal, Quebec, Canada. druths@ruthsresearch.org
Al Zamal
Faiyaz
F
D001331:Automation; D015706:Bibliometrics; D020407:Internet; D011643:Publishing / Q000706:statistics & numerical data*; D015203:Reproducibility of Results; D012108:Research Personnel / Q000706:statistics & numerical data*; D057386:Search Engine / Q000379:methods*; D014825:Vocabulary
Proc Natl Acad Sci U S A. 2005 Nov 15;102(46):16569-72
16275915
PLoS One. 2009;4(5):e5429
19415119