title: Bibliometrics of systematic reviews: analysis of citation rates and journal impact factors.
abstract: BACKGROUND
  Systematic reviews are important for informing clinical practice and health policy. The aim of this study was to examine the bibliometrics of systematic reviews and to determine the amount of variance in citations predicted by the journal impact factor (JIF) alone and combined with several other characteristics.
  
  
  METHODS
  We conducted a bibliometric analysis of 1,261 systematic reviews published in 2008 and the citations to them in the Scopus database from 2008 to June 2012. Potential predictors of the citation impact of the reviews were examined using descriptive, univariate and multiple regression analysis.
  
  
  RESULTS
  The mean number of citations per review over four years was 26.5 (SD ± 29.9) or 6.6 citations per review per year. The mean JIF of the journals in which the reviews were published was 4.3 (SD ± 4.2). We found that 17% of the reviews accounted for 50% of the total citations and 1.6% of the reviews were not cited. The number of authors was correlated with the number of citations (r = 0.215, P < 0.001). Higher numbers of citations were associated with the following characteristics: first author from the United States (36.5 citations), an ICD-10 chapter heading of Neoplasms (31.8 citations), type of intervention classified as Investigation, Diagnostics or Screening (34.7 citations) and having an international collaboration (32.1 citations). The JIF alone explained more than half of the variation in citations (R(2) = 0.59) in univariate analysis. Adjusting for both JIF and type of intervention increased the R2 value to 0.81. Fourteen percent of reviews published in the top quartile of JIFs (≥ 5.16) received citations in the bottom quartile (eight or fewer), whereas 9% of reviews published in the lowest JIF quartile (≤ 2.06) received citations in the top quartile (34 or more). Six percent of reviews in journals with no JIF were also in the first quartile of citations.
  
  
  CONCLUSIONS
  The JIF predicted over half of the variation in citations to the systematic reviews. However, the distribution of citations was markedly skewed. Some reviews in journals with low JIFs were well-cited and others in higher JIF journals received relatively few citations; hence the JIF did not accurately represent the number of citations to individual systematic reviews.
authors.affiliation: Division of Health Sciences, Warwick Medical School, University of Warwick, CV4 7AL, Coventry, UK. p.l.royle@warwick.ac.uk.
authors.forename: Pamela
authors.initials: P
authors.lastname: Royle
authors.forename: Ngianga-Bakwin
authors.initials: NB
authors.lastname: Kandala
authors.forename: Katharine
authors.initials: K
authors.lastname: Barnard
authors.forename: Norman
authors.initials: N
authors.lastname: Waugh
mesh_terms: D001319:Authorship; D035843:Biomedical Research; D006801:Humans; D055811:Journal Impact Factor; D010506:Periodicals as Topic / Q000706:statistics & numerical data*; D012196:Review Literature as Topic
references.citation: PLoS One. 2012;7(5):e36626
references.pmid: 22574201
references.citation: PLoS Med. 2010 Sep 21;7(9):e1000326
references.pmid: 20877712
references.citation: Neth Heart J. 2012 Oct;20(10):385-6
references.pmid: 22945266
references.citation: Can J Surg. 2007 Apr;50(2):119-23
references.pmid: 17550715
references.citation: BMJ. 2008 Mar 22;336(7645):655-7
references.pmid: 18292132
references.citation: BMJ. 1997 Feb 15;314(7079):498-502
references.pmid: 9056804
references.citation: PLoS One. 2013;8(2):e49476
references.pmid: 23405060
references.citation: J Clin Epidemiol. 2008 May;61(5):449-54
references.pmid: 18394537
references.citation: J Clin Epidemiol. 2008 May;61(5):419-21
references.pmid: 18394533
references.citation: J Child Psychol Psychiatry. 2012 Sep;53(9):915-7
references.pmid: 22924400
references.citation: Cardiovasc Res. 2004 Feb 1;61(2):201-3
references.pmid: 14736534
references.citation: J Clin Epidemiol. 2009 Oct;62(10):1006-12
references.pmid: 19631508
references.citation: Reprod Biomed Online. 2012 May;24(5):485-6
references.pmid: 22578381
references.citation: Pharmacotherapy. 2006 Jun;26(6):759-67
references.pmid: 16716129
references.citation: Chest. 2013 Jan;143(1):1-4
references.pmid: 23276834
references.citation: BJU Int. 2011 Jun;107(12):1876-80
references.pmid: 21332629
references.citation: PLoS Med. 2009 Jul 21;6(7):e1000100
references.pmid: 19621070
references.citation: BMC Med Res Methodol. 2004 May 28;4:14
references.pmid: 15169549
references.citation: JAMA. 2002 Jun 5;287(21):2847-50
references.pmid: 12038930
references.citation: BMJ. 2013 Jul 19;347:f4501
references.pmid: 23873947
references.citation: J Clin Epidemiol. 2012 Dec;65(12):1274-81
references.pmid: 22959593
references.citation: BMC Med. 2003 Nov 24;1:2
references.pmid: 14633274
references.citation: J Clin Epidemiol. 2011 Mar;64(3):331-8
references.pmid: 20947295
references.citation: Br J Gen Pract. 2012 Jul;62(600):371
references.pmid: 22781982
references.citation: Can J Physiol Pharmacol. 2012 Apr;90(4):iii-iv
references.pmid: 22423891
references.citation: Ann Intern Med. 2007 Aug 21;147(4):273-4
references.pmid: 17638716
references.citation: PLoS One. 2007 May 02;2(5):e403
references.pmid: 17476325
references.citation: Eur Heart J. 2012 Dec;33(24):3034-45
references.pmid: 22669850
references.citation: Int J Technol Assess Health Care. 1999 Fall;15(4):671-8
references.pmid: 10645108
references.citation: Orthodontics (Chic.). 2012;13(1):184-91
references.pmid: 22567631
references.citation: Dig Liver Dis. 2010 Jan;42(1):1-5
references.pmid: 19665955
references.citation: JAMA. 2005 May 18;293(19):2362-6
references.pmid: 15900006
references.citation: Crit Care Med. 2007 Feb;35(2):589-94
references.pmid: 17205029