title: Percentile ranking and citation impact of a large cohort of National Heart, Lung, and Blood Institute-funded cardiovascular R01 grants.
abstract: BACKGROUND
  Funding decisions for cardiovascular R01 grant applications at the National Heart, Lung, and Blood Institute (NHLBI) largely hinge on percentile rankings. It is not known whether this approach enables the highest impact science.
  
  
  OBJECTIVE
  Our aim was to conduct an observational analysis of percentile rankings and bibliometric outcomes for a contemporary set of funded NHLBI cardiovascular R01 grants.
  
  
  RESULTS
  We identified 1492 investigator-initiated de novo R01 grant applications that were funded between 2001 and 2008 and followed their progress for linked publications and citations to those publications. Our coprimary end points were citations received per million dollars of funding, citations obtained <2 years of publication, and 2-year citations for each grant's maximally cited paper. In 7654 grant-years of funding that generated $3004 million of total National Institutes of Health awards, the portfolio yielded 16 793 publications that appeared between 2001 and 2012 (median per grant, 8; 25th and 75th percentiles, 4 and 14; range, 0-123), which received 2 224 255 citations (median per grant, 1048; 25th and 75th percentiles, 492 and 1932; range, 0-16 295). We found no association between percentile rankings and citation metrics; the absence of association persisted even after accounting for calendar time, grant duration, number of grants acknowledged per paper, number of authors per paper, early investigator status, human versus nonhuman focus, and institutional funding. An exploratory machine learning analysis suggested that grants with the best percentile rankings did yield more maximally cited papers.
  
  
  CONCLUSIONS
  In a large cohort of NHLBI-funded cardiovascular R01 grants, we were unable to find a monotonic association between better percentile ranking and higher scientific impact as assessed by citation metrics.
authors.affiliation: From the Advanced Technologies and Surgery Branch (N.D.), the Office of Biostatistics Research (C.O.W., P.S.), and the Office of the Director (M.L.), Division of Cardiovascular Sciences of the National Heart, Lung, and Blood Institute (NHLBI), Bethesda, MD.
authors.forename: Narasimhan
authors.initials: N
authors.lastname: Danthi
authors.forename: Colin O
authors.initials: CO
authors.lastname: Wu
authors.forename: Peibei
authors.initials: P
authors.lastname: Shi
authors.forename: Michael
authors.initials: M
authors.lastname: Lauer
mesh_terms: D015706:Bibliometrics; D002318:Cardiovascular Diseases; D017598:Efficiency, Organizational; D005381:Financing, Organized / Q000458:organization & administration / Q000706:statistics & numerical data; D006801:Humans; D055811:Journal Impact Factor; D054555:National Heart, Lung, and Blood Institute (U.S.); D012109:Research Support as Topic / Q000458:organization & administration / Q000706:statistics & numerical data*; D014481:United States
keywords: National Heart, Lung, and Blood Institute (U.S.); bibliometrics