Citation impact of NHLBI R01 grants funded through the American Recovery and Reinvestment Act as compared to R01 grants funded through a standard payline.
BACKGROUND
The American Recovery and Reinvestment Act (ARRA) allowed National Heart, Lung, and Blood Institute to fund R01 grants that fared less well on peer review than those funded by meeting a payline threshold. It is not clear whether the sudden availability of additional funding enabled research of similar or lesser citation impact than already funded work.


OBJECTIVE
To compare the citation impact of ARRA-funded de novo National Heart, Lung, and Blood Institute R01 grants with concurrent de novo National Heart, Lung, and Blood Institute R01 grants funded by standard payline mechanisms.


RESULTS
We identified de novo (type 1) R01 grants funded by National Heart, Lung, and Blood Institute in fiscal year 2009: these included 458 funded by meeting Institute's published payline and 165 funded only because of ARRA funding. Compared with payline grants, ARRA grants received fewer total funds (median values, $1.03 versus $1.87 million; P<0.001) for a shorter duration (median values including no-cost extensions, 3.0 versus 4.9 years; P<0.001). Through May 2014, the payline R01 grants generated 3895 publications, whereas the ARRA R01 grants generated 996. Using the InCites database from Thomson-Reuters, we calculated a normalized citation impact for each grant by weighting each article for the number of citations it received normalizing for subject, article type, and year of publication. The ARRA R01 grants had a similar normalized citation impact per $1 million spent as the payline grants (median values [interquartile range], 2.15 [0.73-4.68] versus 2.03 [0.75-4.10]; P=0.61). The similar impact of the ARRA grants persisted even after accounting for potential confounders.


CONCLUSIONS
Despite shorter durations and lower budgets, ARRA R01 grants had comparable citation outcomes per $million spent to that of contemporaneously funded payline R01 grants.
From the Division of Cardiovascular Sciences (N.S.D., C.O.W., M.S.L.) and Division of Blood Diseases and Disorders (D.M.D., W.K.H.), National Heart, Lung, and Blood Institute, National Institutes of Health (NHLBI), Bethesda, MD.
Narasimhan S
NS
Danthi
From the Division of Cardiovascular Sciences (N.S.D., C.O.W., M.S.L.) and Division of Blood Diseases and Disorders (D.M.D., W.K.H.), National Heart, Lung, and Blood Institute, National Institutes of Health (NHLBI), Bethesda, MD.
Colin O
CO
Wu
From the Division of Cardiovascular Sciences (N.S.D., C.O.W., M.S.L.) and Division of Blood Diseases and Disorders (D.M.D., W.K.H.), National Heart, Lung, and Blood Institute, National Institutes of Health (NHLBI), Bethesda, MD.
Donna M
DM
DiMichele
From the Division of Cardiovascular Sciences (N.S.D., C.O.W., M.S.L.) and Division of Blood Diseases and Disorders (D.M.D., W.K.H.), National Heart, Lung, and Blood Institute, National Institutes of Health (NHLBI), Bethesda, MD.
W Keith
WK
Hoots
From the Division of Cardiovascular Sciences (N.S.D., C.O.W., M.S.L.) and Division of Blood Diseases and Disorders (D.M.D., W.K.H.), National Heart, Lung, and Blood Institute, National Institutes of Health (NHLBI), Bethesda, MD. lauerm@nhlbi.nih.gov.
Michael S
MS
Lauer
D057171:American Recovery and Reinvestment Act; D015706:Bibliometrics; D002017:Budgets; D003362:Cost-Benefit Analysis; D016206:Databases, Bibliographic / Q000706:statistics & numerical data; D005380:Financing, Government / Q000191:economics* / Q000331:legislation & jurisprudence / Q000706:statistics & numerical data; D006801:Humans; D054555:National Heart, Lung, and Blood Institute (U.S.) / Q000191:economics*; D012108:Research Personnel / Q000706:statistics & numerical data; D012109:Research Support as Topic / Q000191:economics* / Q000331:legislation & jurisprudence / Q000706:statistics & numerical data; D014481:United States
bibliometrics; economics