Circulation Research RES Percentile Ranking and Citation Impact of a Large Cohort of NHLBI-Funded Cardiovascular R01 Grants Percentile Rankings of R01 Grants CIRCRES/2013/302656 CIRCRES/2013/302656 10.1161/CIRCRESAHA.114.302656 114 02/14/14 4 Bridges-Lyman Gemma 410-3275005 410-3279322 Bolli, Roberto University of Louisville Dr. Michael S. Lauer lauerm@nhlbi.nih.gov Dr. NHLBI 6701 Rockledge Dr, Room 8128 Bethesda Maryland NA UNITED STATES 3014350422 16624 Narasimhan Danthi NHLBI ndanthi@mail.nih.gov 166443 Colin O. Wu NHLBI wuc@nhlbi.nih.gov 96089 Peibei Shi NHLBI pshi2@illinois.edu 166444 Michael S. Lauer NHLBI lauerm@nhlbi.nih.gov 16624 09/19/2013 09/19/2013 01/03/2014 01/08/2014 01/09/2014 Special Article bibliometrics NHLBI research funding scientific impact <p><i><b><u>Rationale:</u></b></i> Funding decisions for cardiovascular R01 grant applications at NHLBI largely hinge on percentile rankings. It is not known whether this approach enables the highest impact science. </p><p><i><b><u>Objective:</u></b></i> To conduct an observational analysis of percentile rankings and bibliometric outcomes for a contemporary set of funded NHLBI cardiovascular R01 grants. </p><p><i><b><u>Methods and Results:</u></b></i> We identified 1492 investigator-initiated de novo R01 grant applications that were funded between 2001 and 2008, and followed their progress for linked publications and citations to those publications. Our co-primary endpoints were citations received per million dollars of funding, citations obtained within 2-years of publication, and 2-year citations for each grant's maximally cited paper. In 7654 grant-years of funding that generated $3004 million of total NIH awards, the portfolio yielded 16,793 publications that appeared between 2001 and 2012 (median per grant 8, 25th and 75th percentiles 4 and 14, range 0 - 123), which received 2,224,255 citations (median per grant 1048, 25th and 75th percentiles 492 and 1,932, range 0 - 16,295). We found no association between percentile ranking and citation metrics; the absence of association persisted even after accounting for calendar time, grant duration, number of grants acknowledged per paper, number of authors per paper, early investigator status, human versus non-human focus, and institutional funding. An exploratory machine-learning analysis suggested that grants with the very best percentile rankings did yield more maximally cited papers. </p><p><i><b><u>Conclusions:</u></b></i> In a large cohort of NHLBI-funded cardiovascular R01 grants, we were unable to find a monotonic association between better percentile ranking and higher scientific impact as assessed by citation metrics.</p> 2 0 0 5 5 no yes CircRes_CIRCRES-2013-302656.xml CircRes_CIRCRES-2013-302656_file1.docx

CircRes_CIRCRES-2013-302656_fig1_4C.pptx

CircRes_CIRCRES-2013-302656_fig2_4C.tif

CircRes_CIRCRES-2013-302656_fig3_4C.tif

CircRes_CIRCRES-2013-302656_fig4_4C.tif

CircRes_CIRCRES-2013-302656_fig5_4C.tif

CircRes_CIRCRES-2013-302656_fig6_4C.tif

CircRes_CIRCRES-2013-302656_supp1.pdf CircRes_CIRCRES-2013-302656_merge.pdf CircRes_CIRCRES-2013-302656_Wu_96089_disclosure.pdf CircRes_CIRCRES-2013-302656_Wu_96089_copyright.pdf CircRes_CIRCRES-2013-302656_Shi_166444_disclosure.pdf CircRes_CIRCRES-2013-302656_Shi_166444_copyright.pdf CircRes_CIRCRES-2013-302656_Lauer_16624_disclosure.pdf CircRes_CIRCRES-2013-302656_Lauer_16624_copyright.pdf CircRes_CIRCRES-2013-302656_Danthi_166443_disclosure.pdf CircRes_CIRCRES-2013-302656_Danthi_166443_copyright.pdf NHLBI page Funding: Howard Hughes Medical Institute (HHMI): No National Institutes of Health (NIH): Yes Not applicable for this manuscript: No Other: No Wellcome Trust: No Subject Codes: [98] Other research gbridgeslyman