title: A systematic review of spinal research conducted using the National Surgical Quality Improvement Program.
abstract: Over the course of the last decade, interest in the use of large data repositories for clinical research in orthopedic and spine surgery has grown substantially. Detractors maintain that the clinical relevance of research conducted using large registries is limited, and that the academic influence of such studies is minimal. Such contentions have not been empirically evaluated.
  
  
  
  This study sought to perform a systematic review of spinal research conducted using the National Surgical Quality Improvement Program (NSQIP).
  
  
  
  This is a systematic review.
  
  
  
  Impact factor (IF) of the journal of publication and number of citations of published articles conducted using the NSQIP.
  
  
  
  Orthopedic and spine-specific NSQIP articles published from January 1, 2007 to July 31, 2015, were identified through a query of PubMed or Medline, Embase, Web of Science, and Scopus. Articles were classified by journal of publication, year of publication, study topic, study purpose, and method of statistical analysis. Spine surgical publications were compared with other orthopedic research conducted using the NSQIP. The primary dependent variables for the purposes of statistical testing were IF of the journal in which the article was published and the number of citations for each publication. Negative binomial regression was used to evaluate the characteristics of papers associated with increased IF and number of citations.
  
  
  
  Of the 1,525 articles identified in the initial search, 114 studies were considered eligible for inclusion in the systematic review. The average IF for the journals publishing orthopedic NSQIP articles was 2.75 (standard deviation [SD] 1.22, range 0-5.28), whereas it was 2.52 (SD 0.81, range 1.38-5.28) for spinal research. The average number of citations per article was 6.08 (SD 10.9, range 0-69) and 6.4 (SD 12.0, range 0-69) for spine-specific studies. Following negative binomial regression, only IF (regression coefficients [RC] 0.31; 95% confidence intervals [CI] 0.08, 0.55) and the year of publication (RC -1.29; 9% CI -1.64, -0.95) were found to have a statistically significant association with number of citations. Among spine-specific research articles, only the year of publication was found to influence the number of citations (RC -1.29; 95% CI -1.94, -0.64).
  
  
  
  Our findings indicate that the academic impact of orthopedic and spine surgical research conducted using NSQIP is highly variable, with most publications found to have relatively low impact. As our evaluation of study characteristics associated with high-impact publications and increased citations were unable to uncover factors that are likely translatable, we suggest following research design guidelines that highlight best practices when using large datasets for orthopedic research.
authors: Harvard Combined Orthopaedic Residency Program, Massachusetts General Hospital, 55 Fruit St, Boston, MA 02114, USA.
authors: Youssra
authors: Y
authors: Marjoua
authors: Harvard Medical School, 25 Shattuck St, Boston, MA 02115, USA.
authors: Ryan
authors: R
authors: Xiao
authors: Harvard Medical School, 25 Shattuck St, Boston, MA 02115, USA.
authors: Cameron
authors: C
authors: Waites
authors: Harvard Medical School, 25 Shattuck St, Boston, MA 02115, USA.
authors: Brian W
authors: BW
authors: Yang
authors: Department of Orthopaedic Surgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115, USA.
authors: Mitchel B
authors: MB
authors: Harris
authors: Department of Orthopaedic Surgery, Brigham and Women's Hospital, Harvard Medical School, 75 Francis St, Boston, MA 02115, USA. Electronic address: ajschoen@neomed.edu.
authors: Andrew J
authors: AJ
authors: Schoenfeld
mesh_terms: D035843:Biomedical Research / Q000592:standards*; D006801:Humans; D055811:Journal Impact Factor; D009985:Orthopedics / Q000458:organization & administration / Q000592:standards*; D015397:Program Evaluation; D058996:Quality Improvement; D012955:Societies, Medical; D013122:Spinal Diseases / Q000628:therapy; D014481:United States
keywords: Academic influence; Citation analysis; Impact factor; National Surgical Quality Improvement Program; Systematic review; h-index