title: Methodological Quality of Surgical Mortality Studies Using Large Hospital Databases: A Systematic Review.
abstract: To review the methodology employed in surgical mortality studies to control for potential confounders.
  
  
  
  Nationwide hospital data are increasingly used to investigate surgical outcomes. However, poor data granularity and coding inaccuracies may lead to flawed findings.
  
  
  
  We conducted a systematic review in accordance with the PRISMA statement in 6 major journals (NEJM, Lancet, BMJ, JAMA, Medical Care, Annals of Surgery) using PubMed from its inception until December 31, 2014. Two reviewers independently reviewed citations. Using a predesigned data collection form, we extracted information about study aim and design, data source, selected population, outcome definition, patient and hospital adjustment, statistics, and sensitivity analyses. The methodological quality of studies was assessed based on 5 criteria and explored over time.
  
  
  
  Among 89 included studies from 1987 to 2014, 54 explored surgical mortality determinants, 13 compared surgical procedure effectiveness, 13 evaluated the impact of healthcare policy, and 9 described outcome trends for specific procedures. A total of 89% (n = 79) of studies did not describe population selection criteria at patient and hospital level, 64% (n = 57) did not consider secular trends, 52% (n = 46) neglected hospital clustering or characteristics, 21% (n = 19) did not perform sensitivity analyses, and 4% did not adjust outcomes for patient risk (n = 4). The percentage of studies satisfying at least 3 of these criteria increased significantly from 44% before 1999 to 52% between 2000 and 2009 and 78% after 2010 (P = 0.008).
  
  
  
  Although methodological quality of studies has improved over time, confounder control could be improved through better study design, homogeneous population selection, the consideration of hospital factors and secular trends influencing surgical mortality, and the systematic performance of sensitivity analyses.
authors.affiliation: *Department of Medical Information Evaluation and Research, Lyon University Hospital, Lyon, France †Health Services and Performance Research Lab (EA 7425 HESPER), Lyon 1 Claude Bernard University, Lyon, France ‡Department of General and Endocrine Surgery, Lyon University Hospital, Lyon, France §Center for Surgery and Public Health, Brigham and Women's Hospital-Harvard Medical School, Boston, MA ¶Department of Biostatistics, Lyon University Hospital, Lyon, France ||Biometry and Evolutionary Biology Laboratory (CNRS, UMR5558), Lyon 1 Claude Bernard University, Villeurbanne, France.
authors.forename: Cécile
authors.initials: C
authors.lastname: Payet
authors.forename: Jean-Christophe
authors.initials: JC
authors.lastname: Lifante
authors.forename: Matthew J
authors.initials: MJ
authors.lastname: Carty
authors.forename: Muriel
authors.initials: M
authors.lastname: Rabilloud
authors.forename: Antoine
authors.initials: A
authors.lastname: Duclos
mesh_terms: D015986:Confounding Factors, Epidemiologic; D003627:Data Interpretation, Statistical; D016208:Databases, Factual; D017052:Hospital Mortality; D006801:Humans; D012107:Research Design / Q000592:standards*; D013514:Surgical Procedures, Operative / Q000401:mortality*