title: Quality of conduct and reporting of meta-analyses of surgical interventions.
abstract: BACKGROUND
  Meta-analyses are useful tools for summarizing surgical evidence as they aim to encompass multiple sources of information on a particular research question, but they may be prone to methodological and reporting biases. We evaluated the conduct and reporting of meta-analyses of surgical interventions.
  
  
  RESULTS
  We performed a systematic review of 150 meta-analyses of randomized trials of surgical interventions published between January 2010 and June 2011. A comprehensive search strategy was executed using MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews. Data were independently extracted by 2 authors using the PRISMA statement (preferred reporting items for systematic reviews and meta-analyses, a standardized quality of reporting guideline) and AMSTAR (a tool for methodological quality). Descriptive statistics were used for individual items, and as a measure of overall compliance, PRISMA and AMSTAR scores were calculated as the sum of adequately reported domains. A median of 8 trials (interquartile range = 8) was included in each meta-analysis. One third of all meta-analyses had an author with a background in epidemiology and/or statistics. Forty-four percent were published in PRISMA-endorsing journals with a median impact factor of 3.5. There was moderate compliance with PRISMA, with an average of 71% of items reported, but poorer compliance with AMSTAR, with 48% of items adequately described, on average.
  
  
  CONCLUSIONS
  Substantial gaps in the conduct and reporting of meta-analyses within the surgical literature exist, mainly in the specification of aims and/or objectives, the use of preplanned protocols, and the evaluation of potential bias at the review (rather than trial) level. Editorial insistence on using reporting guidelines would improve this situation.
authors.affiliation: *South Western Sydney Clinical School, University of New South Wales †Whitlam Orthopaedic Research Centre, Ingham Institute for Applied Medical Research, Liverpool, New South Wales ‡School of Public Health, University of Sydney, Sydney, New South Wales §Centre for Kidney Research, The Children's Hospital at Westmead, Sydney, Australia.
authors.forename: Sam
authors.initials: S
authors.lastname: Adie
authors.forename: David
authors.initials: D
authors.lastname: Ma
authors.forename: Ian A
authors.initials: IA
authors.lastname: Harris
authors.forename: Justine M
authors.initials: JM
authors.lastname: Naylor
authors.forename: Jonathan C
authors.initials: JC
authors.lastname: Craig
mesh_terms: D015982:Bias; D066289:Data Curation / Q000379:methods / Q000592:standards; D055317:Evidence-Based Practice / Q000379:methods; D015201:Meta-Analysis as Topic; D015999:Multivariate Analysis; D017410:Practice Guidelines as Topic; D012107:Research Design; D018401:Sample Size; D013043:Specialties, Surgical / Q000592:standards / Q000706:statistics & numerical data*; D013514:Surgical Procedures, Operative / Q000592:standards / Q000706:statistics & numerical data*