title: Comparison of effects in randomized controlled trials with observational studies in digestive surgery.
abstract: OBJECTIVE
  To compare the results of randomized controlled trials versus observational studies in meta-analyses of digestive surgical topics.
  
  
  BACKGROUND
  While randomized controlled trials have been recognized as providing the highest standard of evidence, claims have been made that observational studies may overestimate treatment benefits. This debate has recently been renewed, particularly with regard to pharmacotherapies.
  
  
  METHODS
  The PubMed (1966 to April 2004), EMBASE (1986 to April 2004) and Cochrane databases (Issue 2, 2004) were searched to identify meta-analyses of randomized controlled trials in digestive surgery. Fifty-two outcomes of 18 topics were identified from 276 original articles (96 randomized trials, 180 observational studies) and included in meta-analyses. All available binary data and study characteristics were extracted and combined separately for randomized and observational studies. In each selected digestive surgical topic, summary odds ratios or relative risks from randomized controlled trials were compared with observational studies using an equivalent calculation method.
  
  
  RESULTS
  Significant between-study heterogeneity was seen more often among observational studies (5 of 12 topics) than among randomized trials (1 of 9 topics). In 4 of the 16 primary outcomes compared (10 of 52 total outcomes), summary estimates of treatment effects showed significant discrepancies between the two designs.
  
  
  CONCLUSIONS
  One fourth of observational studies gave different results than randomized trials, and between-study heterogeneity was more common in observational studies in the field of digestive surgery.
authors.affiliation: Department of Digestive Surgery, Kyoto Prefectural University of Medicine, Kyoto, Japan.
authors.forename: Satoru
authors.initials: S
authors.lastname: Shikata
authors.forename: Takeo
authors.initials: T
authors.lastname: Nakayama
authors.forename: Yoshinori
authors.initials: Y
authors.lastname: Noguchi
authors.forename: Yoshinori
authors.initials: Y
authors.lastname: Taji
authors.forename: Hisakazu
authors.initials: H
authors.lastname: Yamagishi
mesh_terms: D013505:Digestive System Surgical Procedures / Q000592:standards*; D006801:Humans; D019370:Observation / Q000379:methods*; D016032:Randomized Controlled Trials as Topic / Q000379:methods*; D012189:Retrospective Studies