title: Sex based subgroup differences in randomized controlled trials: empirical evidence from Cochrane meta-analyses.
abstract: OBJECTIVE
  To evaluate the frequency, validity, and relevance of statistically significant (P<0.05) sex-treatment interactions in randomized controlled trials in Cochrane meta-analyses.
  
  
  METHODS
  Meta-epidemiological study.
  
  
  METHODS
  Cochrane Database of Systematic Reviews (CDSR) and PubMed.
  
  
  METHODS
  Reviews published in the CDSR with sex-treatment subgroup analyses in the forest plots, using data from randomized controlled trials.
  
  
  METHODS
  Information on the study design and sex subgroup data were extracted from reviews and forest plots that met inclusion criteria. For each statistically significant sex-treatment interaction, the potential for biological plausibility and clinical significance was considered.
  
  
  RESULTS
  Among the 41 reviews with relevant data, there were 109 separate treatment-outcome analyses ("topics"). Among the 109 topics, eight (7%) had a statistically significant sex-treatment interaction. The 109 topics included 311 randomized controlled trials (162 with both sexes, 46 with males only, 103 with females only). Of the 162 individual randomized controlled trials that included both sexes, 15 (9%) had a statistically significant sex-treatment interaction. Of four topics where the first published randomized controlled trial had a statistically significant sex-treatment interaction, no meta-analyses that included other randomized controlled trials retained the statistical significance and no meta-analyses showed statistical significance when data from the first published randomized controlled trial were excluded. Of the eight statistically significant sex-treatment interactions from the overall analyses, only three were discussed by the CDSR reviewers for a potential impact on different clinical management for males compared with females. None of these topics had a sex-treatment interaction that influenced treatment recommendations in recent guidelines. UpToDate, an online physician-authored clinical decision support resource, suggested differential management of men and women for one of these sex-treatment interactions.
  
  
  CONCLUSIONS
  Statistically significant sex-treatment interactions are only slightly more frequent than what would be expected by chance and there is little evidence of subsequent corroboration or clinical relevance of sex-treatment interactions.
authors.affiliation: Department of Health Research and Policy, and Meta-Research Innovation Center at Stanford (METRICS), Stanford, CA, USA.
authors.forename: Joshua D
authors.initials: JD
authors.lastname: Wallach
authors.affiliation: Department of Health Research and Policy, and Meta-Research Innovation Center at Stanford (METRICS), Stanford, CA, USA.
authors.forename: Patrick G
authors.initials: PG
authors.lastname: Sullivan
authors.affiliation: Stanford Prevention Research Center, Stanford University, Stanford, CA, USA.
authors.forename: John F
authors.initials: JF
authors.lastname: Trepanowski
authors.affiliation: Department of Public Health, Erasmus MC, Rotterdam, Netherlands.
authors.forename: Ewout W
authors.initials: EW
authors.lastname: Steyerberg
authors.affiliation: Departments of Medicine, Health Research and Policy, and Statistics, and Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, California, CA 94305, USA jioannid@stanford.edu.
authors.forename: John P A
authors.initials: JP
authors.lastname: Ioannidis
mesh_terms: D001569:Benzodiazepines / Q000009:adverse effects / Q000627:therapeutic use; D015982:Bias; D016893:Carotid Stenosis / Q000453:epidemiology / Q000628:therapy; D016894:Endarterectomy, Carotid / Q000706:statistics & numerical data; D005260:Female; D006801:Humans; D006966:Hyperprolactinemia / Q000139:chemically induced / Q000453:epidemiology; D015994:Incidence; D008175:Lung Neoplasms / Q000453:epidemiology / Q000628:therapy; D008297:Male; D000077152:Olanzapine; D017063:Outcome Assessment, Health Care / Q000706:statistics & numerical data; D011388:Prolactin / Q000097:blood; D016032:Randomized Controlled Trials as Topic / Q000706:statistics & numerical data*; D018967:Risperidone / Q000009:adverse effects / Q000627:therapeutic use; D012737:Sex Factors; D020521:Stroke / Q000453:epidemiology / Q000517:prevention & control
chemical_list: D001569:Benzodiazepines; D011388:Prolactin; D018967:Risperidone; D000077152:Olanzapine