title: Randomisation to protect against selection bias in healthcare trials.
abstract: BACKGROUND
  Randomised trials use the play of chance to assign participants to comparison groups. The unpredictability of the process, if not subverted, should prevent systematic differences between comparison groups (selection bias). Differences due to chance will still occur and these are minimised by randomising a sufficiently large number of people.
  
  
  OBJECTIVE
  To assess the effects of randomisation and concealment of allocation on the results of healthcare studies.
  
  
  METHODS
  We searched the Cochrane Methodology Register, MEDLINE, SciSearch and reference lists up to September 2009. In addition, we screened articles citing included studies (ISI Science Citation Index) and papers related to included studies (PubMed).
  
  
  METHODS
  Eligible study designs were cohorts of studies, systematic reviews or meta-analyses of healthcare interventions that compared random allocation versus non-random allocation or adequate versus inadequate/unclear concealment of allocation in randomised trials. Outcomes of interest were the magnitude and direction of estimates of effect and imbalances in prognostic factors.
  
  
  METHODS
  We retrieved and assessed studies that appeared to meet the inclusion criteria independently. At least two review authors independently appraised methodological quality and extracted information. We prepared tabular summaries of the results for each comparison and assessed the results across studies qualitatively to identify common trends or discrepancies.
  
  
  RESULTS
  A total of 18 studies (systematic reviews or meta-analyses) met our inclusion criteria. Ten compared random allocation versus non-random allocation and nine compared adequate versus inadequate or unclear concealment of allocation within controlled trials. All studies were at high risk of bias.For the comparison of randomised versus non-randomised studies, four comparisons yielded inconclusive results (differed between outcomes or different modes of analysis); three comparisons showed similar results for random and non-random allocation; two comparisons had larger estimates of effect in non-randomised studies than in randomised trials; and two comparisons had larger estimates of effect in randomised than in non-randomised studies.Five studies found larger estimates of effect in trials with inadequate concealment of allocation than in trials with adequate concealment. The four other studies did not find statistically significant differences.
  
  
  CONCLUSIONS
  The results of randomised and non-randomised studies sometimes differed. In some instances non-randomised studies yielded larger estimates of effect and in other instances randomised trials yielded larger estimates of effect. The results of controlled trials with adequate and inadequate/unclear concealment of allocation sometimes differed. When differences occurred, most often trials with inadequate or unclear allocation concealment yielded larger estimates of effects relative to controlled trials with adequate allocation concealment. However, it is not generally possible to predict the magnitude, or even the direction, of possible selection biases and consequent distortions of treatment effects from studies with non-random allocation or controlled trials with inadequate or unclear allocation concealment.
authors.affiliation: Norwegian Knowledge Centre for the Health Services, PO Box 7004, St. Olavs Plass, Oslo, Norway, N-0130.
authors.forename: Jan
authors.initials: J
authors.lastname: Odgaard-Jensen
authors.forename: Gunn E
authors.initials: GE
authors.lastname: Vist
authors.forename: Antje
authors.initials: A
authors.lastname: Timmer
authors.forename: Regina
authors.initials: R
authors.lastname: Kunz
authors.forename: Elie A
authors.initials: EA
authors.lastname: Akl
authors.forename: Holger
authors.initials: H
authors.lastname: Schünemann
authors.forename: Matthias
authors.initials: M
authors.lastname: Briel
authors.forename: Alain J
authors.initials: AJ
authors.lastname: Nordmann
authors.forename: Silvia
authors.initials: S
authors.lastname: Pregno
authors.forename: Andrew D
authors.initials: AD
authors.lastname: Oxman
mesh_terms: D002986:Clinical Trials as Topic / Q000379:methods / Q000592:standards / Q000706:statistics & numerical data; D018849:Controlled Clinical Trials as Topic / Q000379:methods / Q000592:standards / Q000706:statistics & numerical data; D011897:Random Allocation; D016032:Randomized Controlled Trials as Topic / Q000379:methods / Q000592:standards / Q000706:statistics & numerical data; D015983:Selection Bias; D016896:Treatment Outcome