title: Learning from past mistakes: assessing trial quality, power and eligibility in non-renal systemic lupus erythematosus randomized controlled trials.
abstract: OBJECTIVE
  To evaluate the post hoc study power of randomized controlled trials (RCTs) in the treatment of non-renal SLE and to determine the generalizability of these RCTs using an SLE database.
  
  
  METHODS
  RCTs in non-renal SLE were identified using PubMed (1975-2007). Inclusion/exclusion criteria, trial quality (5-point scale) and results of each study were recorded. The inclusion/exclusion criteria were compared with an SLE database to determine the proportion of patients from the database who would theoretically be eligible for these trials. For each negative study, we calculated the post hoc study power. We also looked for temporal improvements of trials in the literature and examined if pharmaceutical involvement influenced trial quality.
  
  
  RESULTS
  Sixty-four articles were included; the mean power of 30 negative studies was 24.6 +/- s.e.m. 3.9% (range 2.5-81.1%). Only one study had a power > 80%. Overall, potential eligibility of SLE patients in the database was 45.1 +/- s.e.m. 3.6%. Only 14 studies (21.9%) were of good quality. Fortunately, RCT quality is improving over time (trials <1995, compared with 1996-2002 and >2003; P < 0.001). Trials with pharmaceutical involvement had a significantly higher number of enrollees and better study quality.
  
  
  CONCLUSIONS
  Negative RCTs in SLE were mostly underpowered but the generalizability of these trials was high. Determination of study power and the impact of eligibility criteria on generalizability of study results are crucial in the design of clinical trials to ensure applicability to clinical practice.
authors.affiliation: St Joseph's Health Care London, 268 Grosvenor Street, Box 5777, London, ON N6A 4V2, Canada. janet.pope@sjhc.london.on.ca.
authors.forename: S Y
authors.initials: SY
authors.lastname: Yuen
authors.forename: J E
authors.initials: JE
authors.lastname: Pope
mesh_terms: D000328:Adult; D005260:Female; D006801:Humans; D008180:Lupus Erythematosus, Systemic / Q000188:drug therapy*; D008297:Male; D008875:Middle Aged; D018579:Patient Selection; D016032:Randomized Controlled Trials as Topic / Q000379:methods / Q000592:standards*; D015203:Reproducibility of Results; D012107:Research Design; D012109:Research Support as Topic; D018401:Sample Size; D012720:Severity of Illness Index