title: Shifting effects in randomised controlled trials of complex interventions: a new kind of performance bias?
abstract: OBJECTIVE
  Randomised controlled trials (RCTs) aim to provide unbiased estimates of treatment effects. However, the process of implementing trial procedures may have an impact on the performance of complex interventions that rely strongly on the intuition and confidence of therapists. We aimed to examine whether shifting effects over the recruitment period can be observed that might indicate such impact.
  
  
  METHODS
  Three RCTs investigating music therapy vs. standard care were included. The intervention was performed by experienced therapists and based on established methods. We examined outcomes of participants graphically, analysed cumulative effects and tested for differences between first vs. later participants. We tested for potential confounding population shifts through multiple regression models.
  
  
  RESULTS
  Cumulative differences suggested trends over the recruitment period. Effect sizes tended to be less favourable among the first participants than later participants. In one study, effects even changed direction. Age, gender and baseline severity did not account for these shifting effects.
  
  
  CONCLUSIONS
  Some trials of complex interventions have shifting effects over the recruitment period that cannot be explained by therapist experience or shifting demographics. Replication and further research should aim to find out which interventions and trial designs are most vulnerable to this new kind of performance bias.
authors.affiliation: GAMUT, Uni Health, Uni Research, Bergen, Norway. christian.gold@uni.no
authors.forename: C
authors.initials: C
authors.lastname: Gold
authors.forename: J
authors.initials: J
authors.lastname: Erkkilä
authors.forename: M J
authors.initials: MJ
authors.lastname: Crawford
mesh_terms: D000293:Adolescent; D000328:Adult; D015982:Bias; D003866:Depressive Disorder / Q000628:therapy*; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D009147:Music Therapy; D016032:Randomized Controlled Trials as Topic; D012559:Schizophrenia / Q000628:therapy*; D013997:Time Factors; D016896:Treatment Outcome