An example on the value of non-randomisation in clinical trials in complementary medicine.
BACKGROUND
Randomised clinical trials may in principle show a small external validity. Non-randomised clinical trials therefore are sometimes regarded as an appropriate alternative when complementary and conventional treatments are compared.


OBJECTIVE
To assess the value of advanced statistical methods in the process of estimating differences between a complementary and a conventional treatment of acute sinusitis in a non-randomised clinical trial.


METHODS
Multicentre, non-randomised, controlled clinical trial comparing 2 complementary and 3 conventional ENT centres. Patients were free to choose the physician (and hence the therapy). Treatment differences were estimated by controlling for confounders in analyses of covariance or by propensity score techniques.


RESULTS
Most potential confounders (sex, age, life-style parameters) did not have significant effects on the choice of therapy. Disease severity and previous ENT surgery were the main confounding factors. At study onset they almost cause a defined separation of both treatment groups. As a result estimated treatment differences vary substantially depending on the chosen statistical model.


CONCLUSIONS
When comparing complementary and conventional treatments, non-randomised clinical trials may be misleading. Results may be strongly biased even when advanced statistical methods are used. Trials of complex statistical designs are needed to give valid results.
Luedtke
R
R
Karl und Veronica Carstens-Stiftung, Essen, Germany. r.luedtke@carstens-stiftung.de
Weber
U
U
Fischer
I
I
Friese
K H
KH
Moeller
H
H
D000208:Acute Disease; D000328:Adult; D000704:Analysis of Variance; D000900:Anti-Bacterial Agents / Q000627:therapeutic use; D015982:Bias; D000529:Complementary Therapies; D015986:Confounding Factors, Epidemiologic; D005260:Female; D006801:Humans; D008297:Male; D017063:Outcome Assessment, Health Care; D010865:Pilot Projects; D012720:Severity of Illness Index; D012852:Sinusitis / Q000188:drug therapy / Q000628:therapy*; D016896:Treatment Outcome
D000900:Anti-Bacterial Agents