Circular instead of hierarchical: methodological principles for the evaluation of complex interventions.
BACKGROUND
The reasoning behind evaluating medical interventions is that a hierarchy of methods exists which successively produce improved and therefore more rigorous evidence based medicine upon which to make clinical decisions. At the foundation of this hierarchy are case studies, retrospective and prospective case series, followed by cohort studies with historical and concomitant non-randomized controls. Open-label randomized controlled studies (RCTs), and finally blinded, placebo-controlled RCTs, which offer most internal validity are considered the most reliable evidence. Rigorous RCTs remove bias. Evidence from RCTs forms the basis of meta-analyses and systematic reviews. This hierarchy, founded on a pharmacological model of therapy, is generalized to other interventions which may be complex and non-pharmacological (healing, acupuncture and surgery).


CONCLUSIONS
The hierarchical model is valid for limited questions of efficacy, for instance for regulatory purposes and newly devised products and pharmacological preparations. It is inadequate for the evaluation of complex interventions such as physiotherapy, surgery and complementary and alternative medicine (CAM). This has to do with the essential tension between internal validity (rigor and the removal of bias) and external validity (generalizability).


CONCLUSIONS
Instead of an Evidence Hierarchy, we propose a Circular Model. This would imply a multiplicity of methods, using different designs, counterbalancing their individual strengths and weaknesses to arrive at pragmatic but equally rigorous evidence which would provide significant assistance in clinical and health systems innovation. Such evidence would better inform national health care technology assessment agencies and promote evidence based health reform.
Walach
Harald
H
University of Northampton & Samueli Institute - European Office, School of Social Sciences, Park Campus, Northampton NN2 7AL, UK. harald.walach@northampton.ac.uk
Falkenberg
Torkel
T
Fønnebø
Vinjar
V
Lewith
George
G
Jonas
Wayne B
WB
D019317:Evidence-Based Medicine; D006801:Humans; D017063:Outcome Assessment, Health Care / Q000379:methods; D010919:Placebos; D016032:Randomized Controlled Trials as Topic / Q000379:methods; D015203:Reproducibility of Results; D012107:Research Design; D012680:Sensitivity and Specificity; D013673:Technology Assessment, Biomedical / Q000379:methods
D010919:Placebos