Flawed meta-analyses comparing psychotherapy with pharmacotherapy.
OBJECTIVE
The author sought to illustrate the invalidity of meta-analyses that claim to quantitatively compare the benefits of psychotherapy to pharmacotherapy in patients with psychiatric disorders.


METHODS
Studies included in four meta-analyses were retrieved and their study designs evaluated.


RESULTS
The meta-analyses compared effect sizes from disparate studies that were not uniformly blind, random, controlled, or of high quality. The studies did not directly address the comparative efficacy question or lacked assay sensitivity.


CONCLUSIONS
Numerous types of studies exemplify the need for caution in evaluating meta-analytic conclusions without first critically examining the included studies. Estimates of the relative efficacy of different treatments are not well founded when based almost exclusively on indirect, multiply confounded comparisons. Meta-analyses based on flawed studies or studies that lack demonstrated assay sensitivity are also inadequate for the criticism of treatment guidelines. Some bodies of data are inadequate to support a proper meta-analysis.
Klein
D F
DF
Department of Therapeutics, New York State Psychiatric Institute, New York, NY 10032, USA. donaldk737@aol.com
D000928:Antidepressive Agents / Q000627:therapeutic use; D002986:Clinical Trials as Topic; D015928:Cognitive Behavioral Therapy; D006801:Humans; D001523:Mental Disorders / Q000188:drug therapy / Q000628:therapy*; D015201:Meta-Analysis as Topic; D016584:Panic Disorder / Q000188:drug therapy / Q000628:therapy; D011613:Psychotherapy; D011619:Psychotropic Drugs / Q000627:therapeutic use*; D015203:Reproducibility of Results; D012107:Research Design / Q000592:standards
D000928:Antidepressive Agents; D011619:Psychotropic Drugs