Larger effect sizes were associated with higher quality ratings in complementary and alternative medicine randomized controlled trials.
OBJECTIVE
To determine if the quality of complementary and alternative medicine (CAM) placebo controlled randomized controlled trials (RCTs) is related to the effect sizes they produce when the type of interventions and outcome variables are controlled.


METHODS
A sample of 25 CAM meta-analyses was identified from MEDLINE and hand searches containing published effect sizes for at least three efficacy trials employing placebo control groups. From these 25 reviews, 26 pairs of trials were selected: the one reporting the largest effect size and the matching trial reporting the smallest effect size. Quality and publication characteristics were then abstracted from each trial.


RESULTS
Unlike the preponderance of past evidence examining the relationship between quality and effect size, the present study found that trials possessing the largest effect sizes within a meta-analysis were also associated with higher quality ratings than their counterparts possessing the lowest effect sizes (P=.019).


CONCLUSIONS
Possible theoretical reasons for this unexpected positive relationship include (a) sampling error, (b) reduced within group variation, (c) fraudulent reporting, and (d) the restriction of the analyses to placebo controlled trial.
Bausell
R Barker
RB
University of Maryland School of Nursing, Baltimore, MD 21201, USA. bbausell@compmed.umm.edu
Lee
Wen-Lin
WL
Soeken
Karen L
KL
Li
Yu-Fang
YF
Berman
Brian M
BM
D000529:Complementary Therapies; D015987:Effect Modifier, Epidemiologic; D006801:Humans; D015201:Meta-Analysis as Topic; D011786:Quality Control; D016032:Randomized Controlled Trials as Topic / Q000379:methods / Q000592:standards*; D012107:Research Design