Therapist effects in randomised controlled trials: what to do about them.
OBJECTIVE
The aim of this study is to describe and compare three statistical methods to allow for therapist effects in individually randomised controlled trials.


BACKGROUND
In an individually randomised controlled trial where the intervention is delivered by a health professional it seems likely that the effectiveness of the intervention, independent of any treatment effect, could depend on the skill of the health professional delivering it. This leads to a potential clustering of the outcomes for the patients being treated by the same health professional.


METHODS
Retrospective statistical analysis of outcomes from four example randomised controlled trial datasets with potential clustering by health professional.


METHODS
Three methods to allow for clustering are described: cluster level analysis; random effects models and marginal models. These models were fitted to continuous outcome data from four example randomised controlled trial datasets with potential clustering by health professional.


RESULTS
The cluster level models produced the widest confidence intervals. Little difference was found between the estimates of the regression coefficients for the treatment effect and confidence intervals between the individual patient level models for the datasets. The conclusions reached for each dataset match those published in the original papers. The intracluster correlation coefficient ranged from <0.001-0.04 for the outcomes, which shows only minor levels of clustering within the datasets.


CONCLUSIONS
The models, which use individual level data are to be preferred. Treatment coefficients from these models have different interpretations. The choice of model should depend on the scientific question being asked.


CONCLUSIONS
We recommend that researchers should be aware of any potential clustering, by health professional, in their randomised controlled trial and use appropriate methods to account for this clustering in the statistical analysis of the data.
Walters
Stephen J
SJ
Medical Statistics Group, School of Health and Related Research, University of Sheffield, Sheffield S1 4DA, UK. s.j.walters@sheffield.ac.uk
D015670:Acupuncture Therapy; D019645:Arthroplasty, Replacement, Knee / Q000534:rehabilitation; D016000:Cluster Analysis; D003627:Data Interpretation, Statistical; D015987:Effect Modifier, Epidemiologic; D015673:Fatigue Syndrome, Chronic; D006705:Homeopathy; D006801:Humans; D007871:Leg Ulcer / Q000628:therapy; D026741:Physical Therapy Modalities; D011369:Professional-Patient Relations; D016032:Randomized Controlled Trials as Topic; D012044:Regression Analysis; D012107:Research Design