Discordance between reported intention-to-treat and per protocol analyses.
OBJECTIVE
To quantify the degree of disagreement between the two most popular methods for dealing with missing data: intention to treat (ITT) and per protocol (PP).


METHODS
We performed a systematic review of randomized two-armed clinical trials (CTs) published between 2001 and 2003, abstracted in PubMed and reporting both the ITT and PP analyses on a primary binary endpoint, out of which 74 papers were finally selected. The treatment effect of each CT was measured by the odds ratio, and the disagreement between them was quantified by the Bland-Altman method.


RESULTS
On average, the PP estimator provides greater values Log(e)ORPP=1 x 25.Log(e)ORITT, (95% CI: 1.15, 1.35) than the corresponding ITT estimator, although the limits of concordance showed that the ratio between the two estimators varies greatly from 0.39 up to 2.53.


CONCLUSIONS
These results confirm that missing values may cause both systematic and unpredictable bias in CTs. Further efforts should be made to minimize protocol deviations and to use better statistical methods to highlight the drawbacks of missing information. In the presence of protocol deviations, the conclusion of a CT cannot rest on the single reporting of either the ITT or the PP approach alone.
Porta
Núria
N
Department of Statistics and Operational Research, Universitat Politècnica de Catalunya, Pau Gargallo 5, 08028 - Barcelona, Spain.
Bonet
Catalina
C
Cobo
Erik
E
D015982:Bias; D003627:Data Interpretation, Statistical; D015340:Epidemiologic Research Design; D006801:Humans; D010506:Periodicals as Topic; D016032:Randomized Controlled Trials as Topic; D015203:Reproducibility of Results; D018401:Sample Size; D000078202:Systematic Reviews as Topic; D016896:Treatment Outcome