Setting the bar in phase II trials: the use of historical data for determining "go/no go" decision for definitive phase III testing.
OBJECTIVE
Phase II trials aim to determine whether a cancer treatment is sufficiently promising to justify phase III study. Whether an agent is declared promising in a phase II trial depends on prespecified "null" and "alternative" rates of an outcome of interest such as tumor response. In some cases, the null must be determined with reference to historical data. We sought to determine the proportion of phase II trials that require historical data to establish the null and to determine how these historical estimates were derived.


METHODS
We conducted a systematic review of phase II trials published in the Journal of Clinical Oncology or Cancer in the 3 years to June 2005. Data were extracted following a prespecified protocol.


RESULTS
We retrieved 251 papers, of which 117 were found to be ineligible; 70 of 134 included trials (52%) were defined as requiring historical data for design. Nearly half (32, 46%) of these papers did not cite the source of the historical data used, and just 9 (13%) clearly gave a single historical estimate as the rationale for the null. Trials that failed to cite prior data appropriately were significantly more likely to declare an agent to be active (82% versus 33%; P=0.005). No study incorporated statistical methods to account for either sampling error or possible differences in case mix between the phase II sample and the historical cohort.


CONCLUSIONS
Many phase II trials require historical data to determine null response rates. Simple guidelines may improve design and reporting of such trials.
Vickers
Andrew J
AJ
Department of Medicine, Memorial Sloan-Kettering Cancer Center, New York, NY 10021, USA. vickersa@mskcc.org
Ballen
Vennus
V
Scher
Howard I
HI
D000970:Antineoplastic Agents / Q000627:therapeutic use*; D017322:Clinical Trials, Phase II as Topic / Q000379:methods*; D017326:Clinical Trials, Phase III as Topic / Q000379:methods*; D018572:Disease-Free Survival; D006801:Humans; D008495:Medical Oncology / Q000379:methods*; D009369:Neoplasms / Q000628:therapy*; D016032:Randomized Controlled Trials as Topic / Q000379:methods*; D012107:Research Design; D016896:Treatment Outcome
D000970:Antineoplastic Agents