title: Monitoring futility in a two-by-two factorial design: the SPS3 experience.
abstract: BACKGROUND
  For studies with two-by-two factorial designs, the complexity of determining an appropriate futility analysis plan is increased as compared to studies where patients are randomized to one treatment. Issues that must be addressed include the possibility of a significant interaction and the need to determine how to proceed given evidence of futility in one arm. Suggested approaches include a two-stage plan, which first assesses futility of the interaction term and proceeds to examine the main effects, given sufficient evidence that no interaction is present, and variations on one-stage plans, which assume the trial will not be stopped for futility in the interaction.
  
  
  OBJECTIVE
  To discuss different approaches to monitoring futility in two-by-two factorial clinical trials and compare their properties.
  
  
  METHODS
  We utilized a simulation study, designed to mimic the Secondary Prevention of Small Subcortical Strokes (SPS3) Study, to determine which approach to monitoring futility in two-by-two factorial studies had the most desirable statistical properties.
  
  
  RESULTS
  We found that in most scenarios typical of clinical trials, monitoring futility in each arm simultaneously was superior to or as good as monitoring the interaction and then assessing futility in each arm only when the interaction was deemed futile. Monitoring each arm simultaneously lead to early stopping more often when no treatment effect was present, and lower average sample numbers (ASNs). The exception to this was the unlikely case when a qualitative interaction was present.
  
  
  CONCLUSIONS
  We assumed that one-sided tests were to be performed, and only assessed some of the possible methods for monitoring futility under the study design.
  
  
  CONCLUSIONS
  Futility monitoring in two-by-two factorial studies should proceed by assessing each arm simultaneously, rather than monitoring the interaction first. If sizeable interactions are anticipated, study design, rather than study monitoring, should account for this.
authors: Department of Biostatistics, University of Alabama at Birmingham, Birmingham, AL 35294-0022, USA. lmcclure@uab.edu
authors: Leslie A
authors: LA
authors: McClure
authors: Christopher S
authors: CS
authors: Coffey
authors: George
authors: G
authors: Howard
mesh_terms: D003198:Computer Simulation; D005069:Evaluation Studies as Topic; D006801:Humans; D018447:Medical Futility; D016032:Randomized Controlled Trials as Topic / Q000379:methods* / Q000706:statistics & numerical data*; D012107:Research Design; D020521:Stroke / Q000628:therapy
references: Stat Med. 1994 Jul 15-30;13(13-14):1479-84
references: 7973227
references: Int J Stroke. 2011 Apr;6(2):164-75
references: 21371282
references: Control Clin Trials. 1982 Dec;3(4):311-23
references: 7160189
references: Biometrics. 1993 Mar;49(1):23-30
references: 8513104
references: Biometrics. 1994 Dec;50(4):1146-52
references: 7786995
references: Stat Med. 1995 Feb 28;14(4):357-79
references: 7746977
references: Biometrics. 1985 Jun;41(2):361-72
references: 4027319