title: Optimizing the order of hypotheses in serial testing of multiple endpoints in clinical trials.
abstract: Clinical trials usually collect information on a large number of variables or endpoints, including one or more primary endpoints as well as a number of secondary endpoints representing different aspects of treatment effectiveness and safety. In this article, we focus on serial testing procedures that test multiple endpoints in a pre-specified order, and consider how to optimize the order of endpoints subject to any clinical constraints, with respect to the expected number of successes (i.e., endpoints that reach statistical significance) or the expected gain (if endpoints are associated with numerical utilities). We consider some common approaches to this problem and propose two new approaches: a greedy algorithm based on conditional power and a simulated annealing algorithm that attempts to improve a given sequence in a random and iterative fashion. Simulation results indicate that the proposed algorithms are useful for finding a high-performing sequence, and that optimized fixed sequence procedures can be competitive against traditional multiple testing procedures such as Holm's. The methods and findings are illustrated with two examples concerning migraine and asthma.
authors.affiliation: Division of Biostatistics, Office of Surveillance and Biometrics, Center for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, MD, U.S.A.
authors.forename: Zhiwei
authors.initials: Z
authors.lastname: Zhang
authors.forename: Chenguang
authors.initials: C
authors.lastname: Wang
authors.forename: James F
authors.initials: JF
authors.lastname: Troendle
mesh_terms: D000465:Algorithms; D001249:Asthma; D001699:Biometry / Q000379:methods; D002986:Clinical Trials as Topic / Q000379:methods*; D003198:Computer Simulation; D003627:Data Interpretation, Statistical; D006801:Humans; D008881:Migraine Disorders / Q000628:therapy; D017063:Outcome Assessment, Health Care / Q000379:methods*; D011788:Quality of Life; D018401:Sample Size; D016896:Treatment Outcome
keywords: chain procedure; fixed sequence; hierarchical testing; multiple comparisons; multiplicity; secondary endpoint