The power of the sign test given uncertainty in the proportion of tied observations.
BACKGROUND
The sign test is a well-known non-parametric approach for testing whether one of two conditions is preferable to another. In medicine, this method may be used when one is interested in testing in the context of a clinical trial whether either of the two treatments that are provided to study subjects is favored over the other. When neither treatment outperforms the other within a given individual, a "tie" is said to have occurred. When planning such a trial and estimating statistical power and/or sample size, one should consider the probability of a tie occurring (P(T)). This paper quantifies the degree to which uncertainty in P(T) affects a study's statistical power.


METHODS
Binomial theory was used to calculate power given varying levels of uncertainty and varying distributional forms (i.e. beta, uniform) for P(T).


RESULTS
Across a range of prior distributions for P(T), power was reduced (i.e. <80%) for 46 (71.9%) of 64 experimental conditions, with large reductions (i.e. power <70%) for 10 (15.6%) of them.


CONCLUSIONS
When designing a clinical trial that will incorporate the sign test to compare 2 conditions, ignoring potential variation in the probability of a tie occurring will tend to result in an underpowered study. These findings have implications to the design of any clinical trial for which assumptions are made in calculating an appropriate sample size.
Nietert
Paul J
PJ
Division of Biostatistics and Epidemiology, Department of Medicine, Medical University of South Carolina, Charleston, SC 29425, United States. nieterpj@musc.edu
Dooley
Mary J
MJ
D016010:Binomial Distribution; D002986:Clinical Trials as Topic; D006801:Humans; D015233:Models, Statistical; D011336:Probability; D012107:Research Design; D018401:Sample Size; D018709:Statistics, Nonparametric; D035501:Uncertainty