title: An empirical evaluation of Tukey's control chart for use in health care and quality management applications.
abstract: Recently in this journal, F. Alemi (Qual Manage Health Care. 2004;13(4):216-221) proposed the use of Tukey's Control Chart because of the unique benefits associated with nonparametric inferential statistics including robust performance with (1) low N sizes, (2) nonnormal data, and (3) the presence of outliers, However, an assumption that applies to virtually all inferential statistical procedures (parametric and nonparametric) is that the observations in question are independent from each other. Unfortunately, there is good reason to suspect violation of this assumption when evaluating quality processes over time (as is often the case in health care settings). In this article, the power (ability to detect real changes in a data process) and type I error (probability of false positives) performance of Tukey's Control Chart technique is empirically evaluated. When observations are not independent, Tukey's Control Chart technique demonstrates unacceptable type I error performance. Additionally, regardless of whether observations are independent, the technique demonstrates low power to detect real effects unless the effects are quite large.
authors.affiliation: Institute of Psychiatry, Medical University of South Carolina, Charleston 29425, USA. borckard@musc.edu
authors.forename: Jeffrey J
authors.initials: JJ
authors.lastname: Borckardt
authors.forename: Michael R
authors.initials: MR
authors.lastname: Nash
authors.forename: Sue
authors.initials: S
authors.lastname: Hardesty
authors.forename: Joan
authors.initials: J
authors.lastname: Herbert
authors.forename: Harriet
authors.initials: H
authors.lastname: Cooney
authors.forename: Chris
authors.initials: C
authors.lastname: Pelic
mesh_terms: D015982:Bias; D003627:Data Interpretation, Statistical; D004282:Documentation / Q000379:methods*; D006801:Humans; D008019:Life Style; D015233:Models, Statistical; D017064:Process Assessment, Health Care / Q000379:methods*; D012680:Sensitivity and Specificity; D014481:United States