title: Measuring and estimating diagnostic accuracy when there are three ordinal diagnostic groups.
abstract: This article studies the problem of measuring and estimating the diagnostic accuracy when there are three ordinal diagnostic groups. We use a receiver operating characteristic (ROC) surface to describe the probabilities of correct classifications into three diagnostic groups based on various sets of diagnostic thresholds of a test and propose to use the entire and the partial volume under the surface to measure the diagnostic accuracy. Mathematical properties and probabilistic interpretations of the proposed measure of diagnostic accuracy are discussed. Under the assumption of normal distributions of the diagnostic test from three diagnostic groups, we present the maximum likelihood estimate to the volume under the ROC surface and give the asymptotic variance to the estimate. We further propose several asymptotic confidence interval estimates to the volume under the ROC surface. The performance of these confidence interval estimates is evaluated in terms of attaining the nominal coverage probability based on a simulation study. In addition, we develop a method of sample size determination to achieve an adequate accuracy of the confidence interval estimate. Finally, we demonstrate the proposed methodology by applying it to the clinical diagnosis of early stage Alzheimer's disease based on the neuropsychological database of the Washington University Alzheimer's Disease Research Center.
authors.affiliation: Division of Biostatistics, Washington University in St. Louis, St. Louis, MO 63110, USA. chengjie@wubios.wustl.edu
authors.forename: Chengjie
authors.initials: C
authors.lastname: Xiong
authors.forename: Gerald
authors.initials: G
authors.lastname: van Belle
authors.forename: J Philip
authors.initials: JP
authors.lastname: Miller
authors.forename: John C
authors.initials: JC
authors.lastname: Morris
mesh_terms: D000544:Alzheimer Disease / Q000175:diagnosis; D003198:Computer Simulation; D016001:Confidence Intervals; D003627:Data Interpretation, Statistical; D003954:Diagnostic Services / Q000592:standards / Q000706:statistics & numerical data*; D003955:Diagnostic Tests, Routine / Q000592:standards*; D018450:Disease Progression; D006801:Humans; D016013:Likelihood Functions; D015233:Models, Statistical; D009483:Neuropsychological Tests / Q000592:standards / Q000706:statistics & numerical data; D012372:ROC Curve; D018401:Sample Size; D012680:Sensitivity and Specificity; D012720:Severity of Illness Index; D012984:Software