Power estimation for the Dorfman-Berbaum-Metz method.
OBJECTIVE
The authors describe how to perform power and sample size computations for the Dorfman-Berbaum-Metz method for analyzing multireader receiver operating characteristic (ROC) studies when data from a pilot study or from a previous study similar to the planned study are available.


METHODS
Power and sample size computations are described in a step-by-step procedure.


RESULTS
To illustrate the power computation method we treat 2 studies that did not show a significant difference between modalities as pilot studies for planning future studies. For the future studies we plan to compare the modalities with respect to the mean of the treatment-reader area under the curve (AUC) estimates. We show how to estimate the reader and case sample sizes for each future study to have 80% power to detect a specified difference in modality AUCs.


CONCLUSIONS
Application of the power and sample size computation procedure for the Dorfman-Berbaum-Metz method is straightforward. For a given effect size there will be several different reader and case sample size combinations that yield the desired power. It is important that the pilot study or previous study used for the computations be comparable to the planned study with respect to the modalities, reader expertise, case selection, and ratio of normal to abnormal cases.
Hillis
Stephen L
SL
Center for Research in the Implementation of Innovative Strategies in Practice (CRIISP), Iowa City VA Medical Center, Iowa, USA. steve-hillis@uiowa.edu
Berbaum
Kevin S
KS
D000704:Analysis of Variance; D000784:Aortic Dissection / Q000000981:diagnostic imaging / Q000453:epidemiology; D001014:Aortic Aneurysm / Q000000981:diagnostic imaging / Q000453:epidemiology; D019540:Area Under Curve; D003198:Computer Simulation; D017352:Echo-Planar Imaging / Q000379:methods; D006801:Humans; D007090:Image Interpretation, Computer-Assisted / Q000379:methods; D007231:Infant, Newborn; D019028:Magnetic Resonance Imaging, Cine / Q000379:methods; D008962:Models, Theoretical; D015588:Observer Variation; D010865:Pilot Projects; D012372:ROC Curve; D011859:Radiography / Q000379:methods*; D011873:Radiology Information Systems; D018401:Sample Size