How to measure the diagnostic accuracy of noninvasive liver fibrosis indices: the area under the ROC curve revisited.
BACKGROUND
The area under the ROC curve (AUC) is widely used to measure the diagnostic accuracy of noninvasive fibrosis indices. However, use of the AUC assumes a binary gold standard, whereas fibrosis staging is based on an ordinal scale and also depends on the distribution of fibrosis stages in the study sample. We explored other fibrosis staging accuracy measures designed for ordinal gold standards, the C-statistic and the Obuchowski measure.


METHODS
We performed a simulation study to assess the bias in estimating the accuracy measures when the distribution of fibrosis stages in the study sample do not fit the reference distribution in the population to which the indices are applied. We also estimated the type I error of the tests comparing these measures in 2 samples with different distributions of fibrosis stages. We illustrated the practical use of these measures by reanalyzing real data.


RESULTS
Compared with the AUC or the C-statistic, the Obuchowski measure showed limited bias when the distribution of fibrosis stages in the study sample differed from the reference distribution. The type I error was strongly inflated with the AUC or the C-statistic but was preserved in the Obuchowski measure. When we compared noninvasive indices on real data, AUC analysis led to discordant results depending on how the fibrosis stages were grouped together. One single conclusion was drawn from the analysis based on the Obuchowski measure.


CONCLUSIONS
We recommend using the Obuchowski measure for assessing the diagnostic accuracy of noninvasive indices of fibrosis.
Université Pierre et Marie Curie-Paris; INSERM, UMR-S 707; unité de santé publique, Assistance Publique Hôpitaux de Paris, Hôpital Saint-Antoine, Paris, France.
Jerome
J
Lambert
Philippe
P
Halfon
Guillaume
G
Penaranda
Pierre
P
Bedossa
Patrice
P
Cacoub
Fabrice
F
Carrat
D015982:Bias; D015415:Biomarkers / Q000097:blood; D003198:Computer Simulation; D003627:Data Interpretation, Statistical; D003955:Diagnostic Tests, Routine / Q000379:methods / Q000706:statistics & numerical data; D019698:Hepatitis C, Chronic / Q000150:complications; D006801:Humans; D008099:Liver / Q000473:pathology; D008103:Liver Cirrhosis / Q000097:blood / Q000175:diagnosis* / Q000209:etiology / Q000473:pathology; D012372:ROC Curve; D012015:Reference Standards; D012680:Sensitivity and Specificity; D012720:Severity of Illness Index
D015415:Biomarkers