Performance assessments of diagnostic systems under the FROC paradigm: experimental, analytical, and results interpretation issues.
As use of free response receiver-operating characteristic (FROC) curves gains more acceptance for quantitatively assessing the performance of diagnostic systems, it is important that the experimentalist understands the possible role of this approach as one of the experimental design paradigms that are available to him or her among all other approaches as well as some of the issues associated with FROC type studies. In a number of experimental scenarios, the FROC paradigm and associated analytical tools have theoretical and practical advantages over both the binary and the ROC approaches to performance assessments of diagnostic systems, but it also has some limitations related to experimental design, data analyses, clinical relevance, and complexity in the interpretation of the results. These issues are rarely discussed and are the focus of this work.
Gur
David
D
Department of Radiology, School of Medicine, University of Pittsburgh, 3362 Fifth Avenue, Pittsburgh, PA 15261-3180, USA. gurd@upmc.edu
Rockette
Howard E
HE
D000465:Algorithms; D007089:Image Enhancement / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D012372:ROC Curve
Med Phys. 2008 Feb;35(2):645-59
18383686
Phys Med Biol. 2006 Jul 21;51(14):3463-82
16825743
Acad Radiol. 2007 Jan;14(1):4-18
17178361
Med Phys. 2007 Mar;34(3):898-905
17441235
Acad Radiol. 2004 Nov;11(11):1260-73
15561573
Acad Radiol. 2007 Jun;14(6):723-48
17502262
Med Phys. 2005 Apr;32(4):1031-4
15895587
Acad Radiol. 1995 Aug;2(8):709-16
9419629
Biometrics. 2009 Mar;65(1):247-56
18479482
Med Phys. 2007 Jun;34(6):2024-38
17654906
Phys Med Biol. 2006 Jul 21;51(14):3449-62
16825742
Med Phys. 2004 Aug;31(8):2313-30
15377098
Radiology. 2008 Oct;249(1):47-53
18682584
Med Decis Making. 2004 Nov-Dec;24(6):561-72
15534338
Med Phys. 2006 Nov;33(11):4157-68
17153394
Med Phys. 2008 Apr;35(4):1547-58
18491549
Med Phys. 2002 Dec;29(12):2861-70
12512721