title: Performance assessments of diagnostic systems under the FROC paradigm: experimental, analytical, and results interpretation issues.
abstract: As use of free response receiver-operating characteristic (FROC) curves gains more acceptance for quantitatively assessing the performance of diagnostic systems, it is important that the experimentalist understands the possible role of this approach as one of the experimental design paradigms that are available to him or her among all other approaches as well as some of the issues associated with FROC type studies. In a number of experimental scenarios, the FROC paradigm and associated analytical tools have theoretical and practical advantages over both the binary and the ROC approaches to performance assessments of diagnostic systems, but it also has some limitations related to experimental design, data analyses, clinical relevance, and complexity in the interpretation of the results. These issues are rarely discussed and are the focus of this work.
authors.affiliation: Department of Radiology, School of Medicine, University of Pittsburgh, 3362 Fifth Avenue, Pittsburgh, PA 15261-3180, USA. gurd@upmc.edu
authors.forename: David
authors.initials: D
authors.lastname: Gur
authors.forename: Howard E
authors.initials: HE
authors.lastname: Rockette
mesh_terms: D000465:Algorithms; D007089:Image Enhancement / Q000379:methods*; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D012372:ROC Curve
references.citation: Med Phys. 2008 Feb;35(2):645-59
references.pmid: 18383686
references.citation: Phys Med Biol. 2006 Jul 21;51(14):3463-82
references.pmid: 16825743
references.citation: Acad Radiol. 2007 Jan;14(1):4-18
references.pmid: 17178361
references.citation: Med Phys. 2007 Mar;34(3):898-905
references.pmid: 17441235
references.citation: Acad Radiol. 2004 Nov;11(11):1260-73
references.pmid: 15561573
references.citation: Acad Radiol. 2007 Jun;14(6):723-48
references.pmid: 17502262
references.citation: Med Phys. 2005 Apr;32(4):1031-4
references.pmid: 15895587
references.citation: Acad Radiol. 1995 Aug;2(8):709-16
references.pmid: 9419629
references.citation: Biometrics. 2009 Mar;65(1):247-56
references.pmid: 18479482
references.citation: Med Phys. 2007 Jun;34(6):2024-38
references.pmid: 17654906
references.citation: Phys Med Biol. 2006 Jul 21;51(14):3449-62
references.pmid: 16825742
references.citation: Med Phys. 2004 Aug;31(8):2313-30
references.pmid: 15377098
references.citation: Radiology. 2008 Oct;249(1):47-53
references.pmid: 18682584
references.citation: Med Decis Making. 2004 Nov-Dec;24(6):561-72
references.pmid: 15534338
references.citation: Med Phys. 2006 Nov;33(11):4157-68
references.pmid: 17153394
references.citation: Med Phys. 2008 Apr;35(4):1547-58
references.pmid: 18491549
references.citation: Med Phys. 2002 Dec;29(12):2861-70
references.pmid: 12512721