title: Subject-centered free-response ROC (FROC) analysis.
abstract: OBJECTIVE
  To develop an approach of estimating subject-centered free-response receiver operating characteristic (FROC) curve for providing patient-centered inferences regarding detection-localization characteristics of a diagnostic system.
  
  
  METHODS
  The authors examine properties of the conventional, target-centered, FROC curve and demonstrate that in scenarios where the diagnostic performance correlates with the total number of targets on a subject, it may lead to inadequate inferences from the perspective of possible benefits to a patient. Following solutions to patient-centered approaches in other applications, the authors define a subject-centered FROC curve and develop its formulation as a covariate-adjusted FROC curve. The authors also conduct a numerical study illustrating the relative properties of the conventional and subject-centered approach and provide an example.
  
  
  RESULTS
  A simple-to-implement approach for estimating the subject-centered FROC curve and its overall index can be formulated as a type of stratified FROC analysis. The authors demonstrate that when diagnostic performance is associated with the number of targets, the diagnostic system with apparently superior target-centered characteristics (conventional approach) can be actually inferior from the subject-centered perspective. The authors show that under some clinically reasonable conditions the magnitude of disagreement in results could be substantial. An example from an actual observer performance study illustrates the natural setting where the developed approach would be relevant and lead to conclusions that are contradictory to those obtained from conventional analysis.
  
  
  CONCLUSIONS
  The authors developed a subject-centered FROC curve and its overall index provides tools for inferences that may be relevant from a perspective of potential benefits to a patient.
authors: Department of Biostatistics, Graduate School of Public Health, University of Pittsburgh, 130 DeSoto Street, Pittsburgh, Pennsylvania 15261, USA. anb61@pitt.edu
authors: Andriy I
authors: AI
authors: Bandos
authors: Howard E
authors: HE
authors: Rockette
authors: David
authors: D
authors: Gur
mesh_terms: D000465:Algorithms; D003933:Diagnosis; D006801:Humans; D008962:Models, Theoretical; D012372:ROC Curve
references: Invest Radiol. 1990 Feb;25(2):133-40
references: 2312249
references: Med Phys. 1989 Jul-Aug;16(4):561-8
references: 2770630
references: Biometrics. 1997 Jun;53(2):567-78
references: 9192452
references: Biostatistics. 2008 Jul;9(3):513-22
references: 18204044
references: Stat Med. 2005 Sep 30;24(18):2873-93
references: 16134144
references: Acad Radiol. 2000 Jul;7(7):516-25
references: 10902960
references: Biometrics. 2005 Mar;61(1):259-68
references: 15737102
references: J Opt Soc Am A Opt Image Sci Vis. 2007 Dec;24(12):B70-80
references: 18059916
references: Stat Med. 2007 Apr 30;26(9):2017-35
references: 17016864
references: Med Phys. 2008 Apr;35(4):1547-58
references: 18491549
references: Med Phys. 2002 Dec;29(12):2861-70
references: 12512721
references: N Engl J Med. 2001 Jul 19;345(3):181-8
references: 11463014
references: Radiology. 1975 Sep;116(3):533-8
references: 1153755
references: Acad Radiol. 2000 Jun;7(6):413-9
references: 10845400
references: Biometrics. 2003 Mar;59(1):36-42
references: 12762439
references: Radiology. 1990 Mar;174(3 Pt 1):873-81
references: 2305073
references: Biostatistics. 2005 Apr;6(2):303-12
references: 15772108
references: Biometrics. 2009 Mar;65(1):247-56
references: 18479482
references: AJR Am J Roentgenol. 2009 Aug;193(2):586-91
references: 19620460
references: Med Phys. 2004 Aug;31(8):2313-30
references: 15377098
references: Med Phys. 1996 Oct;23(10):1709-25
references: 8946368