title: Ovarian cancer: comparison of observer performance for four methods of interpreting CT scans.
abstract: OBJECTIVE
  To assess the effects of four interpretative methods on observers' mean sensitivity and specificity by using computed tomography (CT) of ovarian carcinoma as a model.
  
  
  METHODS
  CT scans in 98 patients with ovarian carcinoma and 49 women who were disease free were retrospectively reviewed by four experienced blinded radiologists to compare single-observer reading, single-observer reading with an anatomic checklist, paired-observer reading (simultaneous double reading), and replicated reading (combination of two independent readings). Confidence level scoring was used to identify three possible disease forms in each patient: extranodal tumor, lymphadenopathy, and ascites. Patient conditions were then categorized as abnormal or normal.
  
  
  RESULTS
  There were no significant improvements in sensitivity or specificity for classification of patient conditions as abnormal or normal when comparing single-observer interpretation with single-observer interpretation with a checklist or paired-observer interpretation. Although there was no significant improvement in the mean sensitivity (93% vs 94%) by using the replicated reading method, there was a statistically significant improvement in mean specificity (85% vs 79%) for the replicated readings compared with single-observer interpretations (P < .05).
  
  
  CONCLUSIONS
  Diagnostic aids such as checklists and paired simultaneous readings did not lead to an improved mean observer performance for experienced readers. However, an increase in the mean specificity occurred with replicated readings.
authors.affiliation: Dept of Radiology, University of Rochester Medical Center, NY 14642, USA.
authors.forename: P J
authors.initials: PJ
authors.lastname: Fultz
authors.forename: C V
authors.initials: CV
authors.lastname: Jacobs
authors.forename: W J
authors.initials: WJ
authors.lastname: Hall
authors.forename: R
authors.initials: R
authors.lastname: Gottlieb
authors.forename: D
authors.initials: D
authors.lastname: Rubens
authors.forename: S M
authors.initials: SM
authors.lastname: Totterman
authors.forename: S
authors.initials: S
authors.lastname: Meyers
authors.forename: C
authors.initials: C
authors.lastname: Angel
authors.forename: G
authors.initials: G
authors.lastname: Del Priore
authors.forename: D P
authors.initials: DP
authors.lastname: Warshal
authors.forename: K H
authors.initials: KH
authors.lastname: Zou
authors.forename: D E
authors.initials: DE
authors.lastname: Shapiro
mesh_terms: D005260:Female; D006801:Humans; D008875:Middle Aged; D015588:Observer Variation; D010051:Ovarian Neoplasms / Q000000981:diagnostic imaging* / Q000453:epidemiology; D012372:ROC Curve; D012189:Retrospective Studies; D012680:Sensitivity and Specificity; D014057:Tomography, X-Ray Computed