title: Plus disease in retinopathy of prematurity: qualitative analysis of diagnostic process by experts.
abstract: OBJECTIVE
  Plus disease is the most important parameter that characterizes severe treatment-requiring retinopathy of prematurity, yet diagnostic agreement among experts is imperfect and the precise factors involved in clinical diagnosis are unclear. This study is designed to address these gaps in knowledge by analyzing cognitive aspects of the plus disease diagnostic process by experts.
  
  
  OBJECTIVE
  To examine the diagnostic reasoning process of experts for plus disease in retinopathy of prematurity using qualitative research techniques.
  
  
  METHODS
  Cognitive walk-through, with qualitative analysis of videotaped expert responses and quantitative analysis of expert diagnoses.
  
  
  METHODS
  Experimental setting in which experts were videotaped while reviewing study data.
  
  
  METHODS
  A panel of international retinopathy of prematurity experts who had the experience of using qualitative retinal features as their primary basis for clinical diagnosis.
  
  
  METHODS
  Six experts were video recorded while independently reviewing 7 wide-angle retinal images from infants with retinopathy of prematurity. Experts were asked to explain their diagnostic process in detail (think-aloud protocol), mark findings relevant to their reasoning, and diagnose each image (plus vs pre-plus vs neither). Subsequently, each expert viewed the images again while being asked to examine arteries and veins in isolation and answer specific questions. Video recordings were transcribed and reviewed. Diagnostic process of experts was analyzed using a published cognitive model.
  
  
  METHODS
  Interexpert and intraexpert agreement.
  
  
  RESULTS
  Based on the think-aloud protocol, 5 of 6 experts agreed on the same diagnosis in 3 study images and 3 of 6 experts agreed in 3 images. When experts were asked to rank images in order of severity, the mean correlation coefficient between pairs of experts was 0.33 (range, -0.04 to 0.75). All experts considered arterial tortuosity and venous dilation while reviewing each image. Some considered venous tortuosity, arterial dilation, peripheral retinal features, and other factors. When experts were asked to rereview images to diagnose plus disease based strictly on definitions of sufficient arterial tortuosity and venous dilation, all but 1 expert changed their diagnosis compared with the think-aloud protocol.
  
  
  CONCLUSIONS
  Diagnostic consistency in plus disease is imperfect. Experts differ in their reasoning process, retinal features that they focus on, and interpretations of the same features. Understanding these factors may improve diagnosis and education. Future research defining more precise diagnostic criteria may be warranted.
authors.affiliation: Department of Ophthalmology, Weill Cornell Medical College, New York, New York, USA.
authors.forename: Nina J
authors.initials: NJ
authors.lastname: Hewing
authors.forename: David R
authors.initials: DR
authors.lastname: Kaufman
authors.forename: R V Paul
authors.initials: RV
authors.lastname: Chan
authors.forename: Michael F
authors.initials: MF
authors.lastname: Chiang
mesh_terms: D003941:Diagnostic Techniques, Ophthalmological; D004108:Dilatation, Pathologic; D006801:Humans; D007231:Infant, Newborn; D007234:Infant, Premature; D015588:Observer Variation; D010781:Photography; D015203:Reproducibility of Results; D012161:Retinal Artery / Q000473:pathology*; D012169:Retinal Vein / Q000473:pathology*; D012178:Retinopathy of Prematurity / Q000175:diagnosis*; D014741:Video Recording