title: Automated grading for diabetic retinopathy: a large-scale audit using arbitration by clinical experts.
abstract: OBJECTIVE
  Automated grading software has the potential to reduce the manual grading workload within diabetic retinopathy screening programmes. This audit was undertaken at the request of Scotland's National Diabetic Retinopathy Screening Collaborative to assess whether the introduction of automated grading software into the national screening programme would be safe, robust and effective.
  
  
  METHODS
  Automated grading, performed by software for image quality assessment and for microaneurysm/dot haemorrhage detection, was carried out on 78,601 images, obtained from 33,535 consecutive patients, which had been manually graded at one of two regional diabetic retinopathy screening programmes. Cases where the automated grading software assessment indicated gradable images with no disease but the screening programme indicated ungradable images or disease more severe than mild retinopathy were arbitrated by seven senior ophthalmologists.
  
  
  RESULTS
  100% (180/180) of patients with proliferative retinopathy, 100% (324/324) with referable background retinopathy, 100% (193/193) with observable background retinopathy, 97.3% (1099/1130) with referable maculopathy, 99.2% (384/387) with observable maculopathy and 99.8% (1824/1827) with ungradable images were detected by the software.
  
  
  CONCLUSIONS
  The automated grading software operated to previously published results when applied to a large, unselected population attending two regional screening programmes. Manual grading workload reduction would be 36.3%.
authors.affiliation: Biomedical Physics, University of Aberdeen, Foresterhill, UK.
authors.forename: Alan D
authors.initials: AD
authors.lastname: Fleming
authors.forename: Keith A
authors.initials: KA
authors.lastname: Goatman
authors.forename: Sam
authors.initials: S
authors.lastname: Philip
authors.forename: Gordon J
authors.initials: GJ
authors.lastname: Prescott
authors.forename: Peter F
authors.initials: PF
authors.lastname: Sharp
authors.forename: John A
authors.initials: JA
authors.lastname: Olson
mesh_terms: D054869:Clinical Audit; D003930:Diabetic Retinopathy / Q000175:diagnosis* / Q000453:epidemiology; D003936:Diagnosis, Computer-Assisted / Q000379:methods*; D005260:Female; D006801:Humans; D008297:Male; D008403:Mass Screening; D017008:Negotiating; D015397:Program Evaluation; D012166:Retinal Hemorrhage / Q000175:diagnosis* / Q000453:epidemiology; D012606:Scotland / Q000453:epidemiology; D012680:Sensitivity and Specificity; D012720:Severity of Illness Index; D012984:Software