title: Advancing bag-of-visual-words representations for lesion classification in retinal images.
abstract: Diabetic Retinopathy (DR) is a complication of diabetes that can lead to blindness if not readily discovered. Automated screening algorithms have the potential to improve identification of patients who need further medical attention. However, the identification of lesions must be accurate to be useful for clinical application. The bag-of-visual-words (BoVW) algorithm employs a maximum-margin classifier in a flexible framework that is able to detect the most common DR-related lesions such as microaneurysms, cotton-wool spots and hard exudates. BoVW allows to bypass the need for pre- and post-processing of the retinographic images, as well as the need of specific ad hoc techniques for identification of each type of lesion. An extensive evaluation of the BoVW model, using three large retinograph datasets (DR1, DR2 and Messidor) with different resolution and collected by different healthcare personnel, was performed. The results demonstrate that the BoVW classification approach can identify different lesions within an image without having to utilize different algorithms for each lesion reducing processing time and providing a more flexible diagnostic system. Our BoVW scheme is based on sparse low-level feature detection with a Speeded-Up Robust Features (SURF) local descriptor, and mid-level features based on semi-soft coding with max pooling. The best BoVW representation for retinal image classification was an area under the receiver operating characteristic curve (AUC-ROC) of 97.8% (exudates) and 93.5% (red lesions), applying a cross-dataset validation protocol. To assess the accuracy for detecting cases that require referral within one year, the sparse extraction technique associated with semi-soft coding and max pooling obtained an AUC of 94.2 ± 2.0%, outperforming current methods. Those results indicate that, for retinal image classification tasks in clinical practice, BoVW is equal and, in some instances, surpasses results obtained using dense detection (widely believed to be the best choice in many vision problems) for the low-level descriptors.
authors.affiliation: Institute of Computing, University of Campinas (Unicamp), Campinas, São Paulo, Brazil.
authors.forename: Ramon
authors.initials: R
authors.lastname: Pires
authors.affiliation: Department of Biomedical Engineering, Khalifa University, Abu Dhabi, United Arab Emirates, and Australian School of Advanced Medicine, Macquarie University, North Ryde, New South Wales, Australia.
authors.forename: Herbert F
authors.initials: HF
authors.lastname: Jelinek
authors.affiliation: Institute of Computing, University of Campinas (Unicamp), Campinas, São Paulo, Brazil.
authors.forename: Jacques
authors.initials: J
authors.lastname: Wainer
authors.affiliation: School of Electrical and Computing Engineering, University of Campinas (UNICAMP), Campinas, São Paulo, Brazil.
authors.forename: Eduardo
authors.initials: E
authors.lastname: Valle
authors.affiliation: Institute of Computing, University of Campinas (Unicamp), Campinas, São Paulo, Brazil.
authors.forename: Anderson
authors.initials: A
authors.lastname: Rocha
mesh_terms: D000465:Algorithms; D019540:Area Under Curve; D019992:Databases as Topic; D003657:Decision Making; D003930:Diabetic Retinopathy / Q000175:diagnosis* / Q000473:pathology*; D006801:Humans; D012015:Reference Standards; D012164:Retinal Diseases / Q000175:diagnosis* / Q000473:pathology*