title: Agreement among ophthalmologists in marking the optic disc and optic cup in fundus images.
abstract: The purpose of this paper was to study the agreement between six ophthalmologists who manually marked the optic nerve head using fundus images. Four different parameters were considered from the manual marking images: (1) disc (area and centroid), (2) cup (area and centroid), (3) horizontal and vertical cup-to-disc ratios, and (4) including the previous two parameters for both horizontal and vertical cup-to-disc ratios, and investigated the comprehensive agreement and accuracy among all the ophthalmologists. The best agreement percentage for all the parameters combined was between ophthalmologists number one and three for 44 % of images, and the best accuracy was for ophthalmologist number one with 77.4 % of 315 total tested images. Our analysis shows that more than half of the images in the dataset were not agreed upon when considering all the parameters together.
authors: King Abdullah International Medical Research Center (KAIMRC), Ministry of National Guard, Jeddah, Saudi Arabia.|School of Optometry, University of Waterloo, Waterloo, Canada.
authors: Ahmed
authors: A
authors: Almazroa
authors: Bin Rushed Ophthalmic Center, Riyadh, Saudi Arabia.
authors: Sami
authors: S
authors: Alodhayb
authors: Ophthalmology Department, King Saud University, Riyadh, Saudi Arabia.
authors: Essameldin
authors: E
authors: Osman
authors: Ophthalmology Department, Magrabi Eye and Ear Center, Riyadh, Saudi Arabia.
authors: Eslam
authors: E
authors: Ramadan
authors: Ophthalmology Department, King Fahad Medical City, Riyadh, Saudi Arabia.
authors: Mohammed
authors: M
authors: Hummadi
authors: Alhokama Eye Specialist Center, Riyadh, Saudi Arabia.
authors: Mohammed
authors: M
authors: Dlaim
authors: Ophthalmology Department, AlJazeera Hospital, Riyadh, Saudi Arabia.
authors: Muhannad
authors: M
authors: Alkatee
authors: Department of Electrical and Computer Engineering, Ryerson University, 350 Victoria St, Toronto, ON, M5B 2K3, Canada. kraahemi@ee.ryerson.ca.
authors: Kaamran
authors: http://orcid.org/0000-0002-9835-7897
authors: K
authors: Raahemifar
authors: School of Optometry, University of Waterloo, Waterloo, Canada.
authors: Vasudevan
authors: V
authors: Lakshminarayanan
mesh_terms: D002983:Clinical Competence; D003941:Diagnostic Techniques, Ophthalmological; D005260:Female; D005654:Fundus Oculi; D006801:Humans; D007091:Image Processing, Computer-Assisted; D008297:Male; D000072163:Ophthalmologists; D009898:Optic Disk / Q000473:pathology*; D009901:Optic Nerve Diseases / Q000175:diagnosis*; D012372:ROC Curve
keywords: Fundus images; Manual marking; Ophthalmology; Optic cup; Optic disc