Comparing the detection and agreement of parapapillary atrophy progression using digital optic disk photographs and alternation flicker.
OBJECTIVE
Parapapillary atrophy (PPA) progression has been associated with progressive glaucoma, but has proven to be difficult to assess clinically. We compared inter- and intra-observer agreement using a novel automated alternation flicker technology and side-by-side digital photography inspection for the evaluation of PPA progression.


METHODS
Consecutive patients with serial digital optic nerve photographs at least 1 year apart were included. Two graders (NR, BV) masked to image chronology assessed a set of photographs for progressive PPA using predefined criteria based on reference photographs containing mild, moderate, extensive or no PPA progression. At a separate session, the graders evaluated photographs using alternation flicker (EyeIC, Narberth, PA, USA) applying the same criteria. The order of patients and technique was randomized. Graders then assessed the same set of flickers and photographs a second time with the order of presentation reversed. The main outcome measure was the assessment of progressive PPA as identified by alternation flicker and digital photography inspection. Inter- and intra-observer agreement using each technique was assessed using the kappa statistic. A bootstrap method for comparing correlated kappa coefficients was used to assess statistical significance.


RESULTS
Serial photographs from 131 eyes of 68 patients were evaluated. Both graders identified significantly more cases of PPA progression using flicker compared to photography (27-34% vs 8-13%; both p< or =0.003). Inter-observer agreement using flicker was better than using photographs (kappa=0.52 vs 0.18, p=0.02). Intra-observer agreement was similar for both graders (photos: kappa=0.58 vs 0.57, p=0.97; flicker: kappa=0.61 vs 0.70, p=0.37). When progression was assessed by the number of progressive quadrants identified by each grader using a weighted kappa statistic, flicker inter-observer agreement was still moderate (kappa=0.45) and significantly better (p=0.01) than photography, which showed poor agreement (kappa=0.15). Intra-observer agreement with a weighted kappa for quadrant progression was also similar for both graders (photos: grader 1 kappa=0.53 vs grader 2 kappa=0.52, p=0.92; flickers: grader 1 kappa=0.58 vs grader 2 kappa=0.69, p=0.22). Conclusion Flicker identified more cases of progressive PPA than photographic review. Agreement between observers was significantly higher when using the automated flicker technology.
VanderBeek
Brian L
BL
Department of Ophthalmology, Weill Cornell Medical College, Weill Greenberg Center, 1305 York Ave. at East 70th St., New York, NY 10021, USA. brian.vanderbeek@yahoo.com
Smith
Scott D
SD
Radcliffe
Nathan M
NM
D003941:Diagnostic Techniques, Ophthalmological; D018450:Disease Progression; D005260:Female; D005500:Follow-Up Studies; D005901:Glaucoma / Q000175:diagnosis*; D006801:Humans; D007090:Image Interpretation, Computer-Assisted / Q000379:methods*; D008297:Male; D015588:Observer Variation; D009798:Ocular Hypertension / Q000175:diagnosis; D009896:Optic Atrophy / Q000175:diagnosis*; D009898:Optic Disk / Q000473:pathology*; D010781:Photography / Q000379:methods*; D015203:Reproducibility of Results; D012189:Retrospective Studies
Ophthalmology. 1998 Aug;105(8):1541-5
9709771
J Glaucoma. 1998 Oct;7(5):306-11
9786558
Br J Ophthalmol. 2006 Mar;90(3):262-7
16488940
Ophthalmology. 2004 Sep;111(9):1627-35
15350314
Doc Ophthalmol. 1981 Jul 15;51(3):269-76
7285773
Am J Ophthalmol. 1976 Mar;81(3):341-5
943951
Arch Ophthalmol. 2002 Jun;120(6):701-13; discussion 829-30
12049574
Ophthalmology. 1999 Nov;106(11):2144-53
10571351
Arch Ophthalmol. 2002 Oct;120(10):1268-79
12365904
Optometry. 2009 Aug;80(8):437-41
19635435
Invest Ophthalmol Vis Sci. 1989 Nov;30(11):2376-84
2807794
Am J Ophthalmol. 2009 Jan;147(1):39-44.e1
18790472
Am J Ophthalmol. 1998 Oct;126(4):487-97
9780093
Am J Ophthalmol. 1999 May;127(5):623-5
10334368
Acta Ophthalmol (Copenh). 1979 Jun;57(3):503-6
474092
Curr Opin Ophthalmol. 2005 Apr;16(2):84-8
15744137
Ophthalmology. 2002 Sep;109(9):1612-21
12208707
Ophthalmology. 2007 Nov;114(11):1965-72
17628686
Ophthalmology. 2000 Jul;107(7):1316-20
10889105
Am J Ophthalmol. 2008 Nov;146(5):735-40
18723142
Am J Ophthalmol. 2004 Apr;137(4):646-54
15059703
Ophthalmology. 1999 May;106(5):857
10328376
Klin Monbl Augenheilkd. 2002 Dec;219(12):862-5
12548470
Invest Ophthalmol Vis Sci. 1989 May;30(5):919-26
2722448