title: Optical coherence tomography grading reproducibility during the Comparison of Age-related Macular Degeneration Treatments Trials.
abstract: OBJECTIVE
  To report reading center reproducibility during grading of Stratus optical coherence tomography (OCT) (Carl Zeiss Meditec, Dublin, CA) images obtained during the Comparison of Age-Related Macular Degeneration Treatments Trials (CATT).
  
  
  METHODS
  Prospective, clinical trial.
  
  
  METHODS
  Independent reading teams reevaluated 270 OCT scans randomly sampled from the first 2 years of CATT enrollment. To assess temporal drift, a cohort of 23 scans submitted during the initial portion of the CATT study was longitudinally followed with serial reproducibility analysis.
  
  
  METHODS
  The CATT readers performed standardized grading of OCT images. A reader team, composed of 2 independent readers and a senior reader, evaluated each scan. Grading included the CATT OCT end points of total thickness at the foveal center point and intraretinal fluid (IRF), subretinal fluid (SRF), and subretinal pigment epithelium (RPE) fluid. Independent reading teams masked to the results of initial grading reevaluated scans to determine the reproducibility of qualitative grading and measurements.
  
  
  METHODS
  Categorical grading agreement was reported using percent agreement and kappa statistic, and measurement agreement was reported using intraclass correlations and paired differences.
  
  
  RESULTS
  Reading center teams reproducibly graded IRF (percent agreement = 73%, kappa = 0.48; 95% confidence interval [CI], 0.38-0.58), SRF (percent agreement = 90%; kappa = 0.80; 95% CI, 0.73-0.87), and sub-RPE fluid (percent agreement 88%; kappa = 0.75; 95% CI, 0.67-0.83). For independent reading center team measurements of total thickness at the foveal center point, the intraclass correlation was 0.99 (95% CI, 0.99-0.99), and the mean paired difference between reading center teams was 4 μm (95% limits of agreement, -55 to 47 μm). There was no qualitative or quantitative grading drift.
  
  
  CONCLUSIONS
  The standardized protocols used to evaluate OCT scans from the CATT study were reproducible. The methods used are suitable to monitor OCT imaging data from a large, neovascular age-related macular degeneration, interventional, multicenter study.
  
  
  BACKGROUND
  The author(s) have no proprietary or commercial interest in any materials discussed in this article.
authors.affiliation: Wills Eye Institute, Mid Atlantic Retina, Philadelphia, Pennsylvania, USA.
authors.forename: Francis Char
authors.initials: FC
authors.lastname: DeCroos
authors.forename: Cynthia A
authors.initials: CA
authors.lastname: Toth
authors.forename: Sandra S
authors.initials: SS
authors.lastname: Stinnett
authors.forename: Cynthia S
authors.initials: CS
authors.lastname: Heydary
authors.forename: Russell
authors.initials: R
authors.lastname: Burns
authors.forename: Glenn J
authors.initials: GJ
authors.lastname: Jaffe
mesh_terms: D020533:Angiogenesis Inhibitors / Q000627:therapeutic use; D061067:Antibodies, Monoclonal, Humanized / Q000627:therapeutic use; D000068258:Bevacizumab; D004311:Double-Blind Method; D019773:Epiretinal Membrane / Q000175:diagnosis; D006801:Humans; D008268:Macular Degeneration / Q000145:classification / Q000175:diagnosis* / Q000188:drug therapy; D015588:Observer Variation; D011446:Prospective Studies; D011786:Quality Control; D000069579:Ranibizumab; D015203:Reproducibility of Results; D012160:Retina / Q000473:pathology; D058471:Subretinal Fluid; D041623:Tomography, Optical Coherence / Q000592:standards*; D042461:Vascular Endothelial Growth Factor A / Q000037:antagonists & inhibitors; D014792:Visual Acuity / Q000502:physiology
chemical_list: D020533:Angiogenesis Inhibitors; D061067:Antibodies, Monoclonal, Humanized; C467484:VEGFA protein, human; D042461:Vascular Endothelial Growth Factor A; D000068258:Bevacizumab; D000069579:Ranibizumab