title: A comparative study of resident performance on standardized training examinations and the american board of ophthalmology written examination.
abstract: OBJECTIVE
  To investigate the relationships between ophthalmology resident performance on the United States Medical Licensing Examination (USMLE), the Ophthalmic Knowledge Assessment Program (OKAP) exam and the American Board of Ophthalmology written qualifying examination (ABO-WQE).
  
  
  METHODS
  Cohort study.
  
  
  METHODS
  We included 76 residents from 15 consecutive training classes (1991-2006) at 1 ophthalmologic residency training program.
  
  
  METHODS
  Numeric scores on the USMLE Step 1 and OKAP examinations during the 3 years of residency, and first attempt pass rate on the ABO-WQE were recorded for 76 residents. Age and gender were also noted. Spearman's rank correlations and univariate and multivariate logistic analyses were performed to determine relevant associations.
  
  
  METHODS
  First-time attempt pass rate on the ABO-WQE and/or successful completion of the ABO-WQE within 3 years of graduation from the residency program.
  
  
  RESULTS
  The ABO-WQE first-attempt pass rate was 72.6%, consistent with the national average. Resident USMLE scores were not significantly associated with ABO-WQE performance. The ABO-WQE pass rate was significantly associated with OKAP examination scores during the 3 residency years (year 1: odds ratio [OR], 8.85 and 95% confidence interval [CI] 1.82-42.79; year 2: OR, 5.28 and 95% CI, 1.15-25.27; year 3: OR, 11.08 and 95% CI, 1.86-68.96). Passing the OKAP examinations in all 3 years during residency training was associated with 5.43-fold increased odds of passing the ABO-WQE and failing all 3 OKAP examinations was associated with >9-fold lower odds of passing the ABO-WQE on the first attempt.
  
  
  CONCLUSIONS
  Our results suggest that OKAP examination performance is a predictor of a resident's success in passing the ABO-WQE on the first attempt, as well as within 3 years of graduation from an ophthalmologic training program. Awareness of this association may permit identification of residents at risk for failing the ABO-WQE and encourage educational remediation to prevent this failure.
authors.affiliation: Department of Ophthalmology and Visual Sciences, Case Western Reserve University School of Medicine, Cleveland, Ohio, USA.
authors.forename: Gene A
authors.initials: GA
authors.lastname: Johnson
authors.forename: Jeffrey N
authors.initials: JN
authors.lastname: Bloom
authors.forename: Loretta
authors.initials: L
authors.lastname: Szczotka-Flynn
authors.forename: Debra
authors.initials: D
authors.lastname: Zauner
authors.forename: Robert L
authors.initials: RL
authors.lastname: Tomsak
mesh_terms: D000328:Adult; D002568:Certification; D002983:Clinical Competence / Q000592:standards*; D015331:Cohort Studies; D004503:Education, Medical, Graduate / Q000592:standards*; D004521:Educational Measurement; D005260:Female; D006801:Humans; D007396:Internship and Residency / Q000592:standards*; D008004:Licensure; D008297:Male; D009885:Ophthalmology / Q000193:education* / Q000592:standards; D014481:United States; D055815:Young Adult