title: Assessment of ophthalmology resident on-call performance.
abstract: OBJECTIVE
  To design and implement a valid tool for assessment of ophthalmology resident on-call performance.
  
  
  METHODS
  Retrospective chart audit.
  
  
  METHODS
  Tertiary care academic ophthalmology programs.
  
  
  METHODS
  Ophthalmology faculty and residents at the University of Cincinnati and the University of Iowa.
  
  
  METHODS
  A 1-page on-call assessment tool (OCAT) and scoring rubric were developed to evaluate ophthalmology resident on-call performance. A retrospective chart audit of consecutive resident on-call charts was performed at the University of Cincinnati and the University of Iowa, and resident performance was scored using the OCAT.
  
  
  RESULTS
  A consensus of faculty comments established the face and content validity of the OCAT. One hundred ninety-one on-call consultations were assessed. Timeliness of consultation was the most common category receiving a borderline or unsatisfactory rating. Borderline ratings in knowledge-based categories (history, examination, assessment and plan, urgency rating) occurred more often for postgraduate year 2 (PGY2) residents than for PGY3 residents (P = 0.05, chi-square test). Incomplete differential diagnosis (n = 6) and lack of follow-up instruction (n = 5) were the most common deficiencies observed.
  
  
  CONCLUSIONS
  The OCAT has face, content, and discriminative validity. It can be used to assess resident competence in patient care, professionalism, and medical knowledge. Interrater and intrarater reliability still need to be determined. The OCAT may prove to be an additional assessment tool for meeting the Accreditation Council for Graduate Medical Education competencies mandate.
authors.affiliation: Department of Ophthalmology, University of Cincinnati, The Cincinnati Eye Institute, Cincinnati, Ohio, USA. kgolnik@cinci.rr.com
authors.forename: Karl C
authors.initials: KC
authors.lastname: Golnik
authors.forename: Andrew G
authors.initials: AG
authors.lastname: Lee
authors.forename: Keith
authors.initials: K
authors.lastname: Carter
mesh_terms: D002983:Clinical Competence; D004503:Education, Medical, Graduate / Q000592:standards*; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D007396:Internship and Residency; D009885:Ophthalmology / Q000193:education*; D011787:Quality of Health Care; D012017:Referral and Consultation; D015203:Reproducibility of Results; D012189:Retrospective Studies; D014481:United States