title: Evaluating teaching methods: validation of an evaluation tool for hydrodissection and phacoemulsification portions of cataract surgery.
abstract: OBJECTIVE
  To develop and assess the validity of an evaluation tool to assess quantitatively the hydrodissection and phacoemulsification portions of cataract surgery performed by residents.
  
  
  METHODS
  Case series.
  
  
  METHODS
  Jules Stein Eye Institute, Olive View-UCLA Medical Center, and Veterans Administration Medical Center, Los Angeles, California, USA.
  
  
  METHODS
  The UCLA ophthalmology faculty members were surveyed and the literature was reviewed to develop a grading tool consisting of 15 questions to evaluate surgical technique, including questions from the Global Rating Assessment of Skills in Intraocular Surgery and from the International Council of Ophthalmology's Ophthalmology Surgical Competency Assessment Rubric. Video clips of the hydrodissection and phacoemulsification portions of cataract surgery performed by 1 postgraduate year 2 (PGY2) resident, 1 PGY3 resident, 2 PGY4 residents, and an advanced surgeon were independently graded in a masked fashion by an 8-member faculty panel.
  
  
  RESULTS
  Eleven of the 15 questions had a significant association with surgical experience level (P<.05, analysis of variance). Interobserver variability in grading yielded intraclass correlation coefficients between 0.28 and 0.72. The questions with the lowest interobserver variability were hydrodissection questions on instrument handling, flow of operation, and nucleus rotation. Nucleus cracking also had low variability. Less directly visible tasks, especially 3-dimensional tasks, had wider interobserver variability.
  
  
  CONCLUSIONS
  Surgical performance can be validly measured using an evaluation tool. Improved videography and studies to identify the best questions for evaluating each step of cataract surgery may help ophthalmic educators more precisely measure training outcomes for improving teaching interventions.
  
  
  BACKGROUND
  No author has a financial or proprietary interest in any material or method mentioned.
authors.affiliation: From Jules Stein Eye Institute (Gordon, Bartlett, Mondino) and Veterans Administration Medical Center of Greater Los Angeles (Smith, Hollander, Giaconi, Stelzner), Los Angeles, Olive View-UCLA Medical Center (Devgan), Sylmar, and Harbor-UCLA Medical Center (McCannel), Torrance, California, USA. Electronic address: lasik@pacbell.net.
authors.forename: Ronald J
authors.initials: RJ
authors.lastname: Smith
authors.affiliation: From Jules Stein Eye Institute (Gordon, Bartlett, Mondino) and Veterans Administration Medical Center of Greater Los Angeles (Smith, Hollander, Giaconi, Stelzner), Los Angeles, Olive View-UCLA Medical Center (Devgan), Sylmar, and Harbor-UCLA Medical Center (McCannel), Torrance, California, USA.
authors.forename: Colin A
authors.initials: CA
authors.lastname: McCannel
authors.affiliation: From Jules Stein Eye Institute (Gordon, Bartlett, Mondino) and Veterans Administration Medical Center of Greater Los Angeles (Smith, Hollander, Giaconi, Stelzner), Los Angeles, Olive View-UCLA Medical Center (Devgan), Sylmar, and Harbor-UCLA Medical Center (McCannel), Torrance, California, USA.
authors.forename: Lynn K
authors.initials: LK
authors.lastname: Gordon
authors.affiliation: From Jules Stein Eye Institute (Gordon, Bartlett, Mondino) and Veterans Administration Medical Center of Greater Los Angeles (Smith, Hollander, Giaconi, Stelzner), Los Angeles, Olive View-UCLA Medical Center (Devgan), Sylmar, and Harbor-UCLA Medical Center (McCannel), Torrance, California, USA.
authors.forename: David A
authors.initials: DA
authors.lastname: Hollander
authors.affiliation: From Jules Stein Eye Institute (Gordon, Bartlett, Mondino) and Veterans Administration Medical Center of Greater Los Angeles (Smith, Hollander, Giaconi, Stelzner), Los Angeles, Olive View-UCLA Medical Center (Devgan), Sylmar, and Harbor-UCLA Medical Center (McCannel), Torrance, California, USA.
authors.forename: JoAnn A
authors.initials: JA
authors.lastname: Giaconi
authors.affiliation: From Jules Stein Eye Institute (Gordon, Bartlett, Mondino) and Veterans Administration Medical Center of Greater Los Angeles (Smith, Hollander, Giaconi, Stelzner), Los Angeles, Olive View-UCLA Medical Center (Devgan), Sylmar, and Harbor-UCLA Medical Center (McCannel), Torrance, California, USA.
authors.forename: Sadiqa K
authors.initials: SK
authors.lastname: Stelzner
authors.affiliation: From Jules Stein Eye Institute (Gordon, Bartlett, Mondino) and Veterans Administration Medical Center of Greater Los Angeles (Smith, Hollander, Giaconi, Stelzner), Los Angeles, Olive View-UCLA Medical Center (Devgan), Sylmar, and Harbor-UCLA Medical Center (McCannel), Torrance, California, USA.
authors.forename: Uday
authors.initials: U
authors.lastname: Devgan
authors.affiliation: From Jules Stein Eye Institute (Gordon, Bartlett, Mondino) and Veterans Administration Medical Center of Greater Los Angeles (Smith, Hollander, Giaconi, Stelzner), Los Angeles, Olive View-UCLA Medical Center (Devgan), Sylmar, and Harbor-UCLA Medical Center (McCannel), Torrance, California, USA.
authors.forename: John
authors.initials: J
authors.lastname: Bartlett
authors.affiliation: From Jules Stein Eye Institute (Gordon, Bartlett, Mondino) and Veterans Administration Medical Center of Greater Los Angeles (Smith, Hollander, Giaconi, Stelzner), Los Angeles, Olive View-UCLA Medical Center (Devgan), Sylmar, and Harbor-UCLA Medical Center (McCannel), Torrance, California, USA.
authors.forename: Bartly J
authors.initials: BJ
authors.lastname: Mondino
mesh_terms: D000328:Adult; D002387:Cataract Extraction / Q000193:education / Q000592:standards; D002983:Clinical Competence / Q000592:standards*; D004503:Education, Medical, Graduate; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D007396:Internship and Residency; D015588:Observer Variation; D061646:Operative Time; D009885:Ophthalmology / Q000193:education*; D018918:Phacoemulsification / Q000193:education / Q000592:standards*; D015203:Reproducibility of Results; D011795:Surveys and Questionnaires; D013663:Teaching / Q000379:methods*; D014741:Video Recording