title: Development and pilot testing of an OSCE for difficult conversations in surgical intensive care.
abstract: OBJECTIVE
  To describe the development and results of an Objective Structured Clinical Exam (OSCE) for leading family conferences in the surgical intensive care unit (SICU).
  
  
  METHODS
  Pilot demonstration and reliability assessment.
  
  
  METHODS
  General surgery residency program at a major academic teaching hospital.
  
  
  METHODS
  PGY-2 and PGY-4 categorical general surgery residents (n=8).
  
  
  RESULTS
  The SICU Family Conference OSCE consists of two 20-minute stations, one requiring residents to lead an end-of-life discussion and the other to disclose an iatrogenic complication. Actual case scenarios and trained actors were used; the examinations were videotaped in a standardized setting. Two professional raters as well as the participating actors assessed each resident performance using rating tools developed for each station and based on guiding principles gleaned from the literature. Resident debriefings and evaluation surveys were also conducted. Resident perception of the OSCE overall was positive. Analysis of the videotapes revealed the need for greater standardization of the actors' roles. The rating tools showed strong internal consistency (0.77-0.85), but inter-rater agreement of scores was generally low (<0.70) within rater groups. Family actors consistently gave residents higher global assessment scores than did the professional raters. Second- and fourth-year residents scored equally well on the examination.
  
  
  CONCLUSIONS
  This pilot provided residents with a positive learning experience and valid formative feedback. Case materials developed for each station served their function well. More work in actor and rater training is needed before the examination scores can be reliably used in summative evaluation.
authors.affiliation: Department of Surgery, University of Minnesota Medical School, Minneapolis, Minnesota 55455-0321, USA.
authors.forename: Jeffrey G
authors.initials: JG
authors.lastname: Chipman
authors.forename: Gregory J
authors.initials: GJ
authors.lastname: Beilman
authors.forename: Constance C
authors.initials: CC
authors.lastname: Schmitz
authors.forename: Susan C
authors.initials: SC
authors.lastname: Seatter
mesh_terms: D002983:Clinical Competence; D003142:Communication; D003422:Critical Care; D003643:Death; D004521:Educational Measurement / Q000379:methods*; D005246:Feedback; D013502:General Surgery / Q000193:education*; D006801:Humans; D007049:Iatrogenic Disease; D007396:Internship and Residency; D007858:Learning; D019300:Medical Errors; D010166:Palliative Care; D016544:Patient Simulation; D010865:Pilot Projects; D011368:Professional-Family Relations; D016730:Program Development; D014743:Videotape Recording