title: A multi-institutional study of the Family Conference Objective Structured Clinical Exam: a reliable assessment of professional communication.
abstract: BACKGROUND
  To test the value of a simulated Family Conference Objective Structured Clinical Exam (OSCE) for resident assessment purposes, we examined the generalizability and construct validity of its scores in a multi-institutional study.
  
  
  METHODS
  Thirty-four first-year (PG1) and 27 third-year (PG3) surgery residents (n = 61) from 6 training programs were tested. The OSCE consisted of 2 cases (End-of-Life [EOL] and Disclosure of Complications [DOC]). At each program, 2 clinicians and 2 standardized family members rated residents using case-specific tools. Performance was measured as the percentage of possible score obtained. We examined the generalizability of scores for each case separately. To assess construct validity, we compared PG1 with PG3 performance using repeated measures multivariate analysis of variance (MANOVA).
  
  
  RESULTS
  The relative G-coefficient for EOL was .890. For DOC, the relative G-coefficient was .716. There were no significant performance differences between PG1 and PG3 residents.
  
  
  CONCLUSIONS
  This OSCE provides reliable assessments suitable for formative evaluation of residents' interpersonal communication skills and professionalism.
authors.affiliation: Department of Surgery, University of Minnesota, Minneapolis, 55455, USA. chipm001@umn.edu
authors.forename: Jeffrey G
authors.initials: JG
authors.lastname: Chipman
authors.forename: Travis P
authors.initials: TP
authors.lastname: Webb
authors.forename: Mohsen
authors.initials: M
authors.lastname: Shabahang
authors.forename: Stephanie F
authors.initials: SF
authors.lastname: Heller
authors.forename: Joan M
authors.initials: JM
authors.lastname: vanCamp
authors.forename: Amy L
authors.initials: AL
authors.lastname: Waer
authors.forename: Michael G
authors.initials: MG
authors.lastname: Luxenberg
authors.forename: Matthew
authors.initials: M
authors.lastname: Christenson
authors.forename: Connie C
authors.initials: CC
authors.lastname: Schmitz
mesh_terms: D002983:Clinical Competence; D003142:Communication; D004521:Educational Measurement / Q000379:methods*; D013502:General Surgery / Q000193:education*; D006801:Humans; D007396:Internship and Residency; D016544:Patient Simulation; D011183:Postoperative Complications; D011368:Professional-Family Relations; D015203:Reproducibility of Results; D013727:Terminal Care; D014342:Truth Disclosure