title: The feasibility of a multi-format Web-based assessment of physicians' communication skills.
abstract: OBJECTIVE
  Little is known about the best approaches and format for measuring physicians' communication skills in an online environment. This study examines the reliability and validity of scores from two Web-based communication skill assessment formats.
  
  
  METHODS
  We created two online communication skill assessment formats: (a) MCQ (multiple-choice questions) consisting of video-based multiple-choice questions; (b) multi-format including video-based multiple-choice questions with rationales, Likert-type scales, and free text responses of what physicians would say to a patient. We randomized 100 general internists to each test format. Peer and patient ratings collected via the American Board of Internal Medicine (ABIM) served as validity sources.
  
  
  RESULTS
  Seventy-seven internists completed the tests (MCQ: 38; multi-format: 39). The adjusted reliability was 0.74 for both formats. Excellent communicators, as based on their peer and patient ratings, performed slightly better on both tests than adequate communicators, though this difference was not statistically significant. Physicians in both groups rated test format innovative (4.2 out of 5.0).
  
  
  CONCLUSIONS
  The acceptable reliability and participants' overall positive experiences point to the value of ongoing research into rigorous Web-based communication skills assessment.
  
  
  CONCLUSIONS
  With efficient and reliable scoring, the Web offers an important way to measure and potentially enhance physicians' communication skills.
authors.affiliation: School of Medicine, University of Washington, Seattle,WA, USA. sarakim@mednet.ucla.edu
authors.forename: Sara
authors.initials: S
authors.lastname: Kim
authors.forename: Douglas M
authors.initials: DM
authors.lastname: Brock
authors.forename: Brian J
authors.initials: BJ
authors.lastname: Hess
authors.forename: Eric S
authors.initials: ES
authors.lastname: Holmboe
authors.forename: Thomas H
authors.initials: TH
authors.lastname: Gallagher
authors.forename: Rebecca S
authors.initials: RS
authors.lastname: Lipner
authors.forename: Kathleen M
authors.initials: KM
authors.lastname: Mazor
mesh_terms: D002983:Clinical Competence / Q000592:standards / Q000706:statistics & numerical data*; D003142:Communication; D004521:Educational Measurement / Q000379:methods; D004522:Educational Status; D005240:Feasibility Studies; D005246:Feedback; D005260:Female; D019538:Health Care Surveys; D006801:Humans; D020407:Internet; D008297:Male; D009862:Online Systems; D010817:Physician-Patient Relations; D010820:Physicians / Q000592:standards / Q000706:statistics & numerical data*; D010818:Practice Patterns, Physicians' / Q000592:standards / Q000706:statistics & numerical data*; D015203:Reproducibility of Results; D013223:Statistics as Topic; D011795:Surveys and Questionnaires; D014481:United States; D014743:Videotape Recording