A web-based team-oriented medical error communication assessment tool: development, preliminary reliability, validity, and user ratings.
BACKGROUND
Multiple-choice exams are not well suited for assessing communication skills. Standardized patient assessments are costly and patient and peer assessments are often biased. Web-based assessment using video content offers the possibility of reliable, valid, and cost-efficient means for measuring complex communication skills, including interprofessional communication.


METHODS
We report development of the Web-based Team-Oriented Medical Error Communication Assessment Tool, which uses videotaped cases for assessing skills in error disclosure and team communication. Steps in development included (a) defining communication behaviors, (b) creating scenarios, (c) developing scripts, (d) filming video with professional actors, and (e) writing assessment questions targeting team communication during planning and error disclosure.


RESULTS
Using valid data from 78 participants in the intervention group, coefficient alpha estimates of internal consistency were calculated based on the Likert-scale questions and ranged from α=.79 to α=.89 for each set of 7 Likert-type discussion/planning items and from α=.70 to α=.86 for each set of 8 Likert-type disclosure items. The preliminary test-retest Pearson correlation based on the scores of the intervention group was r=.59 for discussion/planning and r=.25 for error disclosure sections, respectively. Content validity was established through reliance on empirically driven published principles of effective disclosure as well as integration of expert views across all aspects of the development process. In addition, data from 122 medicine and surgical physicians and nurses showed high ratings for video quality (4.3 of 5.0), acting (4.3), and case content (4.5).


CONCLUSIONS
Web assessment of communication skills appears promising. Physicians and nurses across specialties respond favorably to the tool.
Medical Education, University of Washington, Seattle, Washington, USA. sarakim@mednet.ucla.edu
Sara
S
Kim
Doug
D
Brock
Carolyn D
CD
Prouty
Peggy Soule
PS
Odegard
Sarah E
SE
Shannon
Lynne
L
Robins
Jim G
JG
Boggs
Fiona J
FJ
Clark
Thomas
T
Gallagher
D003142:Communication; D004501:Education, Medical / Q000458:organization & administration*; D004521:Educational Measurement; D004522:Educational Status; D006801:Humans; D020407:Internet; D019300:Medical Errors / Q000517:prevention & control*; D010348:Patient Care Team / Q000458:organization & administration*; D010379:Peer Group; D010549:Personal Satisfaction; D015203:Reproducibility of Results; D013663:Teaching; D014743:Videotape Recording; D014956:Writing