Use of multimedia on the step 1 and step 2 clinical knowledge components of USMLE: a controlled trial of the impact on item characteristics.
BACKGROUND
During 2007, multimedia-based presentations of selected clinical findings were introduced into the United States Medical Licensing Examination. This study investigated the impact of presenting cardiac auscultation findings in multimedia versus text format on item characteristics.


METHODS
Content-matched versions of 43 Step 1 and 51 Step 2 Clinical Knowledge (CK) multiple-choice questions describing common pediatric and adult clinical presentations were administered in unscored sections of Step 1 and Step 2 CK. For multimedia versions, examinees used headphones to listen to the heart on a simulated chest while watching video showing associated chest and neck vein movements. Text versions described auscultation findings using standard medical terminology.


RESULTS
Analyses of item responses for first-time examinees from U.S./Canadian and international medical schools indicated that multimedia items were significantly more difficult than matched text versions, were less discriminating, and required more testing time.


CONCLUSIONS
Examinees can more readily interpret auscultation findings described in text using standard terminology than those same findings presented in a more authentic multimedia format. The impact on examinee performance and item characteristics is substantial.
Holtzman
Kathleen Z
KZ
National Board of Examiners, 3750 Market Street, Philadelphia, PA 19104, USA. kholtzman@nbme.org
Swanson
David B
DB
Ouyang
Wenli
W
Hussie
Kieran
K
Allbee
Krista
K
D002983:Clinical Competence; D004521:Educational Measurement / Q000379:methods*; D008007:Licensure, Medical; D019212:Multimedia; D014481:United States