title: Use of multimedia on the step 1 and step 2 clinical knowledge components of USMLE: a controlled trial of the impact on item characteristics.
abstract: BACKGROUND
  During 2007, multimedia-based presentations of selected clinical findings were introduced into the United States Medical Licensing Examination. This study investigated the impact of presenting cardiac auscultation findings in multimedia versus text format on item characteristics.
  
  
  METHODS
  Content-matched versions of 43 Step 1 and 51 Step 2 Clinical Knowledge (CK) multiple-choice questions describing common pediatric and adult clinical presentations were administered in unscored sections of Step 1 and Step 2 CK. For multimedia versions, examinees used headphones to listen to the heart on a simulated chest while watching video showing associated chest and neck vein movements. Text versions described auscultation findings using standard medical terminology.
  
  
  RESULTS
  Analyses of item responses for first-time examinees from U.S./Canadian and international medical schools indicated that multimedia items were significantly more difficult than matched text versions, were less discriminating, and required more testing time.
  
  
  CONCLUSIONS
  Examinees can more readily interpret auscultation findings described in text using standard terminology than those same findings presented in a more authentic multimedia format. The impact on examinee performance and item characteristics is substantial.
authors.affiliation: National Board of Examiners, 3750 Market Street, Philadelphia, PA 19104, USA. kholtzman@nbme.org
authors.forename: Kathleen Z
authors.initials: KZ
authors.lastname: Holtzman
authors.forename: David B
authors.initials: DB
authors.lastname: Swanson
authors.forename: Wenli
authors.initials: W
authors.lastname: Ouyang
authors.forename: Kieran
authors.initials: K
authors.lastname: Hussie
authors.forename: Krista
authors.initials: K
authors.lastname: Allbee
mesh_terms: D002983:Clinical Competence; D004521:Educational Measurement / Q000379:methods*; D008007:Licensure, Medical; D019212:Multimedia; D014481:United States