Introduction of patient video clips into computer-based testing: effects on item statistics and reliability estimates.
OBJECTIVE
Using patient video clips to evaluate examinees' skills in interpreting physical examination findings is possible with computer-based testing, but the psychometric properties of video-based questions are unknown.


METHODS
We developed parallel test questions incorporating video clips or text descriptions of abnormal neurologic findings and administered them to 106 fourth-year medical students finishing their Neurology Clerkship.


RESULTS
Overall, video-based questions had comparable difficulty and discrimination compared to analogous text-based questions. Preliminary studies indicated similar reliability with text- and video-based questions.


CONCLUSIONS
The inclusion of patient video clips in computer-based testing is feasible from technical, practical, and psychometric perspectives. Further study is needed to gather validity evidence for this novel question format.
Lieberman
Steven A
SA
steven.lieberman@utmb.edu
Frye
Ann W
AW
Litwins
Stephanie D
SD
Rasmusson
Karen A
KA
Boulet
John R
JR
D002982:Clinical Clerkship; D002983:Clinical Competence / Q000706:statistics & numerical data*; D003198:Computer Simulation; D004504:Education, Medical, Undergraduate / Q000379:methods; D004521:Educational Measurement / Q000379:methods*; D005240:Feasibility Studies; D006801:Humans; D019212:Multimedia; D009422:Nervous System Diseases / Q000175:diagnosis; D016544:Patient Simulation; D015203:Reproducibility of Results; D013337:Students, Medical; D014481:United States