The operational validity of a video-based situational judgment test for medical college admissions: illustrating the importance of matching predictor and criterion construct domains.
This study is part of a trend of examining noncognitive predictors, for example, a situational judgment test (SJT), as supplements to cognitive predictors for making college admission decisions. The authors examined criterion data over multiple academic years and universities. The criterion domain was broadly conceptualized, including both cognitive and interpersonal domains. The sample consisted of 7,197 candidates of the Medical and Dental Studies Admission Exam in Belgium. Results confirmed the importance of cognitive predictors. A video-based SJT was differentially valid for predicting overall grade point average for different curricula. The SJT showed incremental validity over cognitively oriented measures for curricula that included interpersonal courses, but not for other curricula. The SJT became more valid through the years. This demonstrates the importance of carefully specifying predictor- criterion linkages and of differentiating both predictor and criterion constructs.
Lievens
Filip
F
Department of Personnel Management and Work and Organizational Psychology, Ghent University, Ghent, Belgium. Filip.Lievens@ugent.be
Buyse
Tine
T
Sackett
Paul R
PR
D000293:Adolescent; D000328:Adult; D001076:Aptitude; D001530:Belgium; D003479:Curriculum; D004522:Educational Status; D005260:Female; D006801:Humans; D007398:Interpersonal Relations; D007600:Judgment; D008297:Male; D011336:Probability; D011581:Psychological Tests / Q000706:statistics & numerical data; D011594:Psychometrics / Q000706:statistics & numerical data; D015203:Reproducibility of Results; D012570:School Admission Criteria / Q000706:statistics & numerical data*; D013223:Statistics as Topic; D013335:Students, Dental / Q000523:psychology* / Q000706:statistics & numerical data; D013337:Students, Medical / Q000523:psychology* / Q000706:statistics & numerical data; D014741:Video Recording