Performance validity in undergraduate research participants: a comparison of failure rates across tests and cutoffs.
This study compared failure rates on performance validity tests (PVTs) across liberal and conservative cutoffs in a sample of undergraduate students participating in academic research.



Participants (n = 120) were administered four free-standing PVTs (Test of Memory Malingering, Word Memory Test, Rey 15-Item Test, Hiscock Forced-Choice Procedure) and three embedded PVTs (Digit Span, letter and category fluency). Participants also reported their perceived level of effort during testing.



At liberal cutoffs, 36.7% of the sample failed ≥1 PVTs, 6.7% failed ≥2, and .8% failed 3. At conservative cutoffs, 18.3% of the sample failed ≥1 PVTs, 2.5% failed ≥2, and .8% failed 3. Participants were 3 to 5 times more likely to fail embedded (15.8-30.8%) compared to free-standing PVTs (3.3-10.0%). There was no significant difference in failure rates between native and non-native English speaking participants at either liberal or conservative cutoffs. Additionally, there was no relation between self-reported effort and PVT failure rates.



Although PVT failure rates varied as a function of PVTs and cutoffs, between a third and a fifth of the sample failed ≥1 PVTs, consistent with high initial estimates of invalid performance in this population. Embedded PVTs had notably higher failure rates than free-standing PVTs. Assuming optimal effort in research using students as participants without a formal assessment of performance validity introduces a potentially significant confound in the study design.
a Department of Psychology , University of Windsor , Windsor , Canada.
Kelly Y
KY
An
a Department of Psychology , University of Windsor , Windsor , Canada.
Kristen
K
Kaploun
a Department of Psychology , University of Windsor , Windsor , Canada.
Laszlo A
LA
Erdodi
a Department of Psychology , University of Windsor , Windsor , Canada.
Christopher A
CA
Abeare
D000328:Adult; D005260:Female; D064368:Healthy Volunteers; D006801:Humans; D008297:Male; D008306:Malingering / Q000175:diagnosis; D008568:Memory; D009042:Motivation; D009483:Neuropsychological Tests; D010465:Perception; D015203:Reproducibility of Results; D012107:Research Design; D057566:Self Report; D013334:Students / Q000523:psychology*; D055815:Young Adult
Performance validity tests; base rate of failure; college sample; test-taking effort; undergraduate students