title: The power of timing: Adding a time-to-completion cutoff to the Word Choice Test and Recognition Memory Test improves classification accuracy.
abstract: BACKGROUND
  The Recognition Memory Test (RMT) and Word Choice Test (WCT) are structurally similar, but psychometrically different. Previous research demonstrated that adding a time-to-completion cutoff improved the classification accuracy of the RMT. However, the contribution of WCT time-cutoffs to improve the detection of invalid responding has not been investigated. The present study was designed to evaluate the classification accuracy of time-to-completion on the WCT compared to the accuracy score and the RMT.
  
  
  METHODS
  Both tests were administered to 202 adults (Mage= 45.3 years, SD = 16.8; 54.5% female) clinically referred for neuropsychological assessment in counterbalanced order as part of a larger battery of cognitive tests.
  
  
  RESULTS
  Participants obtained lower and more variable scores on the RMT (M = 44.1, SD = 7.6) than on the WCT (M = 46.9, SD = 5.7). Similarly, they took longer to complete the recognition trial on the RMT (M = 157.2 s,SD = 71.8) than the WCT (M = 137.2 s, SD = 75.7). The optimal cutoff on the RMT (≤43) produced .60 sensitivity at .87 specificity. The optimal cutoff on the WCT (≤47) produced .57 sensitivity at .87 specificity. Time-cutoffs produced comparable classification accuracies for both RMT (≥192 s; .48 sensitivity at .88 specificity) and WCT (≥171 s; .49 sensitivity at .91 specificity). They also identified an additional 6-10% of the invalid profiles missed by accuracy score cutoffs, while maintaining good specificity (.93-.95). Functional equivalence was reached at accuracy scores ≤43 (RMT) and ≤47 (WCT) or time-to-completion ≥192 s (RMT) and ≥171 s (WCT).
  
  
  CONCLUSIONS
  Time-to-completion cutoffs are valuable additions to both tests. They can function as independent validity indicators or enhance the sensitivity of accuracy scores without requiring additional measures or extending standard administration time.
authors.affiliation: a Department of Psychology , University of Windsor , Windsor , ON , Canada.|b Neuropsychology Services, Department of Psychiatry , Geisel School of Medicine at Dartmouth , Lebanon , NH , USA.
authors.forename: Laszlo A
authors.initials: LA
authors.lastname: Erdodi
authors.affiliation: b Neuropsychology Services, Department of Psychiatry , Geisel School of Medicine at Dartmouth , Lebanon , NH , USA.|c Western Washington Medical Group , Everett , WA , USA.
authors.forename: Bradley T
authors.initials: BT
authors.lastname: Tyson
authors.affiliation: d The Schulich School of Medicine , Western University , London , ON , Canada.
authors.forename: Ayman G
authors.initials: AG
authors.lastname: Shahein
authors.affiliation: b Neuropsychology Services, Department of Psychiatry , Geisel School of Medicine at Dartmouth , Lebanon , NH , USA.
authors.forename: Jonathan D
authors.initials: JD
authors.lastname: Lichtenstein
authors.affiliation: a Department of Psychology , University of Windsor , Windsor , ON , Canada.
authors.forename: Christopher A
authors.initials: CA
authors.lastname: Abeare
authors.affiliation: b Neuropsychology Services, Department of Psychiatry , Geisel School of Medicine at Dartmouth , Lebanon , NH , USA.
authors.forename: Chantalle L
authors.initials: CL
authors.lastname: Pelletier
authors.affiliation: a Department of Psychology , University of Windsor , Windsor , ON , Canada.
authors.forename: Brandon G
authors.initials: BG
authors.lastname: Zuccato
authors.affiliation: a Department of Psychology , University of Windsor , Windsor , ON , Canada.
authors.forename: Brittany
authors.initials: B
authors.lastname: Kucharski
authors.affiliation: b Neuropsychology Services, Department of Psychiatry , Geisel School of Medicine at Dartmouth , Lebanon , NH , USA.
authors.forename: Robert M
authors.initials: RM
authors.lastname: Roth
mesh_terms: D000328:Adult; D002755:Choice Behavior / Q000502:physiology*; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D009483:Neuropsychological Tests; D011594:Psychometrics; D021641:Recognition, Psychology / Q000502:physiology*; D012680:Sensitivity and Specificity; D013997:Time Factors
keywords: Embedded validity indicators; Performance validity assessment; Recognition Memory Test; Time-to-completion cutoffs; Word Choice Test