title: False positive diagnosis of malingering due to the use of multiple effort tests.
abstract: OBJECTIVE
  Effort indicators are used to determine if neuropsychological test results are valid measures of a patient's cognitive abilities. The use of multiple effort measures is often advocated, but the false positive rate for multiple indicators depends on the number of measures used and the correlation among indicators. This study presents a meta-analysis of correlations among effort measures. False positive rates for multiple correlated indicators are then estimated using Monte Carlo simulations.
  
  
  METHODS
  a literature search of published studies identified 22 independent samples in which 407 correlations among 31 effort measures were available in 3564 participants with normal effort. Participants were patients with neurological or psychiatric disorders and healthy volunteers.
  
  
  RESULTS
  Meta-analysis showed a mean correlation among effort indicators of 0.31. Monte Carlo simulation based on a 15% false positive rate for individual indicators showed that, when 10 effort indicators are used together, 38% of patients with valid performance will be incorrectly identified as malingering if two failures is the diagnostic standard. Failure on five of 10 measures is required for a false positive rate of 10% or less. If five effort indicators are interpreted, a false positive rate of 19% results when two test failures are assumed to characterize poor effort and failure on three measures is required to maintain 90% specificity.
  
  
  CONCLUSIONS
  False positive rates for effort tests increase significantly as the number of indicators that are administered is increased.
authors.affiliation: Nova Southeastern University Center for Psychological Studies, Fort Lauderdale, FL 33314, USA.
authors.forename: Lena
authors.initials: L
authors.lastname: Berthelson
authors.forename: Siddika S
authors.initials: SS
authors.lastname: Mulchan
authors.forename: Anthony P
authors.initials: AP
authors.lastname: Odland
authors.forename: Lori J
authors.initials: LJ
authors.lastname: Miller
authors.forename: Wiley
authors.initials: W
authors.lastname: Mittenberg
mesh_terms: D003627:Data Interpretation, Statistical; D004185:Disability Evaluation; D005189:False Positive Reactions; D005260:Female; D006801:Humans; D008297:Male; D008306:Malingering / Q000175:diagnosis* / Q000523:psychology; D009010:Monte Carlo Method; D009483:Neuropsychological Tests; D015203:Reproducibility of Results