title: Training for vigilance: using predictive power to evaluate feedback effectiveness.
abstract: OBJECTIVE
  We examined the effects of knowledge of results (KR) on vigilance accuracy and report the first use of positive and negative predictive power (PPP and NPP) to assess vigilance training effectiveness.
  
  
  BACKGROUND
  Training individuals to detect infrequent signals among a plethora of nonsignals is critical to success in many failure-intolerant monitoring technologies. KR has been widely used for vigilance training, but the effect of the schedule of KR presentation on accuracy has been neglected. Previous research on training for vigilance has used signal detection metrics or hits and false alarms. In this study diagnosticity measures were applied to augment traditional analytic methods.
  
  
  METHODS
  We examined the effects of continuous KR and a partial-KR regimen versus a no-KR control on decision diagnosticity.
  
  
  RESULTS
  Signal detection theory (SDT) analysis indicated that KR induced conservatism in responding but did not enhance sensitivity. However, KR in both forms equally enhanced PPP while selectively impairing NPP.
  
  
  CONCLUSIONS
  There is a trade-off in the effectiveness of KR in reducing false alarms and misses. Together, SDT and PPP/NPP measures provide a more complete portrait of performance effects.
  
  
  CONCLUSIONS
  PPP and NPP together provide another assessment technique for vigilance performance, and as additional diagnostic tools, these measures are potentially useful to the human factors community.
authors.affiliation: Department of Psychology, University of Central Florida, P.O. Box 161390, Orlando 32816-1390, USA. jszalma@mail.ucf.edu
authors.forename: James L
authors.initials: JL
authors.lastname: Szalma
authors.forename: Peter A
authors.initials: PA
authors.lastname: Hancock
authors.forename: Joel S
authors.initials: JS
authors.lastname: Warm
authors.forename: William N
authors.initials: WN
authors.lastname: Dember
authors.forename: Kelley S
authors.initials: KS
authors.lastname: Parsons
mesh_terms: D001143:Arousal; D001288:Attention; D030141:Feedback, Psychological; D005260:Female; D006801:Humans; D007721:Knowledge of Results, Psychological; D008297:Male; D012106:Research; D017603:Signal Detection, Psychological