Automation failures on tasks easily performed by operators undermine trust in automated aids.
OBJECTIVE
We tested the hypothesis that automation errors on tasks easily performed by humans undermine trust in automation.


BACKGROUND
Research has revealed that the reliability of imperfect automation is frequently misperceived. We examined the manner in which the easiness and type of imperfect automation errors affect trust and dependence.


METHODS
Participants performed a target detection task utilizing an automated aid. In Study 1, the aid missed targets either on easy trials (easy miss group) or on difficult trials (difficult miss group). In Study 2, we manipulated both easiness and type of error (miss vs. false alarm). The aid erred on either difficult trials alone (difficult errors group) or on difficult and easy trials (easy miss group; easy false alarm group).


RESULTS
In both experiments, easy errors led to participants mistrusting and disagreeing more with the aid on difficult trials, as compared with those using aids that generated only difficult errors. This resulted in a downward shift in decision criterion for the former, leading to poorer overall performance. Misses and false alarms led to similar effects.


CONCLUSIONS
Automation errors on tasks that appear "easy" to the operator severely degrade trust and reliance.


CONCLUSIONS
Potential applications include the implementation of system design solutions that circumvent the negative effects of easy automation errors.
Madhavan
Poornima
P
Department of Social and Decision Sciences, Porter Hall 208-J, Carnegie Mellon University, Pittsburgh, PA 15213, USA. madhavan@andrew.cmu.edu
Wiegmann
Douglas A
DA
Lacson
Frank C
FC
D001331:Automation; D004868:Equipment Failure; D006801:Humans; D007087:Illinois; D013647:Task Performance and Analysis; D035502:Trust