title: Experience of automation failures in training: effects on trust, automation bias, complacency and performance.
abstract: This work examined the effects of operators' exposure to various types of automation failures in training. Forty-five participants were trained for 3.5 h on a simulated process control environment. During training, participants either experienced a fully reliable, automatic fault repair facility (i.e. faults detected and correctly diagnosed), a misdiagnosis-prone one (i.e. faults detected but not correctly diagnosed) or a miss-prone one (i.e. faults not detected). One week after training, participants were tested for 3 h, experiencing two types of automation failures (misdiagnosis, miss). The results showed that automation bias was very high when operators trained on miss-prone automation encountered a failure of the diagnostic system. Operator errors resulting from automation bias were much higher when automation misdiagnosed a fault than when it missed one. Differences in trust levels that were instilled by the different training experiences disappeared during the testing session. Practitioner Summary: The experience of automation failures during training has some consequences. A greater potential for operator errors may be expected when an automatic system failed to diagnose a fault than when it failed to detect one.
authors.affiliation: a Department of Psychology , University of Fribourg , Fribourg , Switzerland.
authors.forename: Juergen
authors.initials: J
authors.lastname: Sauer
authors.affiliation: a Department of Psychology , University of Fribourg , Fribourg , Switzerland.
authors.forename: Alain
authors.initials: A
authors.lastname: Chavaillaz
authors.affiliation: b Operations Management and Information Systems , Nottingham University Business School , Nottingham , UK.
authors.forename: David
authors.initials: D
authors.lastname: Wastell
mesh_terms: D000293:Adolescent; D000328:Adult; D001331:Automation; D015982:Bias; D004868:Equipment Failure; D005260:Female; D006801:Humans; D008297:Male; D008328:Man-Machine Systems; D035502:Trust; D055815:Young Adult
keywords: Automation failure; adaptable automation; automation bias; complacency; trust