title: Automated detection of heuristics and biases among pathologists in a computer-based system.
abstract: The purpose of this study is threefold: (1) to develop an automated, computer-based method to detect heuristics and biases as pathologists examine virtual slide cases, (2) to measure the frequency and distribution of heuristics and errors across three levels of training, and (3) to examine relationships of heuristics to biases, and biases to diagnostic errors. The authors conducted the study using a computer-based system to view and diagnose virtual slide cases. The software recorded participant responses throughout the diagnostic process, and automatically classified participant actions based on definitions of eight common heuristics and/or biases. The authors measured frequency of heuristic use and bias across three levels of training. Biases studied were detected at varying frequencies, with availability and search satisficing observed most frequently. There were few significant differences by level of training. For representativeness and anchoring, the heuristic was used appropriately as often or more often than it was used in biased judgment. Approximately half of the diagnostic errors were associated with one or more biases. We conclude that heuristic use and biases were observed among physicians at all levels of training using the virtual slide system, although their frequencies varied. The system can be employed to detect heuristic use and to test methods for decreasing diagnostic errors resulting from cognitive biases.
authors.affiliation: Department of Biomedical Informatics, University of Pittsburgh School of Medicine, UPMC Shadyside Cancer Pavilion-Room 313, 5150 Centre Avenue, Pittsburgh, PA 15232, USA. crowleyrs@upmc.edu
authors.forename: Rebecca S
authors.initials: RS
authors.lastname: Crowley
authors.forename: Elizabeth
authors.initials: E
authors.lastname: Legowski
authors.forename: Olga
authors.initials: O
authors.lastname: Medvedeva
authors.forename: Kayse
authors.initials: K
authors.lastname: Reitmeyer
authors.forename: Eugene
authors.initials: E
authors.lastname: Tseytlin
authors.forename: Melissa
authors.initials: M
authors.lastname: Castine
authors.forename: Drazen
authors.initials: D
authors.lastname: Jukic
authors.forename: Claudia
authors.initials: C
authors.lastname: Mello-Thoms
mesh_terms: D002983:Clinical Competence / Q000592:standards; D003936:Diagnosis, Computer-Assisted / Q000523:psychology* / Q000592:standards; D003951:Diagnostic Errors / Q000523:psychology; D006801:Humans; D007600:Judgment; D015588:Observer Variation; D010336:Pathology / Q000379:methods / Q000592:standards*