Augmenting understanding of the relationship between situation awareness and confidence using calibration analysis.
The present study represents a preliminary examination of the relationship between situation awareness (SA) and confidence within a distributed information-sharing environment using the calibration methodology. The calibration methodology uses the indices of calibration, resolution and over/under-confidence to examine the relationship between the accuracy of the responses and the degree of confidence that one has in these responses, which leads to a measure of an operator's meta-SA. The results of this study revealed that, although the participants were slightly overconfident in their responses, overall they demonstrated good meta-SA. That is, the participants' subjective probability judgements corresponded to their pattern of SA response accuracy. It is concluded that the use of calibration analysis represents a better methodology for expanding our understanding of the relationship between SA and confidence and ultimately how this relationship can impact decision-making and performance in applied settings than can be achieved by examining SA measures alone.
Lichacz
Frederick M J
FM
Canadian Forces Experimentation Centre, Ottawa, Ontario, Canada. Lichacz.FMJ@forces.gc.ca
D001364:Awareness; D032882:Comprehension; D003198:Computer Simulation; D006126:Group Processes; D006801:Humans; D008297:Male; D013597:Systems Analysis