Applying signal-detection theory to the study of observer accuracy and bias in behavioral assessment.
We evaluated the feasibility and utility of a laboratory model for examining observer accuracy within the framework of signal-detection theory (SDT). Sixty-one individuals collected data on aggression while viewing videotaped segments of simulated teacher-child interactions. The purpose of Experiment 1 was to determine if brief feedback and contingencies for scoring accurately would bias responding reliably. Experiment 2 focused on one variable (specificity of the operational definition) that we hypothesized might decrease the likelihood of bias. The effects of social consequences and information about expected behavior change were examined in Experiment 3. Results indicated that feedback and contingencies reliably biased responding and that the clarity of the definition only moderately affected this outcome.
University of Houston, Clear Lake, Texas 77058, USA. lerman@uhcl.edu
Dorothea C
DC
Lerman
Allison
A
Tetreault
Alyson
A
Hovanetz
Emily
E
Bellaci
Jonathan
J
Miller
Hilary
H
Karp
Angela
A
Mahmood
Maggie
M
Strobel
Shelley
S
Mullen
Alice
A
Keyl
Alexis
A
Toupard
D000328:Adult; D015982:Bias; D003625:Data Collection / Q000706:statistics & numerical data*; D005246:Feedback; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D019370:Observation / Q000379:methods*; D015588:Observer Variation; D011597:Psychomotor Performance; D017603:Signal Detection, Psychological