Inter-rater and test-retest reliability: methods and results for the neighborhood observational checklist.
The popularity of direct or systematic social observation as a method to evaluate the mechanisms by which neighborhood environments impact health and contribute to health disparities is growing. The development of measures with adequate inter-rater and test-retest reliability is essential for this research. In this paper, based on our experiences conducting direct observation of neighborhoods in Detroit, MI, we describe strategies to promote high inter-rater and test-retest reliability and methods to evaluate reliability. We then present the results and discuss implications for future research efforts using direct observation in four areas: methods to evaluate reliability, instrument content and design, observer training, and data collection.
Zenk
Shannon N
SN
Department of Public Health, Mental Health, and Administrative Nursing, University of Illinois at Chicago College of Nursing, 845 S Damen Ave, M/C 802, Chicago, IL 60608, USA. szenk@uic.edu
Schulz
Amy J
AJ
Mentz
Graciela
G
House
James S
JS
Gravlee
Clarence C
CC
Miranda
Patricia Y
PY
Miller
Patricia
P
Kannan
Srimathi
S
D006801:Humans; D008824:Michigan; D015588:Observer Variation; D011159:Population Surveillance / Q000379:methods*; D012111:Residence Characteristics