title: Inter-rater and test-retest reliability: methods and results for the neighborhood observational checklist.
abstract: The popularity of direct or systematic social observation as a method to evaluate the mechanisms by which neighborhood environments impact health and contribute to health disparities is growing. The development of measures with adequate inter-rater and test-retest reliability is essential for this research. In this paper, based on our experiences conducting direct observation of neighborhoods in Detroit, MI, we describe strategies to promote high inter-rater and test-retest reliability and methods to evaluate reliability. We then present the results and discuss implications for future research efforts using direct observation in four areas: methods to evaluate reliability, instrument content and design, observer training, and data collection.
authors.affiliation: Department of Public Health, Mental Health, and Administrative Nursing, University of Illinois at Chicago College of Nursing, 845 S Damen Ave, M/C 802, Chicago, IL 60608, USA. szenk@uic.edu
authors.forename: Shannon N
authors.initials: SN
authors.lastname: Zenk
authors.forename: Amy J
authors.initials: AJ
authors.lastname: Schulz
authors.forename: Graciela
authors.initials: G
authors.lastname: Mentz
authors.forename: James S
authors.initials: JS
authors.lastname: House
authors.forename: Clarence C
authors.initials: CC
authors.lastname: Gravlee
authors.forename: Patricia Y
authors.initials: PY
authors.lastname: Miranda
authors.forename: Patricia
authors.initials: P
authors.lastname: Miller
authors.forename: Srimathi
authors.initials: S
authors.lastname: Kannan
mesh_terms: D006801:Humans; D008824:Michigan; D015588:Observer Variation; D011159:Population Surveillance / Q000379:methods*; D012111:Residence Characteristics