The Reliability of Naturalistic Observations of Social, Physical and Economic Environments of Bars.
Drinking in bars contributes to numerous public health problems, including violence and motor vehicle crashes. In order to formulate effective preventive interventions it is essential to identify which specific features of bar environments are related to increased risks. Unobtrusive ethnographic observations are one approach that has been used to characterize these features; however no studies have assessed reliability in a representative sample of bars. We performed brief scouting assessments in all 165 bars in six purposively selected California cities, followed by unobtrusive observations from a subsequent representative sample of 97 bars which were located in low and high bar density areas of the cities. Inter-rater reliability between two independent observers assessed individual item reliability, and principal components analyses assessed the reliability of a series of scales describing the physical, social, and economic characteristics of the bars. For the scouting assessment, items exhibited at least moderate reliability (κ or r ≥ 0.40). For the unobtrusive observations, items assessing physical and economic environments (e.g., pool table present, κ = 0.90; index beer cost, r = 0.82) had moderate to outstanding reliability (κ or r > 0.80). Items describing the social environment generally had poorer reliability, though group aspects (e.g., patron count, r = 0.78; patron circulation, r = 0.64) had better reliability than individual behaviors (e.g., derogatory speech, κ = 0.12). Scales constructed from specific sets of items exhibited modest reliability. The individual metrics and principal components we present will enable future studies seeking to disaggregate relationships between bar characteristics and public health problems.
Prevention Research Center, Pacific Institute for Research and Evaluation, Oakland, California; Monash University, Department of Epidemiology and Preventive Medicine, Melbourne, Australia.
Christopher
C
Morrison
Prevention Research Center, Pacific Institute for Research and Evaluation, Oakland, California.
Juliet P
JP
Lee
Prevention Research Center, Pacific Institute for Research and Evaluation, Oakland, California.
Paul J
PJ
Gruenewald
Prevention Research Center, Pacific Institute for Research and Evaluation, Oakland, California; University of Pittsburgh Graduate School of Public Health, Department of Behavioral and Community Health Sciences, Pittsburgh Pennsylvania.
Christina
C
Mair
Bar; drinking; ethnography; quantitative; reliability; survey
Alcohol Clin Exp Res. 2015 Dec;39(12 ):2463-70
26756799
J Stud Alcohol. 1980 Mar;41(3):277-92
7374145
J Stud Alcohol. 2003 Nov;64(6):765-72
14743938
Am J Drug Alcohol Abuse. 2001 Aug;27(3):531-42
11506267
Am J Drug Alcohol Abuse. 2002 Nov;28(4):733-42
12492267
Addiction. 1997 Jun;92 Suppl 2:S155-71
9231442
Addiction. 2008 Jan;103(1):60-5
17996008
J Stud Alcohol. 1993 Sep;54(5):590-9
8412149
Contemp Drug Probl. 2008 Spring;35:59-98
22522904
Int J Behav Nutr Phys Act. 2010 Nov 15;7:82
21078167
Drug Alcohol Depend. 2009 Jun 1;102(1-3):41-8
19250775
Am J Prev Med. 2009 Dec;37(6):556-69
19944925
J Stud Alcohol. 1993 Mar;54(2):133-8
8459706
Drug Alcohol Rev. 2004 Mar;23(1):19-29
14965884
Health Place. 2003 Mar;9(1):1-6
12609468
Cochrane Database Syst Rev. 2008 Jul 16;(3):CD005244
18646123
Alcohol Clin Exp Res. 2003 May;27(5):835-40
12766629
J Stud Alcohol. 1993 Mar;54(2):139-45
8459707
J Stud Alcohol. 1982 Mar;43(3):387-92
7121005
Int J Environ Res Public Health. 2013 Oct 11;10(10):4896-906
24157511
Eval Rev. 2007 Oct;31(5):469-89
17761807
J Clin Epidemiol. 2015 Sep;68(9):970-8
25910912
J Stud Alcohol. 1999 Jan;60(1):37-46
10096307
Subst Use Misuse. 2015 ;50(11):1427-36
26574657
J Public Health Manag Pract. 2008 May-Jun;14(3):e9-16
18408541
Drug Alcohol Depend. 2008 Dec 1;98(3):241-8
18640793
Int J Environ Res Public Health. 2009 Apr;6(4):1341-57
19440522
J Stud Alcohol. 2006 May;67(3):382-90
16608147
Addiction. 2014 May;109(5):736-45
24304295
Addict Behav. 2003 Dec;28(9):1681-700
14656553
Int J Health Geogr. 2010 Feb 10;9:6
20146821
Addiction. 2010 Jun;105(6):1032-40
20219058
Drug Alcohol Rev. 2012 Jun;31(4):377-84
22050319
Addiction. 2006 Nov;101(11):1569-80
17034436
Int J Addict. 1983 Oct;18(7):937-50
6642800
Addiction. 2008 Jan;103(1):66-77
18028523
Biometrics. 1977 Mar;33(1):159-74
843571
Health Place. 2015 Jan;31:163-72
25545769
Subst Use Misuse. 2013 Aug 1;:null
23905583
J Immigr Minor Health. 2010 Apr;12(2):221-7
18712482
J Public Health (Oxf). 2014 Sep;36(3):358-67
24159053
J Clin Epidemiol. 1990;43(6):543-9
2348207
Addiction. 1993 Nov;88(11):1519-26
8286997
Br J Addict. 1987 Jan;82(1):85-95
3470046
Soc Sci Med. 2010 Jan;70(2):277-92
19883966
J Drug Educ. 2012;42(3):315-26
23705511
Q J Stud Alcohol. 1974 Dec;35(4):1392-6
4445472
J Stud Alcohol Drugs. 2007 Mar;68(2):197-207
17286338