title: How reliable are county and regional health rankings?
abstract: Surveillance system indicators of morbidity, mortality, or behaviors are used to provide regional information for ever-smaller areas, most recently for ranking counties. These rankings are thought to provide information about the relative standing of regions and provide information about problem areas and the success of programs. We investigate the ability of such rankings to reliably assess health. We assess the reliability of several ranked health indices used at the county level and the consistency of an index's quality across different states. Reliability is assessed using an index of reliability, simulations, and the ability of an index to consistently identify the top 10 % (worst) counties within a state. There is marked variability across measures to provide consistent ranks, across states, and, many times, across states for a particular measure. A few health measures do consistently well, e.g., Teen Birth, Chlamydia, and Years of Potential Life Lost rates. While a few health rankings appear worthy of use for policy and in the identification of local problems, in general, they are not consistent across regions.
authors: Department of Psychiatry, Carver College of Medicine, University of Iowa, Iowa City, IA 52242, USA. stephan-arndt@uiowa.edu
authors: Stephan
authors: S
authors: Arndt
authors: Laura
authors: L
authors: Acion
authors: Kristin
authors: K
authors: Caspers
authors: Phyllis
authors: P
authors: Blood
mesh_terms: D006291:Health Policy; D006305:Health Status Indicators; D006801:Humans; D015203:Reproducibility of Results
references: Control Clin Trials. 1986 Sep;7(3):177-88
references: 3802833
references: Stat Med. 2002 Jun 15;21(11):1539-58
references: 12111919
references: JAMA. 1999 Jun 9;281(22):2098-105
references: 10367820
references: Prev Chronic Dis. 2010 Sep;7(5):A101
references: 20712928
references: Prev Chronic Dis. 2010 Sep;7(5):A92
references: 20712940
references: J Epidemiol Community Health. 2003 Mar;57(3):186-99
references: 12594195
references: Public Health. 2005 Apr;119(4):239-45
references: 15733682
references: Arch Intern Med. 2007 Jul 9;167(13):1342-4
references: 17620525
references: J Public Health Manag Pract. 2011 Sep-Oct;17(5):397-400
references: 21788775
references: Can J Public Health. 2001 Jul-Aug;92(4):295-8
references: 11962116
references: Am J Epidemiol. 2002 Sep 1;156(5):471-82
references: 12196317
references: Med Care. 1996 Aug;34(8):737-53
references: 8709656
references: Psychol Methods. 2006 Jun;11(2):193-206
references: 16784338
references: BMC Health Serv Res. 2009 Jul 21;9:122
references: 19622159
references: BMC Public Health. 2007 Mar 29;7:44
references: 17394645
references: Med Care. 2005 Dec;43(12):1177-84
references: 16299428
references: Am J Public Health. 2008 Feb;98(2):209-12
references: 18172156
references: Popul Health Metr. 2011 Feb 02;9(1):3
references: 21288354
references: BMJ. 1998 Jun 6;316(7146):1701-4; discussion 1705
references: 9614016
references: J Public Health Manag Pract. 2009 Jan-Feb;15(1):24-32
references: 19077591
references: Prev Chronic Dis. 2010 Jul;7(4):A75
references: 20550833
references: BMJ. 2003 Sep 6;327(7414):557-60
references: 12958120