title: Reliability of a patient survey assessing cost-related changes in health care use among high deductible health plan enrollees.
abstract: BACKGROUND
  Recent increases in patient cost-sharing for health care have lent increasing importance to monitoring cost-related changes in health care use. Despite the widespread use of survey questions to measure changes in health care use and related behaviors, scant data exists on the reliability of such questions.
  
  
  METHODS
  We administered a cross-sectional survey to a stratified random sample of families in a New England health plan's high deductible health plan (HDHP) with ≥ $500 in annualized out-of-pocket expenditures. Enrollees were asked about their knowledge of their plan, information seeking, behavior change associated with having a deductible, experience of delay in care due in part to cost, and hypothetical delay in care due in part to cost. Initial respondents were mailed a follow-up survey within two weeks of each family returning the original survey. We computed several agreement statistics to measure the test-retest reliability for select questions. We also conducted continuity adjusted chi-square, and McNemar tests in both the original and follow-up samples to measure the degree to which our results could be reproduced. Analyses were stratified by self-reported income.
  
  
  RESULTS
  The test-retest reliability was moderate for the majority of questions (0.41 - 0.60) and the level of test-retest reliability did not differ substantially across each of the broader domains of questions. The observed proportions of respondents with delayed or foregone pediatric, adult, or any family care were similar when comparing the original and follow-up surveys. In the original survey, respondents in the lower-income group were more likely to delay or forego pediatric care, adult care, or any family care. All of the tests comparing income groups in the follow-up survey produced the same result as in the original survey.
  
  
  CONCLUSIONS
  In this population of HDHP beneficiaries, we found that survey questions concerning plan knowledge, information seeking, and delayed or foregone care were moderately reliable. Our results offer reassurance for researchers using survey information to study the effects cost sharing on health care utilization.
authors: Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, USA. penfold.r@ghc.org
authors: Robert B
authors: RB
authors: Penfold
authors: Jeffrey T
authors: JT
authors: Kullgren
authors: Irina
authors: I
authors: Miroshnik
authors: Alison A
authors: AA
authors: Galbraith
authors: Virginia L
authors: VL
authors: Hinrichsen
authors: Tracy A
authors: TA
authors: Lieu
references: Epidemiology. 1996 Mar;7(2):199-202
references: 8834562
references: Health Aff (Millwood). 2009 Jul-Aug;28(4):1145-54
references: 19597214
references: Drug Alcohol Depend. 2003 Jul 20;71(1):7-16
references: 12821201
references: NCHS Data Brief. 2009 Mar;(15):1-8
references: 19389327
references: Disabil Rehabil. 2000 May 20;22(8):339-44
references: 10896093
references: J Clin Epidemiol. 1988;41(10):949-58
references: 3057117
references: BMJ. 1993 May 29;306(6890):1440-4
references: 8518640
references: J Insect Sci. 2003;3:34
references: 15841249
references: Arch Intern Med. 2010 Nov 22;170(21):1918-25
references: 21098352
references: Qual Life Res. 2011 Feb;20(1):45-55
references: 20730626
references: Psychol Bull. 1968 Oct;70(4):213-20
references: 19673146
references: Biometrics. 1977 Mar;33(1):159-74
references: 843571
references: Inj Prev. 2000 Jun;6(2):148-50
references: 10875674
references: Qual Life Res. 2010 Aug;19(6):887-97
references: 20401552
references: Am J Epidemiol. 2009 Jun 1;169(11):1388-97
references: 19363096
references: J Gen Intern Med. 2010 Mar;25(3):249-54
references: 20033623
references: Am J Epidemiol. 1987 Aug;126(2):161-9
references: 3300279
references: Med Decis Making. 2011 Mar-Apr;31(2):260-9
references: 20935280
references: J Clin Epidemiol. 1988;41(10):969-70
references: 3193140
references: Arch Gen Psychiatry. 1985 Jul;42(7):725-8
references: 4015315
references: Am J Epidemiol. 1995 Mar 15;141(6):575-80
references: 7900725
references: Phys Ther. 2005 Mar;85(3):257-68
references: 15733050
references: Psychometrika. 1947 Jun;12(2):153-7
references: 20254758
references: Psychol Assess. 2007 Sep;19(3):309-17
references: 17845122
references: EBRI Issue Brief. 2009 Dec;(337):1-42
references: 20043408
references: Clin Pharmacol Ther. 1981 Jan;29(1):111-23
references: 7460469
references: BMC Health Serv Res. 2009 Dec 29;9:244
references: 20040076
references: Health Aff (Millwood). 2008 Jul-Aug;27(4):1120-31
references: 18607046
references: Br J Sports Med. 2011 Mar;45(3):203-8
references: 20484314
references: Pain Physician. 2011 Jan-Feb;14(1):61-70
references: 21267043
references: BMC Psychiatry. 2011 Jan 14;11:11
references: 21235749