title: Can we trust measures of healthcare utilization from household surveys?
abstract: BACKGROUND
  The research community relies heavily on measures of healthcare utilization from household surveys to understand health seeking choices and to evaluate interventions in developing countries. Such measures are known to suffer from recall problems but there is limited evidence of whether the method of data collection affects evaluation findings. We compared the results of a randomized trial of free healthcare using utilization data from two sources.
  
  
  METHODS
  Data are from a study in Ghana, in which 2,194 households containing 2,592 children under 5 y old were randomized into a prepayment scheme providing free primary and some referral care, or to a control group whose families paid user fees for healthcare. Data on morbidity and health seeking behaviour were collected using a standard household survey administered at endline and a pictorial diary given to households over a six month period, collected at monthly intervals.
  
  
  RESULTS
  Self-reported measures of morbidity and healthcare utilization were substantially lower in the household survey than the pictorial diary when the recall period was over a month. Introducing free healthcare had a positive effect on primary care visits based on the pictorial diary and a non-significant negative effect according to the household survey. Using any clinic visit in the past month as the outcome, the difference in the effect of free care between the two data collection methods was 3.6 percentage points (p = 0.078).
  
  
  CONCLUSIONS
  The findings raise methodological concerns about measures of healthcare utilization from household surveys, particularly in the evaluation of health financing interventions.
authors.affiliation: Department of Global Health & Development, London School of Hygiene & Tropical Medicine, 15-17 Tavistock Place, London WC1H 9SH, UK. Timothy.Powell-Jackson@lshtm.ac.uk.
authors.forename: Evelyn Korkor
authors.initials: EK
authors.lastname: Ansah
authors.forename: Timothy
authors.initials: T
authors.lastname: Powell-Jackson
mesh_terms: D000328:Adult; D019985:Benchmarking; D002675:Child, Preschool; D003906:Developing Countries; D005191:Family Characteristics; D005249:Fees and Charges; D005260:Female; D005869:Ghana; D017048:Health Care Costs; D006296:Health Services / Q000706:statistics & numerical data*; D006297:Health Services Accessibility / Q000191:economics*; D006306:Health Surveys; D006801:Humans; D008288:Malaria / Q000175:diagnosis / Q000188:drug therapy / Q000191:economics; D008297:Male; D008499:Medical Records; D018512:Parasitemia / Q000175:diagnosis / Q000191:economics / Q000628:therapy; D017061:Prepaid Health Plans / Q000191:economics* / Q000706:statistics & numerical data; D012680:Sensitivity and Specificity
references.citation: Health Policy Plan. 2005 Nov;20(6):394-404
references.pmid: 16183737
references.citation: Stud Fam Plann. 1986 Mar-Apr;17(2):78-94
references.pmid: 3486503
references.citation: Drug Alcohol Depend. 1983 Apr;11(2):209-16
references.pmid: 6861618
references.citation: PLoS Med. 2009 Jan 6;6(1):e1000007
references.pmid: 19127975
references.citation: J Health Econ. 2009 Jan;28(1):1-19
references.pmid: 19058865
references.citation: J Public Health Med. 1992 Sep;14(3):264-70
references.pmid: 1419204
references.citation: J Pers. 1991 Sep;59(3):575-607
references.pmid: 1960643
references.citation: Lancet. 2012 Jul 14;380(9837):126-33
references.pmid: 22591542
references.citation: Health Psychol. 2007 Jan;26(1):60-7
references.pmid: 17209698
references.citation: Lancet. 2009 Apr 25;373(9673):1447-54
references.pmid: 19359034
references.citation: Am J Epidemiol. 2013 Feb 15;177(4):361-70
references.pmid: 23364878
references.citation: AIDS. 1993 Jun;7(6):877-82
references.pmid: 8363763
references.citation: Vital Health Stat 2. 1977;(69):i-viii, 1-78
references.pmid: 300939
references.citation: J Clin Epidemiol. 1998 Feb;51(2):119-27
references.pmid: 9474072
references.citation: BMJ. 2002 Apr 13;324(7342):860-1
references.pmid: 11950717
references.citation: BMJ. 2010 Oct 21;341:c5617
references.pmid: 20966008
references.citation: Med Care. 1980 Jan;18(1):73-95
references.pmid: 6986517
references.citation: Am J Epidemiol. 1989 Jul;130(1):94-9
references.pmid: 2787113