title: Validation sampling can reduce bias in health care database studies: an illustration using influenza vaccination effectiveness.
abstract: OBJECTIVE
  Estimates of treatment effectiveness in epidemiologic studies using large observational health care databases may be biased owing to inaccurate or incomplete information on important confounders. Study methods that collect and incorporate more comprehensive confounder data on a validation cohort may reduce confounding bias.
  
  
  METHODS
  We applied two such methods, namely imputation and reweighting, to Group Health administrative data (full sample) supplemented by more detailed confounder data from the Adult Changes in Thought study (validation sample). We used influenza vaccination effectiveness (with an unexposed comparator group) as an example and evaluated each method's ability to reduce bias using the control time period before influenza circulation.
  
  
  RESULTS
  Both methods reduced, but did not completely eliminate, the bias compared with traditional effectiveness estimates that do not use the validation sample confounders.
  
  
  CONCLUSIONS
  Although these results support the use of validation sampling methods to improve the accuracy of comparative effectiveness findings from health care database studies, they also illustrate that the success of such methods depends on many factors, including the ability to measure important confounders in a representative and large enough validation sample, the comparability of the full sample and validation sample, and the accuracy with which the data can be imputed or reweighted using the additional validation sample information.
authors.affiliation: Group Health Research Institute, Seattle, WA 98101, USA. nelson.jl@ghc.org
authors.forename: Jennifer Clark
authors.initials: JC
authors.lastname: Nelson
authors.forename: Tracey
authors.initials: T
authors.lastname: Marsh
authors.forename: Thomas
authors.initials: T
authors.lastname: Lumley
authors.forename: Eric B
authors.initials: EB
authors.lastname: Larson
authors.forename: Lisa A
authors.initials: LA
authors.lastname: Jackson
authors.forename: Michael L
authors.initials: ML
authors.lastname: Jackson
mesh_terms: D000328:Adult; D000368:Aged; D000369:Aged, 80 and over; D015331:Cohort Studies; D057186:Comparative Effectiveness Research / Q000706:statistics & numerical data*; D016208:Databases, Factual / Q000706:statistics & numerical data; D015981:Epidemiologic Factors; D005260:Female; D006304:Health Status; D006801:Humans; D007251:Influenza, Human / Q000517:prevention & control*; D008297:Male; D009026:Mortality; D017063:Outcome Assessment, Health Care / Q000706:statistics & numerical data*; D013223:Statistics as Topic; D014611:Vaccination / Q000401:mortality*; D014861:Washington / Q000453:epidemiology
keywords: Aged; Bias (epidemiologic); Comparative effectiveness research; Confounding factors (epidemiology); Influenza vaccines; Propensity score