title: Quality assessments of HMO diagnosis databases used to monitor childhood vaccine safety.
abstract: OBJECTIVE
  To assess the quality of automated diagnoses extracted from medical care databases by the Vaccine Safety Datalink (VSD) study.
  
  
  METHODS
  Two methods are used to assess quality of VSD diagnosis data. The first method compares common automated and abstracted diagnostic categories ("outcomes") in 1-2% simple random samples of study populations. The second method estimates positive predictive values of automated diagnosis codes used to identify potential cases of rare conditions (e.g., acute ataxia) for inclusion in nested case-control medical record abstraction studies.
  
  
  RESULTS
  There was good agreement (64-68%) between automated and abstracted outcomes in the 1-2% simple random samples at 3 of the 4 VSD sites and poor agreement (44%) at 1 site. Overall at 3 sites, 56% of children with automated cerebella ataxia codes (ICD-9 = 334) and 22% with "lack of coordination" codes (ICD-9 = 781.3) met objective clinical criteria for acute ataxia.
  
  
  CONCLUSIONS
  The misclassification error rates for automated screening outcomes substantially reduce the power of screening analyses and limit usefulness of screening analyses to moderate to strong vaccine-outcome associations. Medical record verification of outcomes is needed for definitive assessments.
authors.affiliation: Center for Health Research, Kaiser Permanente Northwest, 3800 N. Interstate Ave., Portland, OR 97227-1110, USA. john.mullooly@kpchr.org
authors.forename: J
authors.initials: J
authors.lastname: Mullooly
authors.forename: L
authors.initials: L
authors.lastname: Drew
authors.forename: F
authors.initials: F
authors.lastname: DeStefano
authors.forename: J
authors.initials: J
authors.lastname: Maher
authors.forename: K
authors.initials: K
authors.lastname: Bohlke
authors.forename: V
authors.initials: V
authors.lastname: Immanuel
authors.forename: S
authors.initials: S
authors.lastname: Black
authors.forename: E
authors.initials: E
authors.lastname: Lewis
authors.forename: P
authors.initials: P
authors.lastname: Ray
authors.forename: C
authors.initials: C
authors.lastname: Vadheim
authors.forename: M
authors.initials: M
authors.lastname: Lugg
authors.forename: R
authors.initials: R
authors.lastname: Chen
mesh_terms: D002675:Child, Preschool; D003628:Database Management Systems / Q000592:standards*; D006279:Health Maintenance Organizations; D006302:Health Services Research; D006801:Humans; D038801:International Classification of Diseases; D011786:Quality Control; D012449:Safety; D014481:United States; D014612:Vaccines / Q000009:adverse effects*
chemical_list: D014612:Vaccines