title: Comparing data mining methods on the VAERS database.
abstract: OBJECTIVE
  Data mining may enhance traditional surveillance of vaccine adverse events by identifying events that are reported more commonly after administering one vaccine than other vaccines. Data mining methods find signals as the proportion of times a condition or group of conditions is reported soon after the administration of a vaccine; thus it is a relative proportion compared across vaccines, and not an absolute rate for the condition. The Vaccine Adverse Event Reporting System (VAERS) contains approximately 150 000 reports of adverse events that are possibly associated with vaccine administration.
  
  
  METHODS
  We studied four data mining techniques: empirical Bayes geometric mean (EBGM), lower-bound of the EBGM's 90% confidence interval (EB05), proportional reporting ratio (PRR), and screened PRR (SPRR). We applied these to the VAERS database and compared the agreement among methods and other performance properties, particularly focusing on the vaccine-event combinations with the highest numerical scores in the various methods.
  
  
  RESULTS
  The vaccine-event combinations with the highest numerical scores varied substantially among the methods. Not all combinations representing known associations appeared in the top 100 vaccine-event pairs for all methods.
  
  
  CONCLUSIONS
  The four methods differ in their ranking of vaccine-COSTART pairs. A given method may be superior in certain situations but inferior in others. This paper examines the statistical relationships among the four estimators. Determining which method is best for public health will require additional analysis that focuses on the true alarm and false alarm rates using known vaccine-event associations. Evaluating the properties of these data mining methods will help determine the value of such methods in vaccine safety surveillance.
authors.affiliation: The Office of Biostatistics and Epidemiology, Center for Biologics Evaluation and Research, Food and Drug Administration, Rockville, MD 20852, USA.
authors.forename: David
authors.initials: D
authors.lastname: Banks
authors.forename: Emily Jane
authors.initials: EJ
authors.lastname: Woo
authors.forename: Dale R
authors.initials: DR
authors.lastname: Burwen
authors.forename: Phil
authors.initials: P
authors.lastname: Perucci
authors.forename: M Miles
authors.initials: MM
authors.lastname: Braun
authors.forename: Robert
authors.initials: R
authors.lastname: Ball
mesh_terms: D016907:Adverse Drug Reaction Reporting Systems / Q000706:statistics & numerical data*; D000465:Algorithms; D001499:Bayes Theorem; D002487:Centers for Disease Control and Prevention, U.S.; D016208:Databases, Factual / Q000706:statistics & numerical data*; D006801:Humans; D015233:Models, Statistical; D012984:Software; D014481:United States; D014486:United States Food and Drug Administration; D014612:Vaccines / Q000009:adverse effects*
chemical_list: D014612:Vaccines