title: Population Health Metrics Research Consortium gold standard verbal autopsy validation study: design, implementation, and development of analysis datasets.
abstract: BACKGROUND
  Verbal autopsy methods are critically important for evaluating the leading causes of death in populations without adequate vital registration systems. With a myriad of analytical and data collection approaches, it is essential to create a high quality validation dataset from different populations to evaluate comparative method performance and make recommendations for future verbal autopsy implementation. This study was undertaken to compile a set of strictly defined gold standard deaths for which verbal autopsies were collected to validate the accuracy of different methods of verbal autopsy cause of death assignment.
  
  
  METHODS
  Data collection was implemented in six sites in four countries: Andhra Pradesh, India; Bohol, Philippines; Dar es Salaam, Tanzania; Mexico City, Mexico; Pemba Island, Tanzania; and Uttar Pradesh, India. The Population Health Metrics Research Consortium (PHMRC) developed stringent diagnostic criteria including laboratory, pathology, and medical imaging findings to identify gold standard deaths in health facilities as well as an enhanced verbal autopsy instrument based on World Health Organization (WHO) standards. A cause list was constructed based on the WHO Global Burden of Disease estimates of the leading causes of death, potential to identify unique signs and symptoms, and the likely existence of sufficient medical technology to ascertain gold standard cases. Blinded verbal autopsies were collected on all gold standard deaths.
  
  
  RESULTS
  Over 12,000 verbal autopsies on deaths with gold standard diagnoses were collected (7,836 adults, 2,075 children, 1,629 neonates, and 1,002 stillbirths). Difficulties in finding sufficient cases to meet gold standard criteria as well as problems with misclassification for certain causes meant that the target list of causes for analysis was reduced to 34 for adults, 21 for children, and 10 for neonates, excluding stillbirths. To ensure strict independence for the validation of methods and assessment of comparative performance, 500 test-train datasets were created from the universe of cases, covering a range of cause-specific compositions.
  
  
  CONCLUSIONS
  This unique, robust validation dataset will allow scholars to evaluate the performance of different verbal autopsy analytic methods as well as instrument design. This dataset can be used to inform the implementation of verbal autopsies to more reliably ascertain cause of death in national health information systems.
authors.affiliation: Institute for Health Metrics and Evaluation, University of Washington, 2301 Fifth Ave, Suite 600, Seattle, WA 98121, USA. cjlm@uw.edu.
authors.forename: Christopher Jl
authors.initials: CJ
authors.lastname: Murray
authors.forename: Alan D
authors.initials: AD
authors.lastname: Lopez
authors.forename: Robert
authors.initials: R
authors.lastname: Black
authors.forename: Ramesh
authors.initials: R
authors.lastname: Ahuja
authors.forename: Said Mohd
authors.initials: SM
authors.lastname: Ali
authors.forename: Abdullah
authors.initials: A
authors.lastname: Baqui
authors.forename: Lalit
authors.initials: L
authors.lastname: Dandona
authors.forename: Emily
authors.initials: E
authors.lastname: Dantzer
authors.forename: Vinita
authors.initials: V
authors.lastname: Das
authors.forename: Usha
authors.initials: U
authors.lastname: Dhingra
authors.forename: Arup
authors.initials: A
authors.lastname: Dutta
authors.forename: Wafaie
authors.initials: W
authors.lastname: Fawzi
authors.forename: Abraham D
authors.initials: AD
authors.lastname: Flaxman
authors.forename: Sara
authors.initials: S
authors.lastname: Gómez
authors.forename: Bernardo
authors.initials: B
authors.lastname: Hernández
authors.forename: Rohina
authors.initials: R
authors.lastname: Joshi
authors.forename: Henry
authors.initials: H
authors.lastname: Kalter
authors.forename: Aarti
authors.initials: A
authors.lastname: Kumar
authors.forename: Vishwajeet
authors.initials: V
authors.lastname: Kumar
authors.forename: Rafael
authors.initials: R
authors.lastname: Lozano
authors.forename: Marilla
authors.initials: M
authors.lastname: Lucero
authors.forename: Saurabh
authors.initials: S
authors.lastname: Mehta
authors.forename: Bruce
authors.initials: B
authors.lastname: Neal
authors.forename: Summer Lockett
authors.initials: SL
authors.lastname: Ohno
authors.forename: Rajendra
authors.initials: R
authors.lastname: Prasad
authors.forename: Devarsetty
authors.initials: D
authors.lastname: Praveen
authors.forename: Zul
authors.initials: Z
authors.lastname: Premji
authors.forename: Dolores
authors.initials: D
authors.lastname: Ramírez-Villalobos
authors.forename: Hazel
authors.initials: H
authors.lastname: Remolador
authors.forename: Ian
authors.initials: I
authors.lastname: Riley
authors.forename: Minerva
authors.initials: M
authors.lastname: Romero
authors.forename: Mwanaidi
authors.initials: M
authors.lastname: Said
authors.forename: Diozele
authors.initials: D
authors.lastname: Sanvictores
authors.forename: Sunil
authors.initials: S
authors.lastname: Sazawal
authors.forename: Veronica
authors.initials: V
authors.lastname: Tallo