title: Measuring the quality of a childhood cancer care delivery system: assessing stakeholder agreement.
abstract: OBJECTIVE
  We described previously the development of a set of quality indicators (QIs) of a childhood cancer system in Ontario, Canada. The purpose of this study was to determine the acceptability of the proposed set of QIs among stakeholders of the childhood cancer system.
  
  
  METHODS
  A modified Delphi method was used to assess stakeholder agreement on the value of the proposed QIs. A QI evaluation survey was mailed to a stakeholder group of 23 multidisciplinary health care providers, survivors, parents, and policymakers who rated each QI on specific criteria. Prior to an in-person consensus meeting, the distribution of scores was provided to panel members. At the meeting, QIs were reevaluated and discussed in three successive rounds. QIs with 80% or more of panel agreement were considered endorsed.
  
  
  RESULTS
  Overall, 20 QIs were endorsed by the panel, measuring all seven quality dimensions of Ontario's Cancer System Quality Index framework. Five QIs were endorsed by 100% of the panel as follows: Five-year event-free survival, chemotherapy admission delay, drug availability, sufficient multidisciplinary staff, and parent satisfaction. Although none of the QIs relating to end-of-life or Satellite care were endorsed, panel members emphasized the need to measure these components of the system.
  
  
  CONCLUSIONS
  Standardized implementation of the 20 pediatric cancer QIs endorsed by the multidisciplinary stakeholder panel will provide ongoing monitoring of various dimensions of system quality and the development of benchmarks over time, greatly augmenting the ability to identify needed system improvements across populations and jurisdictions.
authors.affiliation: Pediatric Oncology Group of Ontario (POGO), Toronto, ON, Canada.
authors.forename: Nicole M E
authors.initials: NM
authors.lastname: Bradley
authors.forename: Paula D
authors.initials: PD
authors.lastname: Robinson
authors.forename: Mark L
authors.initials: ML
authors.lastname: Greenberg
authors.forename: Ronald D
authors.initials: RD
authors.lastname: Barr
authors.forename: Anne F
authors.initials: AF
authors.lastname: Klassen
authors.forename: Y Lilian
authors.initials: YL
authors.lastname: Chan
authors.forename: Corin M
authors.initials: CM
authors.lastname: Greenberg
mesh_terms: D000293:Adolescent; D000970:Antineoplastic Agents / Q000627:therapeutic use; D002648:Child; D003625:Data Collection; D003695:Delivery of Health Care / Q000592:standards*; D003697:Delphi Technique; D018572:Disease-Free Survival; D006801:Humans; D009369:Neoplasms / Q000628:therapy*; D009864:Ontario; D010290:Parents / Q000523:psychology; D017060:Patient Satisfaction; D058996:Quality Improvement; D019984:Quality Indicators, Health Care; D011787:Quality of Health Care
chemical_list: D000970:Antineoplastic Agents