title: Development of a core set of performance measures for evaluating schizophrenia treatment services.
abstract: OBJECTIVE
  The purpose of study was to identify a list of performance measures for schizophrenia treatment services and to assemble a multistakeholder group to reach consensus on a core list.
  
  
  METHODS
  The study was conducted in two stages: first, a systematic review of the literature was conducted to identify a comprehensive list of measures; second, a consensus-building technique, the Delphi process, was used with participants from six groups of stakeholders: schizophrenia experts, mental health clinicians, mental health administrators, the payer (the Alberta Ministry of Health and Wellness), patients, and family members. Thirty stakeholders participated in three rounds of self-completed questionnaires. The degree of consensus achieved in the Delphi process was defined as the semi-interquartile range for each measure.
  
  
  RESULTS
  Ninety-seven measures were identified in the literature review. The Delphi method reduced the list to 36 measures rated as essential. The measures address eight domains of service-level evaluation: acceptability, accessibility, appropriateness, competence, continuity, effectiveness, efficiency, and safety. Despite the diversity in backgrounds of the stakeholder groups, the Delphi technique was effective in moving participants' ratings toward consensus through successive questionnaire rounds. The resulting measures reflected the interests of all stakeholders.
  
  
  CONCLUSIONS
  Several further steps are required before these measures are implemented and include working toward reliability and validity of specific measures, assessing the feasibility and cost-effectiveness of collecting the data, and finally, undertaking risk adjustment for outcome measures.
authors.affiliation: Department of Psychiatry, University of Calgary, Second Floor, Special Services Building, Foothills Medical Centre, 1403 29th St. N.W., Calgary, Alberta T2N 2T9, Canada. addingto@ucalgary.ca
authors.forename: Donald Emile
authors.initials: DE
authors.lastname: Addington
authors.forename: Emily
authors.initials: E
authors.lastname: Mckenzie
authors.forename: JianLi
authors.initials: J
authors.lastname: Wang
authors.forename: Harvey P
authors.initials: HP
authors.lastname: Smith
authors.forename: Beverly
authors.initials: B
authors.lastname: Adams
authors.forename: Zahinoor
authors.initials: Z
authors.lastname: Ismail
mesh_terms: D000416:Alberta; D003697:Delphi Technique; D006801:Humans; D017063:Outcome Assessment, Health Care / Q000379:methods*; D011785:Quality Assurance, Health Care / Q000379:methods*; D019984:Quality Indicators, Health Care / Q000592:standards*; D012559:Schizophrenia / Q000628:therapy*; D011795:Surveys and Questionnaires