title: Development of quality indicators for diagnosis and treatment of patients with non-small cell lung cancer: a first step toward implementing a multidisciplinary, evidence-based guideline.
abstract: BACKGROUND
  While developing and distributing clinical practice guidelines are important in optimising clinical healthcare, insight into actual care is necessary to achieve successful implementation. Developing quality indicators may be the first step to becoming aware of actual care. The Dutch national practice guideline Non-small cell lung cancer: staging and treatment is one of the first clinical, multidisciplinary guidelines for oncology in the Netherlands for which quality indicators were developed systematically. We describe indicator development based on this guideline as a practical experience.
  
  
  METHODS
  To develop a set of indicators for diagnosis and treatment of patients with non-small cell lung cancer, we systematically achieved consensus on the basis of a national, multidisciplinary, evidence-based guideline and the opinions of professionals and patients. After the researchers extracted the recommendations from the guideline, we carried out a so-called Rand-modified-Delphi procedure. This consisted of three rounds: a national panel of professionals and representatives of the national patient organization scored all recommendations, the professionals had a consensus meeting, and the final set of indicators was e-mailed for a last check. Subsequently, some clinimetric characteristics of this final set were assessed in a practice test.
  
  
  RESULTS
  Thirty-two of 83 recommendations were selected in the first round. After the consensus meeting, 8 recommendations met the final criteria and were incorporated into 15 indicators, which were tested in practice. The most successful indicators for quality improvement are indicators that are measurable, have potential for improvement, have a broad range between practices and are applicable to a large part of the population.
  
  
  CONCLUSIONS
  For successful implementation of evidence-based guidelines, each new guideline should be developed and tested with a set of indicators based on the guideline. The procedure we describe can serve as an example for other new guidelines.
authors.affiliation: Centre for Quality of Care Research (WOK), Radboud University Nijmegen Medical Centre, 117 KWAZO, P.O. Box 9101, 6500 HB Nijmegen, The Netherlands.
authors.forename: R P M G
authors.initials: RP
authors.lastname: Hermens
authors.forename: M M T J
authors.initials: MM
authors.lastname: Ouwens
authors.forename: S Y
authors.initials: SY
authors.lastname: Vonk-Okhuijsen
authors.forename: Y
authors.initials: Y
authors.lastname: van der Wel
authors.forename: V C G
authors.initials: VC
authors.lastname: Tjan-Heijnen
authors.forename: L D
authors.initials: LD
authors.lastname: van den Broek
authors.forename: V K Y
authors.initials: VK
authors.lastname: Ho
authors.forename: M L G
authors.initials: ML
authors.lastname: Janssen-Heijnen
authors.forename: H J M
authors.initials: HJ
authors.lastname: Groen
authors.forename: R P T M
authors.initials: RP
authors.lastname: Grol
authors.forename: H C H
authors.initials: HC
authors.lastname: Wollersheim
mesh_terms: D002289:Carcinoma, Non-Small-Cell Lung / Q000175:diagnosis* / Q000628:therapy*; D019317:Evidence-Based Medicine; D006801:Humans; D008175:Lung Neoplasms / Q000175:diagnosis* / Q000628:therapy*; D009367:Neoplasm Staging; D009426:Netherlands; D017410:Practice Guidelines as Topic; D019984:Quality Indicators, Health Care