title: Issues in creating and maintaining value sets for clinical quality measures.
abstract: OBJECTIVE
  To develop methods for assessing the validity, consistency and currency of value sets for clinical quality measures, in order to support the developers of quality measures in which such value sets are used.
  
  
  METHODS
  We assessed the well-formedness of the codes (in a given code system), the existence and currency of the codes in the corresponding code system, using the UMLS and RxNorm terminology services. We also investigated the overlap among value sets using the Jaccard similarity measure.
  
  
  RESULTS
  We extracted 163,788 codes (76,062 unique codes) from 1463 unique value sets in the 113 quality measures published by the National Quality Forum (NQF) in December 2011. Overall, 5% of the codes are invalid (4% of the unique codes). We also found 67 duplicate value sets and 10 pairs of value sets exhibiting a high degree of similarity (Jaccard > .9).
  
  
  CONCLUSIONS
  Invalid codes affect a large proportion of the value sets (19%). 79% of the quality Measures have at least one value set exhibiting errors. However, 50% of the quality measures exhibit errors in less than 10 % of their value sets. The existence of duplicate and highly-similar value sets suggests the need for an authoritative repository of value sets and related tooling in order to support the development of quality measures.
authors.affiliation: National Library of Medicine, National Institutes of Health, Bethesda, Maryland, USA. winnenburgr@mail.nih.gov
authors.forename: Rainer
authors.initials: R
authors.lastname: Winnenburg
authors.forename: Olivier
authors.initials: O
authors.lastname: Bodenreider
mesh_terms: D011785:Quality Assurance, Health Care; D062245:RxNorm; D039061:Systematized Nomenclature of Medicine; D017432:Unified Medical Language System; D018875:Vocabulary, Controlled