title: Metrics for assessing the quality of value sets in clinical quality measures.
abstract: OBJECTIVE
  To assess the quality of value sets in clinical quality measures, both individually and as a population of value sets.
  
  
  METHODS
  The concepts from a given value set are expected to be rooted by one or few ancestor concepts and the value set is expected to contain all the descendants of its root concepts and only these descendants. (1) We assessed the completeness and correctness of individual value sets by comparison to the extension derived from their roots. (2) We assessed the non-redundancy of value sets for the entire population of value sets (within a given code system) using the Jaccard similarity measure.
  
  
  RESULTS
  We demonstrated the utility of our approach on some cases of inconsistent value sets and produced a list of 58 potentially duplicate value sets from the current set of clinical quality measures for the 2014 Meaningful Use criteria.
  
  
  CONCLUSIONS
  These metrics are easy to compute and provide compact indicators of the completeness, correctness, and non-redundancy of value sets.
authors.affiliation: National Library of Medicine, National Institutes of Health, Bethesda, Maryland, USA.
authors.forename: Rainer
authors.initials: R
authors.lastname: Winnenburg
authors.affiliation: National Library of Medicine, National Institutes of Health, Bethesda, Maryland, USA.
authors.forename: Olivier
authors.initials: O
authors.lastname: Bodenreider
mesh_terms: D057286:Electronic Health Records; D038801:International Classification of Diseases; D009317:National Library of Medicine (U.S.); D019984:Quality Indicators, Health Care; D039061:Systematized Nomenclature of Medicine; D017432:Unified Medical Language System / Q000592:standards; D014481:United States; D018875:Vocabulary, Controlled