Deciding not to measure performance: the case of acute otitis media.
BACKGROUND
No Health Plan Employer Data and Information Set (HEDIS) performance measures evaluate health plans for possible overuse or inappropriate use of antibiotics. Acute otitis media (AOM), or infection of the middle ear, is one of the most common infections in children. The antibiotic resistance of the bacteria that cause AOM and the general overuse and inappropriate use of antibiotics for this condition are taking center stage as a major public health threat. An effort was undertaken to develop a new HEDIS performance measure that evaluates appropriate antibiotic use in children with AOM.
The measure development process has three major phases: the initial development phase, the field-testing and analysis phase, and the measure refinement phase. With AOM, the measure development process could not proceed beyond the first phase for reasons that are be discussed in detail.


CONCLUSIONS
Additional difficulties beyond feasibility issues may arise in developing a quality of care performance measure. The measure development process discussed in this article failed primarily because of issues related to relevance as well as the scientific soundness of the proposed measures. If the evidence base related to the diagnosis and management of a particular condition is sparse, no standard can be developed against which to measure performance, and the criterion of scientific soundness cannot be met. This is the case with AOM. Unfortunately, the evidence base will likely remain inadequate to support the development of such a measure in the future.
Mangione-Smith
Rita
R
University of California, Los Angeles, Department of Pediatrics, USA. ritams@ucla.edu
Onstad
Karen
K
Wong
Lok
L
Roski
Joachim
J
D000208:Acute Disease; D000900:Anti-Bacterial Agents / Q000494:pharmacology / Q000627:therapeutic use*; D002648:Child; D032921:Consensus; D004351:Drug Resistance; D017723:Drug Utilization Review / Q000592:standards*; D019317:Evidence-Based Medicine; D005240:Feasibility Studies; D006264:Health Benefit Plans, Employee / Q000592:standards; D006300:Health Services Misuse; D006801:Humans; D010033:Otitis Media / Q000175:diagnosis / Q000188:drug therapy* / Q000382:microbiology; D017410:Practice Guidelines as Topic; D019984:Quality Indicators, Health Care / Q000145:classification / Q000592:standards*; D014481:United States
D000900:Anti-Bacterial Agents