Evaluation of conflicting literature and application to formulary decisions.
OBJECTIVE
Guidelines were developed for grading the quality, quantity, and consistency of drug literature in support of formulary recommendations.


METHODS
Four developmental steps were taken to create a comprehensive literature evaluation system. The first step identified the attributes of a body of literature that were most reflective of its applicability to patient care. The next step defined each domain (quality, quantity, consistency), as determined by the Agency of Healthcare Research and Quality (AHRQ), in terms of the specific qualities to be assessed; a value was assigned to those qualities. Also, a literature search was conducted to identify strategies for evaluating bodies of literature employed in published assessment tools. Following the analysis of previously published systems, which were evaluated with respect to their inclusion of the AHRQ-identified domains, the next step was the development of specific domains and definitions to get a composite grade (with "better" evidence earning more points) for formulary recommendations. The final step was the creation of a system that aggregated the final score for the recommendation. The recommendation was categorized according to quality, quantity, and consistency of supporting evidence, and the total number of points was calculated and the recommendation given letter and numerical grades.


RESULTS
The guidelines that were developed allow the user to accurately, consistently, and easily determine the strength of recommendations for a body of literature that may be conflicting. The addition of criteria for quantity and consistency to previously-published grading systems has made the guidelines more objective.


CONCLUSIONS
A system that accounts for the quality, quantity, and consistency of drug literature was developed to assist in making formulary decisions.
Corman
Shelby L
SL
Department of Pharmacy and Therapeutics, School of Pharmacy, University of Pittsburgh, Pittsburgh, PA 15213, USA. cormansl@upmc.edu
Skledar
Susan J
SJ
Culley
Colleen M
CM
D003287:Contrast Media / Q000009:adverse effects; D003657:Decision Making; D004341:Drug Evaluation / Q000379:methods*; D004358:Drug Therapy; D005569:Formularies as Topic / Q000592:standards*; D006801:Humans; D010506:Periodicals as Topic; D011785:Quality Assurance, Health Care; D051437:Renal Insufficiency / Q000139:chemically induced; D015203:Reproducibility of Results
D003287:Contrast Media