title: Using the Analytic Hierarchy Process for Prioritizing Imaging Tests in Diagnosis of Suspected Appendicitis.
abstract: In clinical guideline or criteria development processes, such as those used in developing American College of Radiology Appropriateness Criteria (ACR AC), experts subjectively evaluate benefits and risks associated with imaging tests and make complex decisions about imaging recommendations. The analytic hierarchy process (AHP) decomposes complex decisions into structured smaller decisions, incorporates quantitative evidence and qualitative expert opinion, and promotes structured consensus building. AHP may supplement and/or improve the transparency of expert opinion contributions to developing guidelines or criteria.
  
  
  
  To conduct an empirical test using health services research tools, we convened a mock ACR AC panel of emergency department radiology and nonradiology physicians to evaluate by multicriteria decision analysis, the relative appropriateness of imaging tests for diagnosing suspected appendicitis. Panel members selected benefit-risk criteria via an online survey and assessed contrast-enhanced computed tomography, magnetic resonance imaging, and ultrasound using an AHP-based software. Participants were asked whether the process was manageable, transparent, and improved shared understanding. Priority scores were converted to rankings and compared to the rank order of ACR AC ratings.
  
  
  
  When compared to magnetic resonance and ultrasound imaging, participants agreed with the ACR AC that contrast-enhanced computed tomography is the most appropriate test. Contrary to the ACR AC ratings, study results suggest that magnetic resonance is preferable to ultrasound. When compared to nonradiologists, radiologists' priority scores reflect a stronger preference for computed tomography.
  
  
  
  Study participants addressed decision-making challenges using a relatively efficient data collection mechanism, suggesting that AHP may benefit the ACR AC guideline development process in identifying the relative appropriateness of imaging tests. With additional development, AHP may improve transparency when expert opinion is used in clinical guideline or appropriateness criteria development.
authors.affiliation: Pharmaceutical Outcomes Research and Policy Program, Department of Pharmacy, School of Pharmacy, University of Washington, 1959 NE Pacific Street, Seattle, WA 98195.
authors.forename: Maria
authors.initials: M
authors.lastname: Agapova
authors.affiliation: Pharmaceutical Outcomes Research and Policy Program, Department of Pharmacy, School of Pharmacy, University of Washington, 1959 NE Pacific Street, Seattle, WA 98195; Department of Radiology, School of Medicine, University of Washington, 325 Ninth Ave, Seattle, WA 98104; Department of Health Services, University of Washington, 1959 NE Pacific Street, Seattle, WA 98195. Electronic address: bres@u.washington.edu.
authors.forename: Brian W
authors.initials: BW
authors.lastname: Bresnahan
authors.affiliation: Department of Radiology, School of Medicine, University of Washington, 325 Ninth Ave, Seattle, WA 98104.
authors.forename: Ken F
authors.initials: KF
authors.lastname: Linnau
authors.affiliation: Pharmaceutical Outcomes Research and Policy Program, Department of Pharmacy, School of Pharmacy, University of Washington, 1959 NE Pacific Street, Seattle, WA 98195.
authors.forename: Louis P
authors.initials: LP
authors.lastname: Garrison
authors.affiliation: General Electric Healthcare, Waukesha, Wisconsin.
authors.forename: Mitchell
authors.initials: M
authors.lastname: Higashi
authors.affiliation: Department of Health Services, University of Washington, 1959 NE Pacific Street, Seattle, WA 98195.
authors.forename: Larry
authors.initials: L
authors.lastname: Kessler
authors.affiliation: Pharmaceutical Outcomes Research and Policy Program, Department of Pharmacy, School of Pharmacy, University of Washington, 1959 NE Pacific Street, Seattle, WA 98195.
authors.forename: Beth
authors.initials: B
authors.lastname: Devine
mesh_terms: D001064:Appendicitis / Q000175:diagnosis*; D003657:Decision Making; D003952:Diagnostic Imaging / Q000379:methods*; D006801:Humans; D017410:Practice Guidelines as Topic
keywords: Diagnostic imaging; analytic hierarchy process; appendicitis; appropriateness criteria