Yield of CT Pulmonary Angiography in the Emergency Department When Providers Override Evidence-based Clinical Decision Support.
Purpose To determine the frequency of, and yield after, provider overrides of evidence-based clinical decision support (CDS) for ordering computed tomographic (CT) pulmonary angiography in the emergency department (ED). Materials and Methods This HIPAA-compliant, institutional review board-approved study was performed at a tertiary care, academic medical center ED with approximately 60 000 annual visits and included all patients who were suspected of having pulmonary embolism (PE) and who underwent CT pulmonary angiography between January 1, 2011, and August 31, 2013. The requirement to obtain informed consent was waived. Each CT order for pulmonary angiography was exposed to CDS on the basis of the Wells criteria. For patients with a Wells score of 4 or less, CDS alerts suggested d-dimer testing because acute PE is highly unlikely in these patients if d-dimer levels are normal. The yield of CT pulmonary angiography (number of positive PE diagnoses/total number of CT pulmonary angiographic examinations) was compared in patients in whom providers overrode CDS alerts (by performing CT pulmonary angiography in patients with a Wells score ≤4 and a normal d-dimer level or no d-dimer testing) (override group) and those in whom providers followed Wells criteria (CT pulmonary angiography only in patients with Wells score >4 or ≤4 with elevated d-dimer level) (adherent group). A validated natural language processing tool identified positive PE diagnoses, with subsegmental and/or indeterminate diagnoses removed by means of chart review. Statistical analysis was performed with the χ2test, the Student t test, and logistic regression. Results Among 2993 CT pulmonary angiography studies in 2655 patients, 563 examinations had a Wells score of 4 or less but did not undergo d-dimer testing and 26 had a Wells score of 4 or less and had normal d-dimer levels. The yield of CT pulmonary angiography was 4.2% in the override group (25 of 589 studies, none with a normal d-dimer level) and 11.2% in the adherent group (270 of 2404 studies) (P < .001). After adjustment for the risk factor differences between the two groups, the odds of an acute PE finding were 51.3% lower when providers overrode alerts than when they followed CDS guidelines. Comparison of the two groups including only patients unlikely to have PE led to similar results. Conclusion The odds of an acute PE finding in the ED when providers adhered to evidence presented in CDS were nearly double those seen when providers overrode CDS alerts. Most overrides were due to the lack of d-dimer testing in patients unlikely to have PE.©RSNA, 2016.
From the Center for Evidence-Based Imaging (Z.Y., I.K.I., A.S.R., A.G., R.K.), Department of Radiology (A.S.R., A.G., R.K.), Department of Medicine (I.K.I.), and Department of Emergency Medicine (A.G., J.M.K.), Brigham and Women's Hospital, Harvard Medical School, 20 Kent St, 2nd Floor, Boston, MA 02120; and Department of Emergency Medicine, Massachusetts General Hospital, Boston, Mass (A.S.R.).
Zihao
Z
Yan
From the Center for Evidence-Based Imaging (Z.Y., I.K.I., A.S.R., A.G., R.K.), Department of Radiology (A.S.R., A.G., R.K.), Department of Medicine (I.K.I.), and Department of Emergency Medicine (A.G., J.M.K.), Brigham and Women's Hospital, Harvard Medical School, 20 Kent St, 2nd Floor, Boston, MA 02120; and Department of Emergency Medicine, Massachusetts General Hospital, Boston, Mass (A.S.R.).
Ivan K
IK
Ip
From the Center for Evidence-Based Imaging (Z.Y., I.K.I., A.S.R., A.G., R.K.), Department of Radiology (A.S.R., A.G., R.K.), Department of Medicine (I.K.I.), and Department of Emergency Medicine (A.G., J.M.K.), Brigham and Women's Hospital, Harvard Medical School, 20 Kent St, 2nd Floor, Boston, MA 02120; and Department of Emergency Medicine, Massachusetts General Hospital, Boston, Mass (A.S.R.).
Ali S
AS
Raja
From the Center for Evidence-Based Imaging (Z.Y., I.K.I., A.S.R., A.G., R.K.), Department of Radiology (A.S.R., A.G., R.K.), Department of Medicine (I.K.I.), and Department of Emergency Medicine (A.G., J.M.K.), Brigham and Women's Hospital, Harvard Medical School, 20 Kent St, 2nd Floor, Boston, MA 02120; and Department of Emergency Medicine, Massachusetts General Hospital, Boston, Mass (A.S.R.).
Anurag
A
Gupta
From the Center for Evidence-Based Imaging (Z.Y., I.K.I., A.S.R., A.G., R.K.), Department of Radiology (A.S.R., A.G., R.K.), Department of Medicine (I.K.I.), and Department of Emergency Medicine (A.G., J.M.K.), Brigham and Women's Hospital, Harvard Medical School, 20 Kent St, 2nd Floor, Boston, MA 02120; and Department of Emergency Medicine, Massachusetts General Hospital, Boston, Mass (A.S.R.).
Joshua M
JM
Kosowsky
From the Center for Evidence-Based Imaging (Z.Y., I.K.I., A.S.R., A.G., R.K.), Department of Radiology (A.S.R., A.G., R.K.), Department of Medicine (I.K.I.), and Department of Emergency Medicine (A.G., J.M.K.), Brigham and Women's Hospital, Harvard Medical School, 20 Kent St, 2nd Floor, Boston, MA 02120; and Department of Emergency Medicine, Massachusetts General Hospital, Boston, Mass (A.S.R.).
Ramin
R
Khorasani
D000072226:Computed Tomography Angiography; D020000:Decision Support Systems, Clinical; D004636:Emergency Service, Hospital; D019317:Evidence-Based Medicine; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D011651:Pulmonary Artery / Q000000981:diagnostic imaging*; D011655:Pulmonary Embolism / Q000000981:diagnostic imaging*
Am J Med. 2013 Aug;126(8):687-92
23786668
J Am Board Fam Med. 2012 Jan-Feb;25(1):33-41
22218622
Emerg Radiol. 2014 Apr;21(2):133-41
24185370
J Am Coll Radiol. 2006 Oct;3(10):799-806
17412171
AJR Am J Roentgenol. 2015 Nov;205(5):936-40
26204114
J Am Coll Radiol. 2011 Jan;8(1):19-25
21211760
Expert Opin Drug Metab Toxicol. 2009 Apr;5(4):403-16
19368492
Radiology. 2012 Feb;262(2):468-74
22187633
Int J Med Inform. 2013 Jun;82(6):492-503
23490305
Radiology. 2015 Jul;276(1):167-74
25686367
Acad Emerg Med. 2010 Jun;17(6):589-97
20624138
Acad Emerg Med. 2012 Nov;19(11):1219-26
23167851
J Am Coll Radiol. 2011 Apr;8(4):251-8
21458763
Radiology. 2007 Nov;245(2):315-29
17848685
Thromb Haemost. 2000 Mar;83(3):416-20
10744147
Conn Med. 2010 Jan;74(1):5-9
20175366
Arch Intern Med. 2012 Jul 9;172(13):1028-32
22664742
J Comput Assist Tomogr. 2008 May-Jun;32(3):421-5
18520550
Ann Intern Med. 2015 Nov 3;163(9):701-11
26414967
Emerg Radiol. 2006 Oct;13(1):25-30
16900352
Acad Radiol. 2014 Mar;21(3):378-83
24507424
AJR Am J Roentgenol. 2009 May;192(5):1319-23
19380556
Ann Emerg Med. 2011 Jun;57(6):628-652.e75
21621092
N Engl J Med. 2006 Jun 29;354(26):2822-8
16807422
J Emerg Med. 2012 Aug;43(2):211-20
21764536
Am J Emerg Med. 2014 Dec;32(12 ):1499-502
25303849
Am J Med Qual. 2015 Nov-Dec;30(6):571-7
25037560
BMJ. 2013 Jul 02;347:f3368
23820021
Eur Radiol. 2009 Jan;19(1):9-11; discussion 12
18766347
JAMA. 2014 Mar 19;311(11):1117-24
24643601
Am J Med. 2014 Jun;127(6):512-8.e1
24513065
N Engl J Med. 2010 Aug 5;363(6):501-4
20647183
JAMA Intern Med. 2013 Jun 10;173(11):1024-6
23609029
Med Care Res Rev. 2013 Oct;70(5):473-96
23804290
AJR Am J Roentgenol. 2014 Nov;203(5):W482-90
25341162