title: Discovering peripheral arterial disease cases from radiology notes using natural language processing.
abstract: As part of the Electronic Medical Records and Genomics Network, we applied, extended and evaluated an open source clinical Natural Language Processing system, Mayo's Clinical Text Analysis and Knowledge Extraction System, for the discovery of peripheral arterial disease cases from radiology reports. The manually created gold standard consisted of 223 positive, 19 negative, 63 probable and 150 unknown cases. Overall accuracy agreement between the system and the gold standard was 0.93 as compared to a named entity recognition baseline of 0.46. Sensitivity for the positive, probable and unknown cases was 0.93-0.96, and for the negative cases was 0.72. Specificity and negative predictive value for all categories were in the 90's. The positive predictive value for the positive and unknown categories was in the high 90's, for the negative category was 0.84, and for the probable category was 0.63. We outline the main sources of errors and suggest improvements.
authors.affiliation: Division of Biomedical Statistics and Informatics.
authors.forename: Guergana K
authors.initials: GK
authors.lastname: Savova
authors.forename: Jin
authors.initials: J
authors.lastname: Fan
authors.forename: Zi
authors.initials: Z
authors.lastname: Ye
authors.forename: Sean P
authors.initials: SP
authors.lastname: Murphy
authors.forename: Jiaping
authors.initials: J
authors.lastname: Zheng
authors.forename: Christopher G
authors.initials: CG
authors.lastname: Chute
authors.forename: Iftikhar J
authors.initials: IJ
authors.lastname: Kullo
mesh_terms: D000465:Algorithms; D057286:Electronic Health Records; D006801:Humans; D009323:Natural Language Processing; D058729:Peripheral Arterial Disease; D012680:Sensitivity and Specificity