title: Named entity recognition of follow-up and time information in 20,000 radiology reports.
abstract: OBJECTIVE
  To develop a system to extract follow-up information from radiology reports. The method may be used as a component in a system which automatically generates follow-up information in a timely fashion.
  
  
  METHODS
  A novel method of combining an LSP (labeled sequential pattern) classifier with a CRF (conditional random field) recognizer was devised. The LSP classifier filters out irrelevant sentences, while the CRF recognizer extracts follow-up and time phrases from candidate sentences presented by the LSP classifier.
  
  
  METHODS
  The standard performance metrics of precision (P), recall (R), and F measure (F) in the exact and inexact matching settings were used for evaluation.
  
  
  RESULTS
  Four experiments conducted using 20,000 radiology reports showed that the CRF recognizer achieved high performance without time-consuming feature engineering and that the LSP classifier further improved the performance of the CRF recognizer. The performance of the current system is P=0.90, R=0.86, F=0.88 in the exact matching setting and P=0.98, R=0.93, F=0.95 in the inexact matching setting.
  
  
  CONCLUSIONS
  The experiments demonstrate that the system performs far better than a baseline rule-based system and is worth considering for deployment trials in an alert generation system. The LSP classifier successfully compensated for the inherent weakness of CRF, that is, its inability to use global information.
authors: State Key Laboratory of Software Development Environment, Beihang University, Beijing, China.
authors: Yan
authors: Y
authors: Xu
authors: Junichi
authors: J
authors: Tsujii
authors: Eric I-Chao
authors: EI
authors: Chang
mesh_terms: D001185:Artificial Intelligence; D057225:Data Mining / Q000379:methods*; D057286:Electronic Health Records / Q000145:classification; D005240:Feasibility Studies; D006801:Humans; D009323:Natural Language Processing; D011873:Radiology Information Systems