title: Feature engineering combined with machine learning and rule-based methods for structured information extraction from narrative clinical discharge summaries.
abstract: OBJECTIVE
  A system that translates narrative text in the medical domain into structured representation is in great demand. The system performs three sub-tasks: concept extraction, assertion classification, and relation identification.
  
  
  METHODS
  The overall system consists of five steps: (1) pre-processing sentences, (2) marking noun phrases (NPs) and adjective phrases (APs), (3) extracting concepts that use a dosage-unit dictionary to dynamically switch two models based on Conditional Random Fields (CRF), (4) classifying assertions based on voting of five classifiers, and (5) identifying relations using normalized sentences with a set of effective discriminating features.
  
  
  METHODS
  Macro-averaged and micro-averaged precision, recall and F-measure were used to evaluate results.
  
  
  RESULTS
  The performance is competitive with the state-of-the-art systems with micro-averaged F-measure of 0.8489 for concept extraction, 0.9392 for assertion classification and 0.7326 for relation identification.
  
  
  CONCLUSIONS
  The system exploits an array of common features and achieves state-of-the-art performance. Prudent feature engineering sets the foundation of our systems. In concept extraction, we demonstrated that switching models, one of which is especially designed for telegraphic sentences, improved extraction of the treatment concept significantly. In assertion classification, a set of features derived from a rule-based classifier were proven to be effective for the classes such as conditional and possible. These classes would suffer from data scarcity in conventional machine-learning methods. In relation identification, we use two-staged architecture, the second of which applies pairwise classifiers to possible candidate classes. This architecture significantly improves performance.
authors.affiliation: State Key Laboratory of Software Development Environment, Beihang University, Beijing, China.
authors.forename: Yan
authors.initials: Y
authors.lastname: Xu
authors.forename: Kai
authors.initials: K
authors.lastname: Hong
authors.forename: Junichi
authors.initials: J
authors.lastname: Tsujii
authors.forename: Eric I-Chao
authors.initials: EI
authors.lastname: Chang
mesh_terms: D001185:Artificial Intelligence; D057225:Data Mining / Q000379:methods*; D057286:Electronic Health Records; D006801:Humans; D009323:Natural Language Processing; D010351:Patient Discharge; D018875:Vocabulary, Controlled