title: Enhancing text categorization with semantic-enriched representation and training data augmentation.
abstract: OBJECTIVE
  Acquiring and representing biomedical knowledge is an increasingly important component of contemporary bioinformatics. A critical step of the process is to identify and retrieve relevant documents among the vast volume of modern biomedical literature efficiently. In the real world, many information retrieval tasks are difficult because of high data dimensionality and the lack of annotated examples to train a retrieval algorithm. Under such a scenario, the performance of information retrieval algorithms is often unsatisfactory, therefore improvements are needed.
  
  
  METHODS
  We studied two approaches that enhance the text categorization performance on sparse and high data dimensionality: (1) semantic-preserving dimension reduction by representing text with semantic-enriched features; and (2) augmenting training data with semi-supervised learning. A probabilistic topic model was applied to extract major semantic topics from a corpus of text of interest. The representation of documents was projected from the high-dimensional vocabulary space onto a semantic topic space with reduced dimensionality. A semi-supervised learning algorithm based on graph theory was applied to identify potential positive training cases, which were further used to augment training data. The effects of data transformation and augmentation on text categorization by support vector machine (SVM) were evaluated.
  
  
  CONCLUSIONS
  Semantic-enriched data transformation and the pseudo-positive-cases augmented training data enhance the efficiency and performance of text categorization by SVM.
authors.affiliation: Department of Biostatistics, Bioinformatics and Epidemiology, Charleston, SC 29425, USA. lux@musc.edu
authors.forename: Xinghua
authors.initials: X
authors.lastname: Lu
authors.forename: Bin
authors.initials: B
authors.lastname: Zheng
authors.forename: Atulya
authors.initials: A
authors.lastname: Velivelli
authors.forename: Chengxiang
authors.initials: C
authors.lastname: Zhai
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D002965:Classification; D016247:Information Storage and Retrieval / Q000379:methods*; D009323:Natural Language Processing; D012372:ROC Curve; D012660:Semantics; D018875:Vocabulary, Controlled