Enhancing Text Categorization with Semantic-enriched Representation and Training Data Augmentation

Xinghua Lu, Bin Zheng, Atulya Velivelli, Cheng Xiang Zhai

Research output: Contribution to journalArticlepeer-review


Objective: Acquiring and representing biomedical knowledge is an increasingly important component of contemporary bioinformatics. A critical step of the process is to identify and retrieve relevant documents among the vast volume of modern biomedical literature efficiently. In the real world, many information retrieval tasks are difficult because of high data dimensionality and the lack of annotated examples to train a retrieval algorithm. Under such a scenario, the performance of information retrieval algorithms is often unsatisfactory, therefore improvements are needed. Design: We studied two approaches that enhance the text categorization performance on sparse and high data dimensionality: (1) semantic-preserving dimension reduction by representing text with semantic-enriched features; and (2) augmenting training data with semi-supervised learning. A probabilistic topic model was applied to extract major semantic topics from a corpus of text of interest. The representation of documents was projected from the high-dimensional vocabulary space onto a semantic topic space with reduced dimensionality. A semi-supervised learning algorithm based on graph theory was applied to identify potential positive training cases, which were further used to augment training data. The effects of data transformation and augmentation on text categorization by support vector machine (SVM) were evaluated. Results and Conclusion: Semantic-enriched data transformation and the pseudo-positive-cases augmented training data enhance the efficiency and performance of text categorization by SVM.

Original languageEnglish (US)
Pages (from-to)526-535
Number of pages10
JournalJournal of the American Medical Informatics Association
Issue number5
StatePublished - Sep 2006

ASJC Scopus subject areas

  • Health Informatics


Dive into the research topics of 'Enhancing Text Categorization with Semantic-enriched Representation and Training Data Augmentation'. Together they form a unique fingerprint.

Cite this