Hierarchical Metadata-Aware Document Categorization under Weak Supervision

Yu Zhang, Xiusi Chen, Yu Meng, Jiawei Han

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Categorizing documents into a given label hierarchy is intuitively appealing due to the ubiquity of hierarchical topic structures in massive text corpora. Although related studies have achieved satisfying performance in fully supervised hierarchical document classification, they usually require massive human-annotated training data and only utilize text information. However, in many domains, (1) annotations are quite expensive where very few training samples can be acquired; (2) documents are accompanied by metadata information. Hence, this paper studies how to integrate the label hierarchy, metadata, and text signals for document categorization under weak supervision. We develop HiMeCat, an embedding-based generative framework for our task. Specifically, we propose a novel joint representation learning module that allows simultaneous modeling of category dependencies, metadata information and textual semantics, and we introduce a data augmentation module that hierarchically synthesizes training documents to complement the original, small-scale training set. Our experiments demonstrate a consistent improvement of HiMeCat over competitive baselines and validate the contribution of our representation learning and data augmentation modules.

Original languageEnglish (US)
Title of host publicationWSDM 2021 - Proceedings of the 14th ACM International Conference on Web Search and Data Mining
PublisherAssociation for Computing Machinery, Inc
Pages770-778
Number of pages9
ISBN (Electronic)9781450382977
DOIs
StatePublished - Aug 3 2021
Event14th ACM International Conference on Web Search and Data Mining, WSDM 2021 - Virtual, Online, Israel
Duration: Mar 8 2021Mar 12 2021

Publication series

NameWSDM 2021 - Proceedings of the 14th ACM International Conference on Web Search and Data Mining

Conference

Conference14th ACM International Conference on Web Search and Data Mining, WSDM 2021
CountryIsrael
CityVirtual, Online
Period3/8/213/12/21

Keywords

  • hierarchical text categorization
  • metadata-aware text categorization
  • weak supervision

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Software

Fingerprint Dive into the research topics of 'Hierarchical Metadata-Aware Document Categorization under Weak Supervision'. Together they form a unique fingerprint.

Cite this