Learning online discussion structures by conditional random fields

Hongning Wang, Chi Wang, Cheng Xiang Zhai, Jiawei Han

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Online forum discussions are emerging as valuable information repository, where knowledge is accumulated by the interaction among users, leading to multiple threads with structures. Such replying structure in each thread conveys important information about the discussion content. Unfortunately, not all the online forum sites would explicitly record such replying relationship, making it hard for both users and computers to digest the information buried in a discussion thread. In this paper, we propose a probabilistic model in the Conditional Random Fields framework to predict the replying structure for a threaded online discussion. Different from previous replying relation reconstruction methods, most of which fail to consider dependency between the posts, we cast the problem as a supervised structure learning problem to incorporate the features capturing the structural dependency and learn their relationship. Experiment results on three different online forums show that the proposed method can well capture the replying structures in online discussion threads, and multiple tasks such as forum search and question answering can benefit from the reconstructed replying structures.

Original languageEnglish (US)
Title of host publicationSIGIR'11 - Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval
PublisherAssociation for Computing Machinery
Pages435-444
Number of pages10
ISBN (Print)9781450309349
DOIs
StatePublished - Jan 1 2011
Event34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011 - Beijing, China
Duration: Jul 24 2011Jul 28 2011

Publication series

NameSIGIR'11 - Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval

Other

Other34th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011
CountryChina
CityBeijing
Period7/24/117/28/11

Keywords

  • Replying relation reconstruction
  • Structure learning
  • Threaded discussion

ASJC Scopus subject areas

  • Information Systems

Fingerprint Dive into the research topics of 'Learning online discussion structures by conditional random fields'. Together they form a unique fingerprint.

  • Cite this

    Wang, H., Wang, C., Zhai, C. X., & Han, J. (2011). Learning online discussion structures by conditional random fields. In SIGIR'11 - Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 435-444). (SIGIR'11 - Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval). Association for Computing Machinery. https://doi.org/10.1145/2009916.2009976