On Robust Truth Discovery in Sparse Social Media Sensing

Daniel Yue Zhang, Rungang Han, Dong Wang, Chao Huang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In the big data era, it's important to identify trustworthy information from an influx of noisy data contributed by unvetted sources from online social media (e.g., Twitter, Instagram, Flickr). This task is referred to as truth discovery which aims at identifying the reliability of the sources and the truthfulness of claims they make without knowing either of them a priori. There are two important challenges that have not been well addressed in current truth discovery solutions. The first one is 'misinformation spread' where a majority of sources are contributing to false claims, making the identification of truthful claims difficult. The second challenge is 'data sparsity' where sources contribute a small number of claims, providing insufficient evidence to accomplish the truth discovery task. In this paper, we developed a Robust Truth Discovery (RTD) scheme to address the above two challenges. In particular, the RTD scheme explicitly quantifies different degrees of attitude that a source may express on a claim and incorporates the historical contributions of a source using a principled approach. The evaluation results on two real world datasetsshow that the RTD scheme significantly outperforms the state-of-the-art truth discovery methods.

Original languageEnglish (US)
Title of host publicationProceedings - 2016 IEEE International Conference on Big Data, Big Data 2016
EditorsRonay Ak, George Karypis, Yinglong Xia, Xiaohua Tony Hu, Philip S. Yu, James Joshi, Lyle Ungar, Ling Liu, Aki-Hiro Sato, Toyotaro Suzumura, Sudarsan Rachuri, Rama Govindaraju, Weijia Xu
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1076-1081
Number of pages6
ISBN (Electronic)9781467390040
DOIs
StatePublished - 2016
Externally publishedYes
Event4th IEEE International Conference on Big Data, Big Data 2016 - Washington, United States
Duration: Dec 5 2016Dec 8 2016

Publication series

NameProceedings - 2016 IEEE International Conference on Big Data, Big Data 2016

Other

Other4th IEEE International Conference on Big Data, Big Data 2016
Country/TerritoryUnited States
CityWashington
Period12/5/1612/8/16

Keywords

  • Big Data
  • Rumor Robust
  • Sparse Social Sensing
  • Truth Discovery
  • Twitter

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems
  • Hardware and Architecture

Fingerprint

Dive into the research topics of 'On Robust Truth Discovery in Sparse Social Media Sensing'. Together they form a unique fingerprint.

Cite this