What and Why Towards Duo Explainable Fauxtography Detection under Constrained Supervision

Ziyi Kou, Daniel Zhang, Lanyu Shang, Dong Wang

Research output: Contribution to journalArticlepeer-review

Abstract

Fauxtography is a category of multi-modal posts that spread misleading information on various big data online social platforms that generate billions of posts on a daily basis. A fauxtography post usually consists of an image, a text description and comments from its readers. In this paper, we focus on explaining fauxtography posts by identifying what specific component and why that component of a post leads to the fauxtography. Two critical challenges exist in solving our problem: i) it is difficult to accurately identify the guilty component of a fauxtography post given the fact that different components of the post and their associations could all lead to the fauxtography; ii) it is expensive and time-consuming to obtain a good training set with fine-grained labels of fauxtography posts in terms of explainability, making it challenging to develop fully supervised explainable solutions. To address the above challenges, we develop a Duo Explainable Fauxtography Detection Framework under a Constrained Supervision (DExFC) to generate duo explanations from both content and comment parts of fauxtography posts. The results show that DExFC not only detects the fauxtography posts more accurately than the state-of-the-art solutions but also provides well-justified explanations to its results without the full supervision.

Original languageEnglish (US)
JournalIEEE Transactions on Big Data
DOIs
StateAccepted/In press - 2021

Keywords

  • Annotations
  • Big Data
  • Feature extraction
  • IEEE Student Members
  • Rats
  • Social networking (online)
  • Training

ASJC Scopus subject areas

  • Information Systems
  • Information Systems and Management

Fingerprint

Dive into the research topics of 'What and Why Towards Duo Explainable Fauxtography Detection under Constrained Supervision'. Together they form a unique fingerprint.

Cite this