Large Language Model-Guided Disentangled Belief Representation Learning on Polarized Social Graphs

Jinning Li, Ruipeng Han, Chenkai Sun, Dachun Sun, Ruijie Wang, Jingying Zeng, Yuchen Yan, Hanghang Tong, Tarek Abdelzaher

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The paper advances belief representation learning in polarized networks - the mapping of social beliefs espoused by users and posts in a polarized network into a disentangled latent space that separates (the members and beliefs of) each side. Our prior work embeds social interaction data, using non-negative variational graph auto-encoders, into a disentangled latent space. However, the interaction graphs alone may not adequately reflect similarity and/or disparity in beliefs, especially for those graphs with sparsity and outlier issues. In this paper, we investigate the impact of limited guidance from Large Language Models (LLMs) on the accuracy of belief separation. Specifically, we integrate social graphs with LLM-based soft labels as a novel weakly-supervised interpretable graph representation learning framework. This framework combines the strengths of graph-and text-based information, and is shown to maintain the interpretability of learned representations, where different axes in the latent space denote association with different sides of the divide. An evaluation on six real-world Twitter datasets illustrates the effectiveness of the proposed model at solving stance detection problems, demonstrating 5.9%-6.5% improvements in the accuracy, F1 score, and purity metrics, without introducing a significant computational overhead. An ablation study is also discussed to study the impact of different components of the proposed architecture.

Original languageEnglish (US)
Title of host publicationICCCN 2024 - 2024 33rd International Conference on Computer Communications and Networks
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350384611
DOIs
StatePublished - 2024
Event33rd International Conference on Computer Communications and Networks, ICCCN 2024 - Big Island, United States
Duration: Jul 29 2024Jul 31 2024

Publication series

NameProceedings - International Conference on Computer Communications and Networks, ICCCN
ISSN (Print)1095-2055

Conference

Conference33rd International Conference on Computer Communications and Networks, ICCCN 2024
Country/TerritoryUnited States
CityBig Island
Period7/29/247/31/24

Keywords

  • Graph Auto-Encoders
  • Interpretability
  • Large Language Models
  • Social Networks
  • Weak Supervision

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Software

Fingerprint

Dive into the research topics of 'Large Language Model-Guided Disentangled Belief Representation Learning on Polarized Social Graphs'. Together they form a unique fingerprint.

Cite this