Capturing signals of enthusiasm and support towards social issues from twitter

Shubhanshu Mishra, Jana Diesner

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Social media enables organizations to learn what users say about their products online, and to engage with their potential audiences. Social media has also been allowing individual users and the public to signal their enthusiasm, support, or lack thereof for a broad range of topics. In this paper, we analyze the robustness of a prior framework for tagging tweets across the dimensions of enthusiasm (labels: enthusiastic, passive) and support (labels: supportive, non-supportive). We investigate the quality of annotations in a collection of tweets about three topics, namely, cyberbullying, LGBT rights, and Chronic Traumatic Encephalopathy (CTE) in the National Football League. We train models that achieve >70% and 80% F1 score for classifying tweets for enthusiasm and support, respectively. We assess how text-based signals of enthusiasm and support vary depending on the different annotators. Finally, we propose and demonstrate a network analysis-based approach for combining the annotated tweets with account and hashtag mention networks. This step helps to identify top accounts and hashtags related to the considered categories (enthusiasm and support). Our work offers an alternative or supplemental classification schema and prediction model to standard sentiment analysis and stance detection.

Original languageEnglish (US)
Title of host publicationSIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors
PublisherAssociation for Computing Machinery, Inc
Pages19-24
Number of pages6
ISBN (Electronic)9781450369039
DOIs
StatePublished - Sep 12 2019
Event5th ACM International Workshop on Social Media World Sensors, SIdEWayS 2019, in conjunction with the 30th ACM Conference on Hypertext and Social Media, HT 2019 - Hof, Germany
Duration: Sep 17 2019 → …

Publication series

NameSIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors

Conference

Conference5th ACM International Workshop on Social Media World Sensors, SIdEWayS 2019, in conjunction with the 30th ACM Conference on Hypertext and Social Media, HT 2019
CountryGermany
CityHof
Period9/17/19 → …

Fingerprint

twitter
social issue
social media
Labels
Electric network analysis
network analysis
lack

Keywords

  • Enthusiasm
  • Networks
  • Social media
  • Support
  • Twitter

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Communication
  • Information Systems
  • Media Technology

Cite this

Mishra, S., & Diesner, J. (2019). Capturing signals of enthusiasm and support towards social issues from twitter. In SIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors (pp. 19-24). (SIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors). Association for Computing Machinery, Inc. https://doi.org/10.1145/3345645.3351104

Capturing signals of enthusiasm and support towards social issues from twitter. / Mishra, Shubhanshu; Diesner, Jana.

SIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors. Association for Computing Machinery, Inc, 2019. p. 19-24 (SIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Mishra, S & Diesner, J 2019, Capturing signals of enthusiasm and support towards social issues from twitter. in SIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors. SIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors, Association for Computing Machinery, Inc, pp. 19-24, 5th ACM International Workshop on Social Media World Sensors, SIdEWayS 2019, in conjunction with the 30th ACM Conference on Hypertext and Social Media, HT 2019, Hof, Germany, 9/17/19. https://doi.org/10.1145/3345645.3351104
Mishra S, Diesner J. Capturing signals of enthusiasm and support towards social issues from twitter. In SIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors. Association for Computing Machinery, Inc. 2019. p. 19-24. (SIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors). https://doi.org/10.1145/3345645.3351104
Mishra, Shubhanshu ; Diesner, Jana. / Capturing signals of enthusiasm and support towards social issues from twitter. SIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors. Association for Computing Machinery, Inc, 2019. pp. 19-24 (SIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors).
@inproceedings{978bb6575e614240b26bf685990b408d,
title = "Capturing signals of enthusiasm and support towards social issues from twitter",
abstract = "Social media enables organizations to learn what users say about their products online, and to engage with their potential audiences. Social media has also been allowing individual users and the public to signal their enthusiasm, support, or lack thereof for a broad range of topics. In this paper, we analyze the robustness of a prior framework for tagging tweets across the dimensions of enthusiasm (labels: enthusiastic, passive) and support (labels: supportive, non-supportive). We investigate the quality of annotations in a collection of tweets about three topics, namely, cyberbullying, LGBT rights, and Chronic Traumatic Encephalopathy (CTE) in the National Football League. We train models that achieve >70{\%} and 80{\%} F1 score for classifying tweets for enthusiasm and support, respectively. We assess how text-based signals of enthusiasm and support vary depending on the different annotators. Finally, we propose and demonstrate a network analysis-based approach for combining the annotated tweets with account and hashtag mention networks. This step helps to identify top accounts and hashtags related to the considered categories (enthusiasm and support). Our work offers an alternative or supplemental classification schema and prediction model to standard sentiment analysis and stance detection.",
keywords = "Enthusiasm, Networks, Social media, Support, Twitter",
author = "Shubhanshu Mishra and Jana Diesner",
year = "2019",
month = "9",
day = "12",
doi = "10.1145/3345645.3351104",
language = "English (US)",
series = "SIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors",
publisher = "Association for Computing Machinery, Inc",
pages = "19--24",
booktitle = "SIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors",

}

TY - GEN

T1 - Capturing signals of enthusiasm and support towards social issues from twitter

AU - Mishra, Shubhanshu

AU - Diesner, Jana

PY - 2019/9/12

Y1 - 2019/9/12

N2 - Social media enables organizations to learn what users say about their products online, and to engage with their potential audiences. Social media has also been allowing individual users and the public to signal their enthusiasm, support, or lack thereof for a broad range of topics. In this paper, we analyze the robustness of a prior framework for tagging tweets across the dimensions of enthusiasm (labels: enthusiastic, passive) and support (labels: supportive, non-supportive). We investigate the quality of annotations in a collection of tweets about three topics, namely, cyberbullying, LGBT rights, and Chronic Traumatic Encephalopathy (CTE) in the National Football League. We train models that achieve >70% and 80% F1 score for classifying tweets for enthusiasm and support, respectively. We assess how text-based signals of enthusiasm and support vary depending on the different annotators. Finally, we propose and demonstrate a network analysis-based approach for combining the annotated tweets with account and hashtag mention networks. This step helps to identify top accounts and hashtags related to the considered categories (enthusiasm and support). Our work offers an alternative or supplemental classification schema and prediction model to standard sentiment analysis and stance detection.

AB - Social media enables organizations to learn what users say about their products online, and to engage with their potential audiences. Social media has also been allowing individual users and the public to signal their enthusiasm, support, or lack thereof for a broad range of topics. In this paper, we analyze the robustness of a prior framework for tagging tweets across the dimensions of enthusiasm (labels: enthusiastic, passive) and support (labels: supportive, non-supportive). We investigate the quality of annotations in a collection of tweets about three topics, namely, cyberbullying, LGBT rights, and Chronic Traumatic Encephalopathy (CTE) in the National Football League. We train models that achieve >70% and 80% F1 score for classifying tweets for enthusiasm and support, respectively. We assess how text-based signals of enthusiasm and support vary depending on the different annotators. Finally, we propose and demonstrate a network analysis-based approach for combining the annotated tweets with account and hashtag mention networks. This step helps to identify top accounts and hashtags related to the considered categories (enthusiasm and support). Our work offers an alternative or supplemental classification schema and prediction model to standard sentiment analysis and stance detection.

KW - Enthusiasm

KW - Networks

KW - Social media

KW - Support

KW - Twitter

UR - http://www.scopus.com/inward/record.url?scp=85073421163&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073421163&partnerID=8YFLogxK

U2 - 10.1145/3345645.3351104

DO - 10.1145/3345645.3351104

M3 - Conference contribution

AN - SCOPUS:85073421163

T3 - SIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors

SP - 19

EP - 24

BT - SIdEWayS 2019 - Proceedings of the 5th International Workshop on Social Media World Sensors

PB - Association for Computing Machinery, Inc

ER -