Analyzing public sentiments online: combining human- and computer-based content analysis

Leona Yi Fan Su, Michael A. Cacciatore, Xuan Liang, Dominique Brossard, Dietram A. Scheufele, Michael A. Xenos

Research output: Contribution to journalArticlepeer-review

Abstract

Recent technological developments have created novel opportunities for analyzing and identifying patterns in large volumes of digital content. However, many content analysis tools require researchers to choose between the validity of human-based coding and the ability to analyze large volumes of content through computer-based techniques. This study argues for the use of supervised content analysis tools that capitalize on the strengths of human- and computer-based coding for assessing opinion expression. We begin by outlining the key methodological issues surrounding content analysis as performed by human coders and existing computational algorithms. After reviewing the most popular analytic approaches, we introduce an alternative, hybrid method that is aimed at improving reliability, validity, and efficiency when analyzing social media content. To demonstrate the usefulness of this method, we track nuclear energy- and nanotechnology-related opinion expression on Twitter surrounding the Fukushima Daiichi accident to examine the extent to which the volume and tone of tweets shift in directions consistent with the expected external influence of the event. Our analysis revealed substantial shifts in both the volume and tone of nuclear power-related tweets that were consistent with our expectations following the disaster event. Conversely, there was decidedly more stability in the volume and tone of tweets for our comparison issue. These analyses provide an empirical demonstration of how the presented hybrid method can analyze defined communication sentiment and topics from large-scale social media data sets. The implications for communication scholars are discussed.

Original languageEnglish (US)
Pages (from-to)406-427
Number of pages22
JournalInformation Communication and Society
Volume20
Issue number3
DOIs
StatePublished - Mar 4 2017
Externally publishedYes

Keywords

  • Content analysis
  • Twitter
  • computer-based coding
  • human-based coding
  • sentiment analysis
  • supervised machine learning

ASJC Scopus subject areas

  • Communication
  • Library and Information Sciences

Fingerprint Dive into the research topics of 'Analyzing public sentiments online: combining human- and computer-based content analysis'. Together they form a unique fingerprint.

Cite this