Modality-specific effects of perceptual load in multimedia processing

Jacob Taylor Fisher, Frederic René Hopp, René Weber

Research output: Contribution to journalArticlepeer-review

Abstract

Digital media are sensory-rich, multimodal, and often highly interactive. An extensive collection of theories and models within the field of media psychology assume the multimodal nature of media stimuli, yet there is current ambiguity as to the independent contributions of visual and auditory content to message complexity and to resource availability in the human processing system. In this article, we argue that explicating the concepts of perceptual and cognitive load can create progress toward a deeper understanding of modality-specific effects in media processing. In addition, we report findings from an experiment showing that perceptual load leads to modality-specific reductions in resource availability, whereas cognitive load leads to a modality-general reduction in resource availability. We conclude with a brief discussion regarding the critical importance of separating modality-specific forms of load in an increasingly multisensory media environment.

Original languageEnglish (US)
Pages (from-to)149-165
Number of pages17
JournalMedia and Communication
Volume7
Issue number4
DOIs
StatePublished - 2019
Externally publishedYes

Keywords

  • Media psychology
  • Modality
  • Multimedia processing
  • Perceptual load
  • Resource availability

ASJC Scopus subject areas

  • Communication

Fingerprint Dive into the research topics of 'Modality-specific effects of perceptual load in multimedia processing'. Together they form a unique fingerprint.

Cite this