Is imagining a voice like listening to it? Evidence from ERPs

Peiyun Zhou, Susan Garnsey, Kiel Christianson

Research output: Contribution to journalArticle

Abstract

Readers who have seen the Harry Potter movies before reading the novels may “hear” actors’ voices in their heads when they later read the books. This phenomenon of mentally simulating the voice of speakers depicted in texts has been referred to as auditory perceptual simulation (APS). How much is this mental simulation of voices like listening to actual voices? Two event-related potential (ERP) experiments examined the auditory perceptual simulation of native and non-native English speech while participants silently read English sentences containing subject-verb agreement errors or pronoun-case errors. The aim was to compare readers’ ERPs when imagining native and non-native speech to the results of Hanulíková van Alphen, van Goch, and Weber (2012), who recorded ERPs while participants listened to native and non-native speech and found that native-speaking listeners “forgive” errors (signaled by reduced P600 effects) by non-native speakers. Our participants listened to samples of a native and a non-native English speaker's speech and were then asked to imagine the voice of either one or the other speaker while reading sentences. Results revealed differences in N400 and P600 waveforms when imagining the non-native speaker's voice compared to the native speaker's voice. Importantly, when imagining the non-native speaker committing subject-verb agreement errors, P600 amplitudes were no different from error-free items.

LanguageEnglish (US)
Pages227-241
Number of pages15
JournalCognition
Volume182
DOIs
StatePublished - Jan 1 2019

Fingerprint

evidence
simulation
Reading
movies
listener
speaking
Motion Pictures
Imagining
Population Groups
Evoked Potentials
event
experiment
Head
Non-native Speakers
Reader
Subject-verb Agreement
Simulation
Hearing

Keywords

  • Auditory perceptual simulation
  • Event-related potentials
  • Grammaticality
  • P600
  • Sentence processing
  • Subject-verb disagreement

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Language and Linguistics
  • Developmental and Educational Psychology
  • Linguistics and Language
  • Cognitive Neuroscience

Cite this

Is imagining a voice like listening to it? Evidence from ERPs. / Zhou, Peiyun; Garnsey, Susan; Christianson, Kiel.

In: Cognition, Vol. 182, 01.01.2019, p. 227-241.

Research output: Contribution to journalArticle

Zhou, Peiyun ; Garnsey, Susan ; Christianson, Kiel. / Is imagining a voice like listening to it? Evidence from ERPs. In: Cognition. 2019 ; Vol. 182. pp. 227-241.
@article{1a30d01618cb4197a49e6564af6e4f59,
title = "Is imagining a voice like listening to it? Evidence from ERPs",
abstract = "Readers who have seen the Harry Potter movies before reading the novels may “hear” actors’ voices in their heads when they later read the books. This phenomenon of mentally simulating the voice of speakers depicted in texts has been referred to as auditory perceptual simulation (APS). How much is this mental simulation of voices like listening to actual voices? Two event-related potential (ERP) experiments examined the auditory perceptual simulation of native and non-native English speech while participants silently read English sentences containing subject-verb agreement errors or pronoun-case errors. The aim was to compare readers’ ERPs when imagining native and non-native speech to the results of Hanul{\'i}kov{\'a} van Alphen, van Goch, and Weber (2012), who recorded ERPs while participants listened to native and non-native speech and found that native-speaking listeners “forgive” errors (signaled by reduced P600 effects) by non-native speakers. Our participants listened to samples of a native and a non-native English speaker's speech and were then asked to imagine the voice of either one or the other speaker while reading sentences. Results revealed differences in N400 and P600 waveforms when imagining the non-native speaker's voice compared to the native speaker's voice. Importantly, when imagining the non-native speaker committing subject-verb agreement errors, P600 amplitudes were no different from error-free items.",
keywords = "Auditory perceptual simulation, Event-related potentials, Grammaticality, P600, Sentence processing, Subject-verb disagreement",
author = "Peiyun Zhou and Susan Garnsey and Kiel Christianson",
year = "2019",
month = "1",
day = "1",
doi = "10.1016/j.cognition.2018.10.014",
language = "English (US)",
volume = "182",
pages = "227--241",
journal = "Cognition",
issn = "0010-0277",
publisher = "Elsevier",

}

TY - JOUR

T1 - Is imagining a voice like listening to it? Evidence from ERPs

AU - Zhou, Peiyun

AU - Garnsey, Susan

AU - Christianson, Kiel

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Readers who have seen the Harry Potter movies before reading the novels may “hear” actors’ voices in their heads when they later read the books. This phenomenon of mentally simulating the voice of speakers depicted in texts has been referred to as auditory perceptual simulation (APS). How much is this mental simulation of voices like listening to actual voices? Two event-related potential (ERP) experiments examined the auditory perceptual simulation of native and non-native English speech while participants silently read English sentences containing subject-verb agreement errors or pronoun-case errors. The aim was to compare readers’ ERPs when imagining native and non-native speech to the results of Hanulíková van Alphen, van Goch, and Weber (2012), who recorded ERPs while participants listened to native and non-native speech and found that native-speaking listeners “forgive” errors (signaled by reduced P600 effects) by non-native speakers. Our participants listened to samples of a native and a non-native English speaker's speech and were then asked to imagine the voice of either one or the other speaker while reading sentences. Results revealed differences in N400 and P600 waveforms when imagining the non-native speaker's voice compared to the native speaker's voice. Importantly, when imagining the non-native speaker committing subject-verb agreement errors, P600 amplitudes were no different from error-free items.

AB - Readers who have seen the Harry Potter movies before reading the novels may “hear” actors’ voices in their heads when they later read the books. This phenomenon of mentally simulating the voice of speakers depicted in texts has been referred to as auditory perceptual simulation (APS). How much is this mental simulation of voices like listening to actual voices? Two event-related potential (ERP) experiments examined the auditory perceptual simulation of native and non-native English speech while participants silently read English sentences containing subject-verb agreement errors or pronoun-case errors. The aim was to compare readers’ ERPs when imagining native and non-native speech to the results of Hanulíková van Alphen, van Goch, and Weber (2012), who recorded ERPs while participants listened to native and non-native speech and found that native-speaking listeners “forgive” errors (signaled by reduced P600 effects) by non-native speakers. Our participants listened to samples of a native and a non-native English speaker's speech and were then asked to imagine the voice of either one or the other speaker while reading sentences. Results revealed differences in N400 and P600 waveforms when imagining the non-native speaker's voice compared to the native speaker's voice. Importantly, when imagining the non-native speaker committing subject-verb agreement errors, P600 amplitudes were no different from error-free items.

KW - Auditory perceptual simulation

KW - Event-related potentials

KW - Grammaticality

KW - P600

KW - Sentence processing

KW - Subject-verb disagreement

UR - http://www.scopus.com/inward/record.url?scp=85055142985&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85055142985&partnerID=8YFLogxK

U2 - 10.1016/j.cognition.2018.10.014

DO - 10.1016/j.cognition.2018.10.014

M3 - Article

VL - 182

SP - 227

EP - 241

JO - Cognition

T2 - Cognition

JF - Cognition

SN - 0010-0277

ER -