Natural, metaphoric, and linguistic auditory direction signals have distinct influences on visual motion processing

Sepideh Sadaghiani, Joost X. Maier, Uta Noppeney

Research output: Contribution to journalArticlepeer-review


To interact with our dynamic environment, the brain merges motion information from auditory and visual senses. However, not only "natural" auditory MOTION, but also "metaphoric" de/ascending PITCH and SPEECH (e.g., "left/right"), influence the visual motion percept. Here, we systematically investigate whether these three classes of direction signals influence visual motion perception through shared or distinct neural mechanisms. In a visual-selective attention paradigm, subjects discriminated the direction of visual motion at several levels of reliability, with an irrelevant auditory stimulus being congruent, absent, or incongruent. Although the natural, metaphoric, and linguistic auditory signals were equally long and adjusted to induce a comparable directional bias on the motion percept, they influenced visual motion processing at different levels of the cortical hierarchy. A significant audiovisual interaction was revealed for MOTION in left human motion complex (hMT+/V5+) and for SPEECH in right intraparietal sulcus. In fact, the audiovisual interaction gradually decreased in left hMT+/V5+ for MOTION > PITCH > SPEECH and in right intraparietal sulcus for SPEECH > PITCH > MOTION. In conclusion, natural motion signals are integrated in audiovisual motion areas, whereas the influence of culturally learnt signals emerges primarily in higher-level convergence regions.

Original languageEnglish (US)
Pages (from-to)6490-6499
Number of pages10
JournalJournal of Neuroscience
Issue number20
StatePublished - May 20 2009
Externally publishedYes

ASJC Scopus subject areas

  • General Neuroscience


Dive into the research topics of 'Natural, metaphoric, and linguistic auditory direction signals have distinct influences on visual motion processing'. Together they form a unique fingerprint.

Cite this