Natural scene categories revealed in distributed patterns of activity in the human brain

Dirk B. Walther, Eamon Caddigan, Li Fei-Fei, Diane M. Beck

Research output: Contribution to journalArticlepeer-review

Abstract

Human subjects are extremely efficient at categorizing natural scenes, despite the fact that different classes of natural scenes often share similar image statistics. Thus far, however, it isunknownwhere andhowcomplex natural scene categories are encoded and discriminated in the brain. We used functional magnetic resonance imaging (fMRI) and distributed pattern analysis to ask what regions of the brain can differentiate natural scene categories (such as forests vs mountains vs beaches). Using completely different exemplars of six natural scene categories for training and testing ensured that the classification algorithm was learning patterns associated with the category in general and not specific exemplars. We found that area V1, the parahippocampal place area (PPA), retrosplenial cortex (RSC), and lateral occipital complex (LOC) all contain information that distinguishes among natural scene categories. More importantly, correlations with human behavioral experiments suggest that the information present in the PPA, RSC, and LOC is likely to contribute to natural scene categorization by humans. Specifically, error patterns of predictions based on fMRI signals in these areas were significantly correlated with the behavioral errors of the subjects. Furthermore, both behavioral categorization performance and predictions from PPA exhibited a significant decrease in accuracywhenscenes were presented up-down inverted. Together these results suggest that a network of regions, including the PPA, RSC, and LOC, contribute to the human ability to categorize natural scenes.

Original languageEnglish (US)
Pages (from-to)10573-10581
Number of pages9
JournalJournal of Neuroscience
Volume29
Issue number34
DOIs
StatePublished - Aug 26 2009

ASJC Scopus subject areas

  • General Neuroscience

Fingerprint

Dive into the research topics of 'Natural scene categories revealed in distributed patterns of activity in the human brain'. Together they form a unique fingerprint.

Cite this