Natural scene categories revealed in distributed patterns of activity in the human brain

Dirk B. Walther, Eamon Caddigan, Li Fei-Fei, Diane M. Beck

Research output: Contribution to journalArticle

Abstract

Human subjects are extremely efficient at categorizing natural scenes, despite the fact that different classes of natural scenes often share similar image statistics. Thus far, however, it isunknownwhere andhowcomplex natural scene categories are encoded and discriminated in the brain. We used functional magnetic resonance imaging (fMRI) and distributed pattern analysis to ask what regions of the brain can differentiate natural scene categories (such as forests vs mountains vs beaches). Using completely different exemplars of six natural scene categories for training and testing ensured that the classification algorithm was learning patterns associated with the category in general and not specific exemplars. We found that area V1, the parahippocampal place area (PPA), retrosplenial cortex (RSC), and lateral occipital complex (LOC) all contain information that distinguishes among natural scene categories. More importantly, correlations with human behavioral experiments suggest that the information present in the PPA, RSC, and LOC is likely to contribute to natural scene categorization by humans. Specifically, error patterns of predictions based on fMRI signals in these areas were significantly correlated with the behavioral errors of the subjects. Furthermore, both behavioral categorization performance and predictions from PPA exhibited a significant decrease in accuracywhenscenes were presented up-down inverted. Together these results suggest that a network of regions, including the PPA, RSC, and LOC, contribute to the human ability to categorize natural scenes.

Original languageEnglish (US)
Pages (from-to)10573-10581
Number of pages9
JournalJournal of Neuroscience
Volume29
Issue number34
DOIs
StatePublished - Aug 26 2009

Fingerprint

Human Activities
Occipital Lobe
Brain
Magnetic Resonance Imaging
Aptitude
Learning

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Natural scene categories revealed in distributed patterns of activity in the human brain. / Walther, Dirk B.; Caddigan, Eamon; Fei-Fei, Li; Beck, Diane M.

In: Journal of Neuroscience, Vol. 29, No. 34, 26.08.2009, p. 10573-10581.

Research output: Contribution to journalArticle

Walther, Dirk B. ; Caddigan, Eamon ; Fei-Fei, Li ; Beck, Diane M. / Natural scene categories revealed in distributed patterns of activity in the human brain. In: Journal of Neuroscience. 2009 ; Vol. 29, No. 34. pp. 10573-10581.
@article{18ff64db00f8495bb54c8319f809782d,
title = "Natural scene categories revealed in distributed patterns of activity in the human brain",
abstract = "Human subjects are extremely efficient at categorizing natural scenes, despite the fact that different classes of natural scenes often share similar image statistics. Thus far, however, it isunknownwhere andhowcomplex natural scene categories are encoded and discriminated in the brain. We used functional magnetic resonance imaging (fMRI) and distributed pattern analysis to ask what regions of the brain can differentiate natural scene categories (such as forests vs mountains vs beaches). Using completely different exemplars of six natural scene categories for training and testing ensured that the classification algorithm was learning patterns associated with the category in general and not specific exemplars. We found that area V1, the parahippocampal place area (PPA), retrosplenial cortex (RSC), and lateral occipital complex (LOC) all contain information that distinguishes among natural scene categories. More importantly, correlations with human behavioral experiments suggest that the information present in the PPA, RSC, and LOC is likely to contribute to natural scene categorization by humans. Specifically, error patterns of predictions based on fMRI signals in these areas were significantly correlated with the behavioral errors of the subjects. Furthermore, both behavioral categorization performance and predictions from PPA exhibited a significant decrease in accuracywhenscenes were presented up-down inverted. Together these results suggest that a network of regions, including the PPA, RSC, and LOC, contribute to the human ability to categorize natural scenes.",
author = "Walther, {Dirk B.} and Eamon Caddigan and Li Fei-Fei and Beck, {Diane M.}",
year = "2009",
month = "8",
day = "26",
doi = "10.1523/JNEUROSCI.0559-09.2009",
language = "English (US)",
volume = "29",
pages = "10573--10581",
journal = "Journal of Neuroscience",
issn = "0270-6474",
publisher = "Society for Neuroscience",
number = "34",

}

TY - JOUR

T1 - Natural scene categories revealed in distributed patterns of activity in the human brain

AU - Walther, Dirk B.

AU - Caddigan, Eamon

AU - Fei-Fei, Li

AU - Beck, Diane M.

PY - 2009/8/26

Y1 - 2009/8/26

N2 - Human subjects are extremely efficient at categorizing natural scenes, despite the fact that different classes of natural scenes often share similar image statistics. Thus far, however, it isunknownwhere andhowcomplex natural scene categories are encoded and discriminated in the brain. We used functional magnetic resonance imaging (fMRI) and distributed pattern analysis to ask what regions of the brain can differentiate natural scene categories (such as forests vs mountains vs beaches). Using completely different exemplars of six natural scene categories for training and testing ensured that the classification algorithm was learning patterns associated with the category in general and not specific exemplars. We found that area V1, the parahippocampal place area (PPA), retrosplenial cortex (RSC), and lateral occipital complex (LOC) all contain information that distinguishes among natural scene categories. More importantly, correlations with human behavioral experiments suggest that the information present in the PPA, RSC, and LOC is likely to contribute to natural scene categorization by humans. Specifically, error patterns of predictions based on fMRI signals in these areas were significantly correlated with the behavioral errors of the subjects. Furthermore, both behavioral categorization performance and predictions from PPA exhibited a significant decrease in accuracywhenscenes were presented up-down inverted. Together these results suggest that a network of regions, including the PPA, RSC, and LOC, contribute to the human ability to categorize natural scenes.

AB - Human subjects are extremely efficient at categorizing natural scenes, despite the fact that different classes of natural scenes often share similar image statistics. Thus far, however, it isunknownwhere andhowcomplex natural scene categories are encoded and discriminated in the brain. We used functional magnetic resonance imaging (fMRI) and distributed pattern analysis to ask what regions of the brain can differentiate natural scene categories (such as forests vs mountains vs beaches). Using completely different exemplars of six natural scene categories for training and testing ensured that the classification algorithm was learning patterns associated with the category in general and not specific exemplars. We found that area V1, the parahippocampal place area (PPA), retrosplenial cortex (RSC), and lateral occipital complex (LOC) all contain information that distinguishes among natural scene categories. More importantly, correlations with human behavioral experiments suggest that the information present in the PPA, RSC, and LOC is likely to contribute to natural scene categorization by humans. Specifically, error patterns of predictions based on fMRI signals in these areas were significantly correlated with the behavioral errors of the subjects. Furthermore, both behavioral categorization performance and predictions from PPA exhibited a significant decrease in accuracywhenscenes were presented up-down inverted. Together these results suggest that a network of regions, including the PPA, RSC, and LOC, contribute to the human ability to categorize natural scenes.

UR - http://www.scopus.com/inward/record.url?scp=69449103772&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=69449103772&partnerID=8YFLogxK

U2 - 10.1523/JNEUROSCI.0559-09.2009

DO - 10.1523/JNEUROSCI.0559-09.2009

M3 - Article

C2 - 19710310

AN - SCOPUS:69449103772

VL - 29

SP - 10573

EP - 10581

JO - Journal of Neuroscience

JF - Journal of Neuroscience

SN - 0270-6474

IS - 34

ER -