Simple line drawings suffice for functional MRI decoding of natural scene categories

Dirk B. Walther, Barry Chai, Eamon Caddigan, Diane M. Beck, Li Fei-Fei

Research output: Contribution to journalArticle

Abstract

Humans are remarkably efficient at categorizing natural scenes. In fact, scene categories can be decoded from functional MRI (fMRI) data throughout the ventral visual cortex, including the primary visual cortex, the parahippocampal place area (PPA), and the retrosplenial cortex (RSC). Here we ask whether, and where, we can still decode scene category if we reduce the scenes to mere lines. We collected fMRI data while participants viewed photographs and line drawings of beaches, city streets, forests, highways, mountains, and offices. Despite the marked difference in scene statistics, we were able to decode scene category from fMRI data for line drawings just as well as from activity for color photographs, in primary visual cortex through PPA and RSC. Even more remarkably, in PPA and RSC, error patterns for decoding from line drawings were very similar to those from color photographs. These data suggest that, in these regions, the information used to distinguish scene category is similar for line drawings and photographs. To determine the relative contributions of local and global structure to the human ability to categorize scenes, we selectively removed long or short contours from the line drawings. In a category-matching task, participants performed significantly worse when long contours were removed than when short contours were removed. We conclude that global scene structure, which is preserved in line drawings, plays an integral part in representing scene categories.

Original languageEnglish (US)
Pages (from-to)9661-9666
Number of pages6
JournalProceedings of the National Academy of Sciences of the United States of America
Volume108
Issue number23
DOIs
StatePublished - Jun 7 2011

Keywords

  • Line art
  • Multivoxel pattern analysis
  • Neuroimaging
  • Scene perception
  • Visual processing

ASJC Scopus subject areas

  • General

Fingerprint Dive into the research topics of 'Simple line drawings suffice for functional MRI decoding of natural scene categories'. Together they form a unique fingerprint.

  • Cite this