What you see is what you expect: rapid scene understanding benefits from prior experience

Michelle R. Greene, Abraham P. Botros, Diane M. Beck, Li Fei-Fei

Research output: Contribution to journalArticle

Abstract

Although we are able to rapidly understand novel scene images, little is known about the mechanisms that support this ability. Theories of optimal coding assert that prior visual experience can be used to ease the computational burden of visual processing. A consequence of this idea is that more probable visual inputs should be facilitated relative to more unlikely stimuli. In three experiments, we compared the perceptions of highly improbable real-world scenes (e.g., an underwater press conference) with common images matched for visual and semantic features. Although the two groups of images could not be distinguished by their low-level visual features, we found profound deficits related to the improbable images: Observers wrote poorer descriptions of these images (Exp. 1), had difficulties classifying the images as unusual (Exp. 2), and even had lower sensitivity to detect these images in noise than to detect their more probable counterparts (Exp. 3). Taken together, these results place a limit on our abilities for rapid scene perception and suggest that perception is facilitated by prior visual experience.

Original languageEnglish (US)
Pages (from-to)1239-1251
Number of pages13
JournalAttention, Perception, and Psychophysics
Volume77
Issue number4
DOIs
StatePublished - May 1 2015

Fingerprint

Aptitude
Semantics
Noise
experience
press conference
ability
Prior Experience
coding
deficit
stimulus
semantics
experiment

Keywords

  • Free-response
  • Prior probability
  • Scene understanding

ASJC Scopus subject areas

  • Language and Linguistics
  • Experimental and Cognitive Psychology
  • Sensory Systems
  • Linguistics and Language

Cite this

What you see is what you expect : rapid scene understanding benefits from prior experience. / Greene, Michelle R.; Botros, Abraham P.; Beck, Diane M.; Fei-Fei, Li.

In: Attention, Perception, and Psychophysics, Vol. 77, No. 4, 01.05.2015, p. 1239-1251.

Research output: Contribution to journalArticle

Greene, Michelle R. ; Botros, Abraham P. ; Beck, Diane M. ; Fei-Fei, Li. / What you see is what you expect : rapid scene understanding benefits from prior experience. In: Attention, Perception, and Psychophysics. 2015 ; Vol. 77, No. 4. pp. 1239-1251.
@article{329da61d242142718dd9a747ddbd26d3,
title = "What you see is what you expect: rapid scene understanding benefits from prior experience",
abstract = "Although we are able to rapidly understand novel scene images, little is known about the mechanisms that support this ability. Theories of optimal coding assert that prior visual experience can be used to ease the computational burden of visual processing. A consequence of this idea is that more probable visual inputs should be facilitated relative to more unlikely stimuli. In three experiments, we compared the perceptions of highly improbable real-world scenes (e.g., an underwater press conference) with common images matched for visual and semantic features. Although the two groups of images could not be distinguished by their low-level visual features, we found profound deficits related to the improbable images: Observers wrote poorer descriptions of these images (Exp. 1), had difficulties classifying the images as unusual (Exp. 2), and even had lower sensitivity to detect these images in noise than to detect their more probable counterparts (Exp. 3). Taken together, these results place a limit on our abilities for rapid scene perception and suggest that perception is facilitated by prior visual experience.",
keywords = "Free-response, Prior probability, Scene understanding",
author = "Greene, {Michelle R.} and Botros, {Abraham P.} and Beck, {Diane M.} and Li Fei-Fei",
year = "2015",
month = "5",
day = "1",
doi = "10.3758/s13414-015-0859-8",
language = "English (US)",
volume = "77",
pages = "1239--1251",
journal = "Attention, Perception, and Psychophysics",
issn = "1943-3921",
publisher = "Springer New York",
number = "4",

}

TY - JOUR

T1 - What you see is what you expect

T2 - rapid scene understanding benefits from prior experience

AU - Greene, Michelle R.

AU - Botros, Abraham P.

AU - Beck, Diane M.

AU - Fei-Fei, Li

PY - 2015/5/1

Y1 - 2015/5/1

N2 - Although we are able to rapidly understand novel scene images, little is known about the mechanisms that support this ability. Theories of optimal coding assert that prior visual experience can be used to ease the computational burden of visual processing. A consequence of this idea is that more probable visual inputs should be facilitated relative to more unlikely stimuli. In three experiments, we compared the perceptions of highly improbable real-world scenes (e.g., an underwater press conference) with common images matched for visual and semantic features. Although the two groups of images could not be distinguished by their low-level visual features, we found profound deficits related to the improbable images: Observers wrote poorer descriptions of these images (Exp. 1), had difficulties classifying the images as unusual (Exp. 2), and even had lower sensitivity to detect these images in noise than to detect their more probable counterparts (Exp. 3). Taken together, these results place a limit on our abilities for rapid scene perception and suggest that perception is facilitated by prior visual experience.

AB - Although we are able to rapidly understand novel scene images, little is known about the mechanisms that support this ability. Theories of optimal coding assert that prior visual experience can be used to ease the computational burden of visual processing. A consequence of this idea is that more probable visual inputs should be facilitated relative to more unlikely stimuli. In three experiments, we compared the perceptions of highly improbable real-world scenes (e.g., an underwater press conference) with common images matched for visual and semantic features. Although the two groups of images could not be distinguished by their low-level visual features, we found profound deficits related to the improbable images: Observers wrote poorer descriptions of these images (Exp. 1), had difficulties classifying the images as unusual (Exp. 2), and even had lower sensitivity to detect these images in noise than to detect their more probable counterparts (Exp. 3). Taken together, these results place a limit on our abilities for rapid scene perception and suggest that perception is facilitated by prior visual experience.

KW - Free-response

KW - Prior probability

KW - Scene understanding

UR - http://www.scopus.com/inward/record.url?scp=84939951252&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84939951252&partnerID=8YFLogxK

U2 - 10.3758/s13414-015-0859-8

DO - 10.3758/s13414-015-0859-8

M3 - Article

C2 - 25776799

AN - SCOPUS:84939951252

VL - 77

SP - 1239

EP - 1251

JO - Attention, Perception, and Psychophysics

JF - Attention, Perception, and Psychophysics

SN - 1943-3921

IS - 4

ER -