Describing objects by their attributes

Ali Farhadi, Ian Endres, Derek Hoiem, David Forsyth

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose to shift the goal of recognition from naming to describing. Doing so allows us not only to name familiar objects, but also: to report unusual aspects of a familiar object ("spotty dog", not just "dog"); to say something about unfamiliar objects ("hairy and four-legged", not just "unknown"); and to learn how to recognize new objects with few or no visual examples. Rather than focusing on identity assignment, we make inferring attributes the core problem of recognition. These attributes can be semantic ("spotty") or discriminative ("dogs have it but sheep do not"). Learning attributes presents a major new challenge: generalization across object categories, not just across instances within a category. In this paper, we also introduce a novel feature selection method for learning attributes that generalize well across categories. We support our claims by thorough evaluation that provides insights into the limitations of the standard recognition paradigm of naming and demonstrates the new abilities provided by our attributebased framework.

Original languageEnglish (US)
Title of host publication2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009
PublisherIEEE Computer Society
Pages1778-1785
Number of pages8
ISBN (Print)9781424439935
DOIs
StatePublished - Jan 1 2009
Event2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Miami, FL, United States
Duration: Jun 20 2009Jun 25 2009

Publication series

Name2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2009
Volume2009 IEEE Computer Society Conference on Computer Vision and ...

Other

Other2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
CountryUnited States
CityMiami, FL
Period6/20/096/25/09

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Biomedical Engineering

Fingerprint Dive into the research topics of 'Describing objects by their attributes'. Together they form a unique fingerprint.

Cite this