Seeing people in social context: Recognizing people and social relationships

Gang Wang, Andrew Gallagher, Jiebo Luo, David Forsyth

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The people in an image are generally not strangers, but instead often share social relationships such as husband-wife, siblings, grandparent-child, father-child, or mother-child. Further, the social relationship between a pair of people influences the relative position and appearance of the people in the image. This paper explores using familial social relationships as context for recognizing people and for recognizing the social relationships between pairs of people. We introduce a model for representing the interaction between social relationship, facial appearance, and identity. We show that the family relationship a pair of people share influences the relative pairwise features between them. The experiments on a set of personal collections show significant improvement in people recognition is achieved by modeling social relationships, even in a weak label setting that is attractive in practical applications. Furthermore, we show the social relationships are effectively recognized in images from a separate test image collection.

Original languageEnglish (US)
Title of host publicationComputer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings
PublisherSpringer-Verlag
Pages169-182
Number of pages14
EditionPART 5
ISBN (Print)3642155545, 9783642155543
DOIs
StatePublished - Jan 1 2010
Event11th European Conference on Computer Vision, ECCV 2010 - Heraklion, Crete, Greece
Duration: Sep 10 2010Sep 11 2010

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 5
Volume6315 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference11th European Conference on Computer Vision, ECCV 2010
CountryGreece
CityHeraklion, Crete
Period9/10/109/11/10

Fingerprint

Labels
Experiments
Context
Relationships
Pairwise
Interaction
Modeling
Experiment
Children

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Wang, G., Gallagher, A., Luo, J., & Forsyth, D. (2010). Seeing people in social context: Recognizing people and social relationships. In Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings (PART 5 ed., pp. 169-182). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6315 LNCS, No. PART 5). Springer-Verlag. https://doi.org/10.1007/978-3-642-15555-0_13

Seeing people in social context : Recognizing people and social relationships. / Wang, Gang; Gallagher, Andrew; Luo, Jiebo; Forsyth, David.

Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings. PART 5. ed. Springer-Verlag, 2010. p. 169-182 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6315 LNCS, No. PART 5).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Wang, G, Gallagher, A, Luo, J & Forsyth, D 2010, Seeing people in social context: Recognizing people and social relationships. in Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings. PART 5 edn, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 5, vol. 6315 LNCS, Springer-Verlag, pp. 169-182, 11th European Conference on Computer Vision, ECCV 2010, Heraklion, Crete, Greece, 9/10/10. https://doi.org/10.1007/978-3-642-15555-0_13
Wang G, Gallagher A, Luo J, Forsyth D. Seeing people in social context: Recognizing people and social relationships. In Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings. PART 5 ed. Springer-Verlag. 2010. p. 169-182. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 5). https://doi.org/10.1007/978-3-642-15555-0_13
Wang, Gang ; Gallagher, Andrew ; Luo, Jiebo ; Forsyth, David. / Seeing people in social context : Recognizing people and social relationships. Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings. PART 5. ed. Springer-Verlag, 2010. pp. 169-182 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 5).
@inproceedings{4f6240c3e00f4aa393974f1b856b24a2,
title = "Seeing people in social context: Recognizing people and social relationships",
abstract = "The people in an image are generally not strangers, but instead often share social relationships such as husband-wife, siblings, grandparent-child, father-child, or mother-child. Further, the social relationship between a pair of people influences the relative position and appearance of the people in the image. This paper explores using familial social relationships as context for recognizing people and for recognizing the social relationships between pairs of people. We introduce a model for representing the interaction between social relationship, facial appearance, and identity. We show that the family relationship a pair of people share influences the relative pairwise features between them. The experiments on a set of personal collections show significant improvement in people recognition is achieved by modeling social relationships, even in a weak label setting that is attractive in practical applications. Furthermore, we show the social relationships are effectively recognized in images from a separate test image collection.",
author = "Gang Wang and Andrew Gallagher and Jiebo Luo and David Forsyth",
year = "2010",
month = "1",
day = "1",
doi = "10.1007/978-3-642-15555-0_13",
language = "English (US)",
isbn = "3642155545",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer-Verlag",
number = "PART 5",
pages = "169--182",
booktitle = "Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings",
edition = "PART 5",

}

TY - GEN

T1 - Seeing people in social context

T2 - Recognizing people and social relationships

AU - Wang, Gang

AU - Gallagher, Andrew

AU - Luo, Jiebo

AU - Forsyth, David

PY - 2010/1/1

Y1 - 2010/1/1

N2 - The people in an image are generally not strangers, but instead often share social relationships such as husband-wife, siblings, grandparent-child, father-child, or mother-child. Further, the social relationship between a pair of people influences the relative position and appearance of the people in the image. This paper explores using familial social relationships as context for recognizing people and for recognizing the social relationships between pairs of people. We introduce a model for representing the interaction between social relationship, facial appearance, and identity. We show that the family relationship a pair of people share influences the relative pairwise features between them. The experiments on a set of personal collections show significant improvement in people recognition is achieved by modeling social relationships, even in a weak label setting that is attractive in practical applications. Furthermore, we show the social relationships are effectively recognized in images from a separate test image collection.

AB - The people in an image are generally not strangers, but instead often share social relationships such as husband-wife, siblings, grandparent-child, father-child, or mother-child. Further, the social relationship between a pair of people influences the relative position and appearance of the people in the image. This paper explores using familial social relationships as context for recognizing people and for recognizing the social relationships between pairs of people. We introduce a model for representing the interaction between social relationship, facial appearance, and identity. We show that the family relationship a pair of people share influences the relative pairwise features between them. The experiments on a set of personal collections show significant improvement in people recognition is achieved by modeling social relationships, even in a weak label setting that is attractive in practical applications. Furthermore, we show the social relationships are effectively recognized in images from a separate test image collection.

UR - http://www.scopus.com/inward/record.url?scp=78149289570&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78149289570&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-15555-0_13

DO - 10.1007/978-3-642-15555-0_13

M3 - Conference contribution

AN - SCOPUS:78149289570

SN - 3642155545

SN - 9783642155543

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 169

EP - 182

BT - Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings

PB - Springer-Verlag

ER -