Abstract
The people in an image are generally not strangers, but instead often share social relationships such as husband-wife, siblings, grandparent-child, father-child, or mother-child. Further, the social relationship between a pair of people influences the relative position and appearance of the people in the image. This paper explores using familial social relationships as context for recognizing people and for recognizing the social relationships between pairs of people. We introduce a model for representing the interaction between social relationship, facial appearance, and identity. We show that the family relationship a pair of people share influences the relative pairwise features between them. The experiments on a set of personal collections show significant improvement in people recognition is achieved by modeling social relationships, even in a weak label setting that is attractive in practical applications. Furthermore, we show the social relationships are effectively recognized in images from a separate test image collection.
| Original language | English (US) |
|---|---|
| Title of host publication | Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings |
| Publisher | Springer-Verlag |
| Pages | 169-182 |
| Number of pages | 14 |
| Edition | PART 5 |
| ISBN (Print) | 3642155545, 9783642155543 |
| DOIs | |
| State | Published - Jan 1 2010 |
| Event | 11th European Conference on Computer Vision, ECCV 2010 - Heraklion, Crete, Greece Duration: Sep 10 2010 → Sep 11 2010 |
Publication series
| Name | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
|---|---|
| Number | PART 5 |
| Volume | 6315 LNCS |
| ISSN (Print) | 0302-9743 |
| ISSN (Electronic) | 1611-3349 |
Conference
| Conference | 11th European Conference on Computer Vision, ECCV 2010 |
|---|---|
| Country | Greece |
| City | Heraklion, Crete |
| Period | 9/10/10 → 9/11/10 |
Fingerprint
ASJC Scopus subject areas
- Theoretical Computer Science
- Computer Science(all)
Cite this
Seeing people in social context : Recognizing people and social relationships. / Wang, Gang; Gallagher, Andrew; Luo, Jiebo; Forsyth, David.
Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings. PART 5. ed. Springer-Verlag, 2010. p. 169-182 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6315 LNCS, No. PART 5).Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
}
TY - GEN
T1 - Seeing people in social context
T2 - Recognizing people and social relationships
AU - Wang, Gang
AU - Gallagher, Andrew
AU - Luo, Jiebo
AU - Forsyth, David
PY - 2010/1/1
Y1 - 2010/1/1
N2 - The people in an image are generally not strangers, but instead often share social relationships such as husband-wife, siblings, grandparent-child, father-child, or mother-child. Further, the social relationship between a pair of people influences the relative position and appearance of the people in the image. This paper explores using familial social relationships as context for recognizing people and for recognizing the social relationships between pairs of people. We introduce a model for representing the interaction between social relationship, facial appearance, and identity. We show that the family relationship a pair of people share influences the relative pairwise features between them. The experiments on a set of personal collections show significant improvement in people recognition is achieved by modeling social relationships, even in a weak label setting that is attractive in practical applications. Furthermore, we show the social relationships are effectively recognized in images from a separate test image collection.
AB - The people in an image are generally not strangers, but instead often share social relationships such as husband-wife, siblings, grandparent-child, father-child, or mother-child. Further, the social relationship between a pair of people influences the relative position and appearance of the people in the image. This paper explores using familial social relationships as context for recognizing people and for recognizing the social relationships between pairs of people. We introduce a model for representing the interaction between social relationship, facial appearance, and identity. We show that the family relationship a pair of people share influences the relative pairwise features between them. The experiments on a set of personal collections show significant improvement in people recognition is achieved by modeling social relationships, even in a weak label setting that is attractive in practical applications. Furthermore, we show the social relationships are effectively recognized in images from a separate test image collection.
UR - http://www.scopus.com/inward/record.url?scp=78149289570&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=78149289570&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-15555-0_13
DO - 10.1007/978-3-642-15555-0_13
M3 - Conference contribution
AN - SCOPUS:78149289570
SN - 3642155545
SN - 9783642155543
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 169
EP - 182
BT - Computer Vision, ECCV 2010 - 11th European Conference on Computer Vision, Proceedings
PB - Springer-Verlag
ER -