Recognizing people in social context

Gang Wang, Andrew Gallagher, Jiebo Luo, David Alexander Forsyth

Research output: Chapter in Book/Report/Conference proceedingChapter


The people in an image are generally not strangers, but instead often share social relationships such as husband-wife, siblings, grandparent-child, father-child, or mother-child. Further, the social relationship between a pair of people influences the relative position and appearance of the people in the image. This chapter explores using familial social relationships as context, recognizing people and recognizing the social relationships between pairs of people. We introduce a model for representing the interaction between social relationship, facial appearance, and identity. The experiments on a set of personal collections show that significant improvement in people recognition is achieved by modeling social relationships, even in a weak label setting that is attractive in practical applications. Furthermore, we show that social relationships are effectively recognized in images from a separate test image collection.

Original languageEnglish (US)
Title of host publicationHuman-Centered Social Media Analytics
Number of pages15
ISBN (Electronic)9783319054919
ISBN (Print)3319054902, 9783319054902
StatePublished - Mar 1 2014

ASJC Scopus subject areas

  • Computer Science(all)


Dive into the research topics of 'Recognizing people in social context'. Together they form a unique fingerprint.

Cite this