Joint feature learning for face recognition

Jiwen Lu, Venice Erin Liong, Gang Wang, Pierre Moulin

Research output: Contribution to journalArticlepeer-review


This paper presents a new joint feature learning (JFL) approach to automatically learn feature representation from raw pixels for face recognition. Unlike many existing face recognition systems, where conventional feature descriptors, such as local binary patterns and Gabor features, are used for face representation, we propose an unsupervised feature learning method to learn hierarchical feature representation. Since different face regions have different physical characteristics, we propose to use different feature dictionaries to represent them, and to learn multiple yet related feature projection matrices for these regions simultaneously. Hence position-specific discriminative information can be exploited for face representation. Having learned these feature projections for different face regions, we perform spatial pooling for face patches within each region to enhance the representative power of the learned features. Moreover, we stack our JFL model into a deep architecture to exploit hierarchical information for feature representation and further improve the recognition performance. Experimental results on five widely used face data sets show the effectiveness of our proposed approach.

Original languageEnglish (US)
Article number7053922
Pages (from-to)1371-1383
Number of pages13
JournalIEEE Transactions on Information Forensics and Security
Issue number7
StatePublished - Jul 1 2015


  • Face recognition
  • deep learning
  • feature learning
  • joint learning

ASJC Scopus subject areas

  • Safety, Risk, Reliability and Quality
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Joint feature learning for face recognition'. Together they form a unique fingerprint.

Cite this