TY - GEN
T1 - Emotion recognition based on joint visual and audio cues
AU - Sebe, Nicu
AU - Cohen, Ira
AU - Gevers, Theo
AU - Huang, Thomas S.
PY - 2006
Y1 - 2006
N2 - Recent technological advances have enabled human users to interact with computers in ways previously unimaginable. Beyond the confines of the keyboard and mouse, new modalities for human-computer interaction such as voice, gesture, and force-feedback are emerging. However, one necessary ingredient for natural interaction is still missing - emotions. This paper describes the problem of bimodal emotion recognition and advocates the use of probabilistic graphical models when fusing the different modalities. We test our audio-visual emotion recognition approach on 38 subjects with 11 HCI-related affect states. The experimental results show that the average person-dependent emotion recognition accuracy is greatly improved when both visual and audio information are used in classification.
AB - Recent technological advances have enabled human users to interact with computers in ways previously unimaginable. Beyond the confines of the keyboard and mouse, new modalities for human-computer interaction such as voice, gesture, and force-feedback are emerging. However, one necessary ingredient for natural interaction is still missing - emotions. This paper describes the problem of bimodal emotion recognition and advocates the use of probabilistic graphical models when fusing the different modalities. We test our audio-visual emotion recognition approach on 38 subjects with 11 HCI-related affect states. The experimental results show that the average person-dependent emotion recognition accuracy is greatly improved when both visual and audio information are used in classification.
UR - http://www.scopus.com/inward/record.url?scp=34047198092&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=34047198092&partnerID=8YFLogxK
U2 - 10.1109/ICPR.2006.489
DO - 10.1109/ICPR.2006.489
M3 - Conference contribution
AN - SCOPUS:34047198092
SN - 0769525210
SN - 9780769525211
T3 - Proceedings - International Conference on Pattern Recognition
SP - 1136
EP - 1139
BT - Proceedings - 18th International Conference on Pattern Recognition, ICPR 2006
T2 - 18th International Conference on Pattern Recognition, ICPR 2006
Y2 - 20 August 2006 through 24 August 2006
ER -