Low bit-rate video streaming for face-to-face teleconference

Then Wen, Zicheng Liu, Michael Cohen, Jin Li, Ke Zheng, Tomas Huang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Face-to-face video teleconferencing is very important for real time communication. Current teleconferencing application uses standard video codec, such as MPEG 1/2/4, for the compression of face video. It either requires high bandwidth for high quality video transmission, or the transmitted face video be blurred at low bitrate. In this paper, we present a system for real-time coding of face video at low bit-rate. There are two main contributions. First, we improve the technique of long term memory prediction by selecting frames into the database in an optimal way. A new frame is selected into the database only when it is significantly different from those frames which are already in the database. In this way, the database can cover a wider range of images. Second, we incorporate the prior knowledge about faces into the long term memory prediction framework. The prior knowledge includes: (1) facial motions are repetitive such that most of them can be reconstructed from multiple reference frames; and (2) different components of the face and the background could tolerate different level of error because of different perceptual importance. Experiments show that at similar PSNR the proposed system works much faster and achieves better visual quality than standard H.264/JVT codec.

Original languageEnglish (US)
Title of host publication2004 IEEE International Conference on Multimedia and Expo (ICME)
Pages1631-1634
Number of pages4
StatePublished - 2004
Event2004 IEEE International Conference on Multimedia and Expo (ICME) - Taipei, Taiwan, Province of China
Duration: Jun 27 2004Jun 30 2004

Publication series

Name2004 IEEE International Conference on Multimedia and Expo (ICME)
Volume3

Other

Other2004 IEEE International Conference on Multimedia and Expo (ICME)
CountryTaiwan, Province of China
CityTaipei
Period6/27/046/30/04

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint Dive into the research topics of 'Low bit-rate video streaming for face-to-face teleconference'. Together they form a unique fingerprint.

Cite this