Optimised sign language video coding based on eye-tracking analysis

D. Agrafiotis, N. Canagarajah, D. R. Bull, Matthew Dye, H. Twyford, J. Kyle, J. Chung How

Research output: Contribution to journalConference article

Abstract

The imminent arrival of mobile video telephony will enable deaf people to communicate - as hearing people have been able to do for a some time now - anytime/anywhere in their own language sign language. At low bit rates coding of sign language sequences is very challenging due to the high level of motion and the need to maintain good image quality to aid with understanding. This paper presents optimised coding of sign language video at low bit rates in a way that will favour comprehension of the compressed material by deaf users. Our coding suggestions are based on an eye-tracking study that we have conducted which allows us to analyse the visual attention of sign language viewers. The results of this study are included in this paper. Analysis and results for two coding methods, one using MPEG-4 video objects and the second using foveation filtering are presented. Results with foveation filtering are very promising, offering a considerable decrease in bit rate in a way which is compatible with the visual attention patterns of deaf people, as these were recorded in the eye tracking study.

Original languageEnglish (US)
Pages (from-to)1244-1252
Number of pages9
JournalProceedings of SPIE - The International Society for Optical Engineering
Volume5150 II
DOIs
StatePublished - Oct 1 2003
EventVisual Communications and Image Processing 2003 - Lugano, Switzerland
Duration: Jul 8 2003Jul 11 2003

Fingerprint

Sign Language
Eye Tracking
Video Coding
Image coding
coding
Coding
Visual Attention
Filtering
Audition
Image quality
MPEG-4
telephony
Image Quality
hearing
suggestion
arrivals
Decrease
Motion

Keywords

  • Eye tracking
  • Foveated video
  • MPEG-4
  • Sign language video coding

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Agrafiotis, D., Canagarajah, N., Bull, D. R., Dye, M., Twyford, H., Kyle, J., & How, J. C. (2003). Optimised sign language video coding based on eye-tracking analysis. Proceedings of SPIE - The International Society for Optical Engineering, 5150 II, 1244-1252. https://doi.org/10.1117/12.503107

Optimised sign language video coding based on eye-tracking analysis. / Agrafiotis, D.; Canagarajah, N.; Bull, D. R.; Dye, Matthew; Twyford, H.; Kyle, J.; How, J. Chung.

In: Proceedings of SPIE - The International Society for Optical Engineering, Vol. 5150 II, 01.10.2003, p. 1244-1252.

Research output: Contribution to journalConference article

Agrafiotis, D, Canagarajah, N, Bull, DR, Dye, M, Twyford, H, Kyle, J & How, JC 2003, 'Optimised sign language video coding based on eye-tracking analysis', Proceedings of SPIE - The International Society for Optical Engineering, vol. 5150 II, pp. 1244-1252. https://doi.org/10.1117/12.503107
Agrafiotis, D. ; Canagarajah, N. ; Bull, D. R. ; Dye, Matthew ; Twyford, H. ; Kyle, J. ; How, J. Chung. / Optimised sign language video coding based on eye-tracking analysis. In: Proceedings of SPIE - The International Society for Optical Engineering. 2003 ; Vol. 5150 II. pp. 1244-1252.
@article{e69de7ea688e4d6b98eed7df61cf135e,
title = "Optimised sign language video coding based on eye-tracking analysis",
abstract = "The imminent arrival of mobile video telephony will enable deaf people to communicate - as hearing people have been able to do for a some time now - anytime/anywhere in their own language sign language. At low bit rates coding of sign language sequences is very challenging due to the high level of motion and the need to maintain good image quality to aid with understanding. This paper presents optimised coding of sign language video at low bit rates in a way that will favour comprehension of the compressed material by deaf users. Our coding suggestions are based on an eye-tracking study that we have conducted which allows us to analyse the visual attention of sign language viewers. The results of this study are included in this paper. Analysis and results for two coding methods, one using MPEG-4 video objects and the second using foveation filtering are presented. Results with foveation filtering are very promising, offering a considerable decrease in bit rate in a way which is compatible with the visual attention patterns of deaf people, as these were recorded in the eye tracking study.",
keywords = "Eye tracking, Foveated video, MPEG-4, Sign language video coding",
author = "D. Agrafiotis and N. Canagarajah and Bull, {D. R.} and Matthew Dye and H. Twyford and J. Kyle and How, {J. Chung}",
year = "2003",
month = "10",
day = "1",
doi = "10.1117/12.503107",
language = "English (US)",
volume = "5150 II",
pages = "1244--1252",
journal = "Proceedings of SPIE - The International Society for Optical Engineering",
issn = "0277-786X",
publisher = "SPIE",

}

TY - JOUR

T1 - Optimised sign language video coding based on eye-tracking analysis

AU - Agrafiotis, D.

AU - Canagarajah, N.

AU - Bull, D. R.

AU - Dye, Matthew

AU - Twyford, H.

AU - Kyle, J.

AU - How, J. Chung

PY - 2003/10/1

Y1 - 2003/10/1

N2 - The imminent arrival of mobile video telephony will enable deaf people to communicate - as hearing people have been able to do for a some time now - anytime/anywhere in their own language sign language. At low bit rates coding of sign language sequences is very challenging due to the high level of motion and the need to maintain good image quality to aid with understanding. This paper presents optimised coding of sign language video at low bit rates in a way that will favour comprehension of the compressed material by deaf users. Our coding suggestions are based on an eye-tracking study that we have conducted which allows us to analyse the visual attention of sign language viewers. The results of this study are included in this paper. Analysis and results for two coding methods, one using MPEG-4 video objects and the second using foveation filtering are presented. Results with foveation filtering are very promising, offering a considerable decrease in bit rate in a way which is compatible with the visual attention patterns of deaf people, as these were recorded in the eye tracking study.

AB - The imminent arrival of mobile video telephony will enable deaf people to communicate - as hearing people have been able to do for a some time now - anytime/anywhere in their own language sign language. At low bit rates coding of sign language sequences is very challenging due to the high level of motion and the need to maintain good image quality to aid with understanding. This paper presents optimised coding of sign language video at low bit rates in a way that will favour comprehension of the compressed material by deaf users. Our coding suggestions are based on an eye-tracking study that we have conducted which allows us to analyse the visual attention of sign language viewers. The results of this study are included in this paper. Analysis and results for two coding methods, one using MPEG-4 video objects and the second using foveation filtering are presented. Results with foveation filtering are very promising, offering a considerable decrease in bit rate in a way which is compatible with the visual attention patterns of deaf people, as these were recorded in the eye tracking study.

KW - Eye tracking

KW - Foveated video

KW - MPEG-4

KW - Sign language video coding

UR - http://www.scopus.com/inward/record.url?scp=0141719478&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0141719478&partnerID=8YFLogxK

U2 - 10.1117/12.503107

DO - 10.1117/12.503107

M3 - Conference article

VL - 5150 II

SP - 1244

EP - 1252

JO - Proceedings of SPIE - The International Society for Optical Engineering

JF - Proceedings of SPIE - The International Society for Optical Engineering

SN - 0277-786X

ER -