Semantic analysis for a speech user interface in an intelligent tutoring system

Yuexi Ren, Mark Hasegawa-Johnson, Stephen E. Levinson

Research output: Contribution to conferencePaperpeer-review

Abstract

In this paper, we describe the strategy of semantic analysis for a speech user interface that is designed for a multimodal intelligent tutoring system. The semantic analysis involves three phases: semantic parsing, salient words/phrases spotting, and accented word detection. Semantic parsing attempts to represent the recognized sentence with a well-formed semantic frame. The recognized sentence consists of the a posterior most probably hypothesized words given the acoustic evidence, and is compliant with the grammatical knowledge that is represented by a semantic language model. The salient words/phrases are useful when semantic parsing fails. The accented words are useful when the user response is out of our expectations, and assist to make the computer agent smarter and smarter.

Original languageEnglish (US)
Pages313-315
Number of pages3
DOIs
StatePublished - 2004
EventIUI 04: 2004 International Conference on Intelligent User Interfaces - Madeira, Portugal
Duration: Jan 13 2004Jan 16 2004

Other

OtherIUI 04: 2004 International Conference on Intelligent User Interfaces
Country/TerritoryPortugal
CityMadeira
Period1/13/041/16/04

Keywords

  • Intelligent tutoring system
  • Semantic analysis
  • Spoken language processing

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'Semantic analysis for a speech user interface in an intelligent tutoring system'. Together they form a unique fingerprint.

Cite this