Semantic analysis for a speech user interface in an intelligent tutoring system

Research output: Contribution to conferencePaper

Abstract

In this paper, we describe the strategy of semantic analysis for a speech user interface that is designed for a multimodal intelligent tutoring system. The semantic analysis involves three phases: semantic parsing, salient words/phrases spotting, and accented word detection. Semantic parsing attempts to represent the recognized sentence with a well-formed semantic frame. The recognized sentence consists of the a posterior most probably hypothesized words given the acoustic evidence, and is compliant with the grammatical knowledge that is represented by a semantic language model. The salient words/phrases are useful when semantic parsing fails. The accented words are useful when the user response is out of our expectations, and assist to make the computer agent smarter and smarter.

Original languageEnglish (US)
Pages313-315
Number of pages3
StatePublished - Dec 1 2004
EventIUI 04: 2004 International Conference on Intelligent User Interfaces - Madeira, Portugal
Duration: Jan 13 2004Jan 16 2004

Other

OtherIUI 04: 2004 International Conference on Intelligent User Interfaces
CountryPortugal
CityMadeira
Period1/13/041/16/04

Fingerprint

Intelligent systems
User interfaces
Semantics
Acoustics

Keywords

  • Intelligent tutoring system
  • Semantic analysis
  • Spoken language processing

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction

Cite this

Ren, Y., Hasegawa-Johnson, M. A., & Levinson, S. E. (2004). Semantic analysis for a speech user interface in an intelligent tutoring system. 313-315. Paper presented at IUI 04: 2004 International Conference on Intelligent User Interfaces, Madeira, Portugal.

Semantic analysis for a speech user interface in an intelligent tutoring system. / Ren, Yuexi; Hasegawa-Johnson, Mark Allan; Levinson, Stephen E.

2004. 313-315 Paper presented at IUI 04: 2004 International Conference on Intelligent User Interfaces, Madeira, Portugal.

Research output: Contribution to conferencePaper

Ren, Y, Hasegawa-Johnson, MA & Levinson, SE 2004, 'Semantic analysis for a speech user interface in an intelligent tutoring system', Paper presented at IUI 04: 2004 International Conference on Intelligent User Interfaces, Madeira, Portugal, 1/13/04 - 1/16/04 pp. 313-315.
Ren Y, Hasegawa-Johnson MA, Levinson SE. Semantic analysis for a speech user interface in an intelligent tutoring system. 2004. Paper presented at IUI 04: 2004 International Conference on Intelligent User Interfaces, Madeira, Portugal.
Ren, Yuexi ; Hasegawa-Johnson, Mark Allan ; Levinson, Stephen E. / Semantic analysis for a speech user interface in an intelligent tutoring system. Paper presented at IUI 04: 2004 International Conference on Intelligent User Interfaces, Madeira, Portugal.3 p.
@conference{adab1d462adc4599a0ce3158cb8ed377,
title = "Semantic analysis for a speech user interface in an intelligent tutoring system",
abstract = "In this paper, we describe the strategy of semantic analysis for a speech user interface that is designed for a multimodal intelligent tutoring system. The semantic analysis involves three phases: semantic parsing, salient words/phrases spotting, and accented word detection. Semantic parsing attempts to represent the recognized sentence with a well-formed semantic frame. The recognized sentence consists of the a posterior most probably hypothesized words given the acoustic evidence, and is compliant with the grammatical knowledge that is represented by a semantic language model. The salient words/phrases are useful when semantic parsing fails. The accented words are useful when the user response is out of our expectations, and assist to make the computer agent smarter and smarter.",
keywords = "Intelligent tutoring system, Semantic analysis, Spoken language processing",
author = "Yuexi Ren and Hasegawa-Johnson, {Mark Allan} and Levinson, {Stephen E}",
year = "2004",
month = "12",
day = "1",
language = "English (US)",
pages = "313--315",
note = "IUI 04: 2004 International Conference on Intelligent User Interfaces ; Conference date: 13-01-2004 Through 16-01-2004",

}

TY - CONF

T1 - Semantic analysis for a speech user interface in an intelligent tutoring system

AU - Ren, Yuexi

AU - Hasegawa-Johnson, Mark Allan

AU - Levinson, Stephen E

PY - 2004/12/1

Y1 - 2004/12/1

N2 - In this paper, we describe the strategy of semantic analysis for a speech user interface that is designed for a multimodal intelligent tutoring system. The semantic analysis involves three phases: semantic parsing, salient words/phrases spotting, and accented word detection. Semantic parsing attempts to represent the recognized sentence with a well-formed semantic frame. The recognized sentence consists of the a posterior most probably hypothesized words given the acoustic evidence, and is compliant with the grammatical knowledge that is represented by a semantic language model. The salient words/phrases are useful when semantic parsing fails. The accented words are useful when the user response is out of our expectations, and assist to make the computer agent smarter and smarter.

AB - In this paper, we describe the strategy of semantic analysis for a speech user interface that is designed for a multimodal intelligent tutoring system. The semantic analysis involves three phases: semantic parsing, salient words/phrases spotting, and accented word detection. Semantic parsing attempts to represent the recognized sentence with a well-formed semantic frame. The recognized sentence consists of the a posterior most probably hypothesized words given the acoustic evidence, and is compliant with the grammatical knowledge that is represented by a semantic language model. The salient words/phrases are useful when semantic parsing fails. The accented words are useful when the user response is out of our expectations, and assist to make the computer agent smarter and smarter.

KW - Intelligent tutoring system

KW - Semantic analysis

KW - Spoken language processing

UR - http://www.scopus.com/inward/record.url?scp=18744366064&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=18744366064&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:18744366064

SP - 313

EP - 315

ER -