Multimodal speech and audio user interfaces for K-12 outreach

Mark Allan Hasegawa-Johnson, Camille Goudeseune, Jennifer Cole, Hank Kaczmarski, Heejin Kim, Sarah King, Timothy Mahrt, Jui Ting Huang, Xiaodan Zhuang, Kai Hsiang Lin, Harsh Vardhan Sharma, Zhen Li, Thomas S Huang

Research output: Contribution to conferencePaper

Abstract

Elementary school children have short attention spans. This paper describes three multimodal speech and audio user interfaces that captured and held the attention of a few dozen elementary-school and high-school children during the course of a two-day university open house. The Speech Recognition Game demonstrated an isolated word recognizer with a rapidly-won game, in which children were challenged to get ten words in a row correctly recognized. The Audio Easter Egg Hunt demonstrated our timeliner multimedia analytics platform with a faster-than-real-time search through orchestral music for audio anomalies (cuckoo clocks, motorcycles, etc). Finally, at the Intonation Station, children had to pick the pitch contour that would help a friendly troll to successfully hunt dragons in the city of Champaign. Results suggest that competition, collaboration, and other forms of social interaction may motivate children more than prizes.

Original languageEnglish (US)
Pages526-531
Number of pages6
StatePublished - Dec 1 2011
EventAsia-Pacific Signal and Information Processing Association Annual Summit and Conference 2011, APSIPA ASC 2011 - Xi'an, China
Duration: Oct 18 2011Oct 21 2011

Other

OtherAsia-Pacific Signal and Information Processing Association Annual Summit and Conference 2011, APSIPA ASC 2011
CountryChina
CityXi'an
Period10/18/1110/21/11

Fingerprint

Motorcycles
Speech recognition
User interfaces
Clocks

ASJC Scopus subject areas

  • Information Systems
  • Signal Processing

Cite this

Hasegawa-Johnson, M. A., Goudeseune, C., Cole, J., Kaczmarski, H., Kim, H., King, S., ... Huang, T. S. (2011). Multimodal speech and audio user interfaces for K-12 outreach. 526-531. Paper presented at Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2011, APSIPA ASC 2011, Xi'an, China.

Multimodal speech and audio user interfaces for K-12 outreach. / Hasegawa-Johnson, Mark Allan; Goudeseune, Camille; Cole, Jennifer; Kaczmarski, Hank; Kim, Heejin; King, Sarah; Mahrt, Timothy; Huang, Jui Ting; Zhuang, Xiaodan; Lin, Kai Hsiang; Sharma, Harsh Vardhan; Li, Zhen; Huang, Thomas S.

2011. 526-531 Paper presented at Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2011, APSIPA ASC 2011, Xi'an, China.

Research output: Contribution to conferencePaper

Hasegawa-Johnson, MA, Goudeseune, C, Cole, J, Kaczmarski, H, Kim, H, King, S, Mahrt, T, Huang, JT, Zhuang, X, Lin, KH, Sharma, HV, Li, Z & Huang, TS 2011, 'Multimodal speech and audio user interfaces for K-12 outreach', Paper presented at Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2011, APSIPA ASC 2011, Xi'an, China, 10/18/11 - 10/21/11 pp. 526-531.
Hasegawa-Johnson MA, Goudeseune C, Cole J, Kaczmarski H, Kim H, King S et al. Multimodal speech and audio user interfaces for K-12 outreach. 2011. Paper presented at Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2011, APSIPA ASC 2011, Xi'an, China.
Hasegawa-Johnson, Mark Allan ; Goudeseune, Camille ; Cole, Jennifer ; Kaczmarski, Hank ; Kim, Heejin ; King, Sarah ; Mahrt, Timothy ; Huang, Jui Ting ; Zhuang, Xiaodan ; Lin, Kai Hsiang ; Sharma, Harsh Vardhan ; Li, Zhen ; Huang, Thomas S. / Multimodal speech and audio user interfaces for K-12 outreach. Paper presented at Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2011, APSIPA ASC 2011, Xi'an, China.6 p.
@conference{fa9bc42df56e453788e03c7315341acf,
title = "Multimodal speech and audio user interfaces for K-12 outreach",
abstract = "Elementary school children have short attention spans. This paper describes three multimodal speech and audio user interfaces that captured and held the attention of a few dozen elementary-school and high-school children during the course of a two-day university open house. The Speech Recognition Game demonstrated an isolated word recognizer with a rapidly-won game, in which children were challenged to get ten words in a row correctly recognized. The Audio Easter Egg Hunt demonstrated our timeliner multimedia analytics platform with a faster-than-real-time search through orchestral music for audio anomalies (cuckoo clocks, motorcycles, etc). Finally, at the Intonation Station, children had to pick the pitch contour that would help a friendly troll to successfully hunt dragons in the city of Champaign. Results suggest that competition, collaboration, and other forms of social interaction may motivate children more than prizes.",
author = "Hasegawa-Johnson, {Mark Allan} and Camille Goudeseune and Jennifer Cole and Hank Kaczmarski and Heejin Kim and Sarah King and Timothy Mahrt and Huang, {Jui Ting} and Xiaodan Zhuang and Lin, {Kai Hsiang} and Sharma, {Harsh Vardhan} and Zhen Li and Huang, {Thomas S}",
year = "2011",
month = "12",
day = "1",
language = "English (US)",
pages = "526--531",
note = "Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2011, APSIPA ASC 2011 ; Conference date: 18-10-2011 Through 21-10-2011",

}

TY - CONF

T1 - Multimodal speech and audio user interfaces for K-12 outreach

AU - Hasegawa-Johnson, Mark Allan

AU - Goudeseune, Camille

AU - Cole, Jennifer

AU - Kaczmarski, Hank

AU - Kim, Heejin

AU - King, Sarah

AU - Mahrt, Timothy

AU - Huang, Jui Ting

AU - Zhuang, Xiaodan

AU - Lin, Kai Hsiang

AU - Sharma, Harsh Vardhan

AU - Li, Zhen

AU - Huang, Thomas S

PY - 2011/12/1

Y1 - 2011/12/1

N2 - Elementary school children have short attention spans. This paper describes three multimodal speech and audio user interfaces that captured and held the attention of a few dozen elementary-school and high-school children during the course of a two-day university open house. The Speech Recognition Game demonstrated an isolated word recognizer with a rapidly-won game, in which children were challenged to get ten words in a row correctly recognized. The Audio Easter Egg Hunt demonstrated our timeliner multimedia analytics platform with a faster-than-real-time search through orchestral music for audio anomalies (cuckoo clocks, motorcycles, etc). Finally, at the Intonation Station, children had to pick the pitch contour that would help a friendly troll to successfully hunt dragons in the city of Champaign. Results suggest that competition, collaboration, and other forms of social interaction may motivate children more than prizes.

AB - Elementary school children have short attention spans. This paper describes three multimodal speech and audio user interfaces that captured and held the attention of a few dozen elementary-school and high-school children during the course of a two-day university open house. The Speech Recognition Game demonstrated an isolated word recognizer with a rapidly-won game, in which children were challenged to get ten words in a row correctly recognized. The Audio Easter Egg Hunt demonstrated our timeliner multimedia analytics platform with a faster-than-real-time search through orchestral music for audio anomalies (cuckoo clocks, motorcycles, etc). Finally, at the Intonation Station, children had to pick the pitch contour that would help a friendly troll to successfully hunt dragons in the city of Champaign. Results suggest that competition, collaboration, and other forms of social interaction may motivate children more than prizes.

UR - http://www.scopus.com/inward/record.url?scp=84866866750&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84866866750&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:84866866750

SP - 526

EP - 531

ER -