Speech/gesture interface to a visual-computing environment

Rajeev Sharma; Michael Zeller; Vladimir I. Pavlovic; Thomas S. Huang; Zion Lo; Stephen Chu; Yunxin Zhao; James C. Phillips; Klaus Schulten

doi:10.1109/38.824531

Speech/gesture interface to a visual-computing environment

Rajeev Sharma, Michael Zeller, Vladimir I. Pavlovic, Thomas S. Huang, Zion Lo, Stephen Chu, Yunxin Zhao, James C. Phillips, Klaus Schulten

National Center for Supercomputing Applications (NCSA)

Research output: Contribution to journal › Article › peer-review

Abstract

A bimodal speech/gesture interface that lets researchers interact with 3D graphical objects in a virtual environment using spoken words and simple, free hand gestures is presented. In this initial implementation, new users needed only a few minutes to get acquainted with the setup. Every user reported that working with the interface is more convenient and, in most cases, more efficient than the traditional interaction with visual molecular dynamics.

Original language	English (US)
Pages (from-to)	29-37
Number of pages	9
Journal	IEEE Computer Graphics and Applications
Volume	20
Issue number	2
DOIs	https://doi.org/10.1109/38.824531
State	Published - Mar 2000

ASJC Scopus subject areas

Software
Computer Graphics and Computer-Aided Design

Online availability

10.1109/38.824531

Library availability

Discover UIUC Full Text

Cite this

@article{abf211a996664923afa294c9f90ac68b,

title = "Speech/gesture interface to a visual-computing environment",

abstract = "A bimodal speech/gesture interface that lets researchers interact with 3D graphical objects in a virtual environment using spoken words and simple, free hand gestures is presented. In this initial implementation, new users needed only a few minutes to get acquainted with the setup. Every user reported that working with the interface is more convenient and, in most cases, more efficient than the traditional interaction with visual molecular dynamics.",

author = "Rajeev Sharma and Michael Zeller and Pavlovic, {Vladimir I.} and Huang, {Thomas S.} and Zion Lo and Stephen Chu and Yunxin Zhao and Phillips, {James C.} and Klaus Schulten",

note = "Funding Information: We gratclully acknowledge the fiilaiicial suppori ollhc National Science Foundation (grants 11s-97-33644,I RI-89-08255, IUR-9318159, RI-95-02074, IRl-96-34618); the US Army Ikscarch Laboratory (Coopcrative Agree- mcnt No. DAA1.0~1-96-2-0003);S uinitonio Electric Industries; tlic Natirmal InstitlitCS 01H ealth (I'I~IS5 1'41 RR05969-04); and the Roy J. Carver Cliariiahle Trust.",

year = "2000",

month = mar,

doi = "10.1109/38.824531",

language = "English (US)",

volume = "20",

pages = "29--37",

journal = "IEEE Computer Graphics and Applications",

issn = "0272-1716",

publisher = "IEEE Computer Society",

number = "2",

}

TY - JOUR

T1 - Speech/gesture interface to a visual-computing environment

AU - Sharma, Rajeev

AU - Zeller, Michael

AU - Pavlovic, Vladimir I.

AU - Huang, Thomas S.

AU - Lo, Zion

AU - Chu, Stephen

AU - Zhao, Yunxin

AU - Phillips, James C.

AU - Schulten, Klaus

N1 - Funding Information: We gratclully acknowledge the fiilaiicial suppori ollhc National Science Foundation (grants 11s-97-33644,I RI-89-08255, IUR-9318159, RI-95-02074, IRl-96-34618); the US Army Ikscarch Laboratory (Coopcrative Agree- mcnt No. DAA1.0~1-96-2-0003);S uinitonio Electric Industries; tlic Natirmal InstitlitCS 01H ealth (I'I~IS5 1'41 RR05969-04); and the Roy J. Carver Cliariiahle Trust.

PY - 2000/3

Y1 - 2000/3

N2 - A bimodal speech/gesture interface that lets researchers interact with 3D graphical objects in a virtual environment using spoken words and simple, free hand gestures is presented. In this initial implementation, new users needed only a few minutes to get acquainted with the setup. Every user reported that working with the interface is more convenient and, in most cases, more efficient than the traditional interaction with visual molecular dynamics.

AB - A bimodal speech/gesture interface that lets researchers interact with 3D graphical objects in a virtual environment using spoken words and simple, free hand gestures is presented. In this initial implementation, new users needed only a few minutes to get acquainted with the setup. Every user reported that working with the interface is more convenient and, in most cases, more efficient than the traditional interaction with visual molecular dynamics.

UR - http://www.scopus.com/inward/record.url?scp=0034158857&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0034158857&partnerID=8YFLogxK

U2 - 10.1109/38.824531

DO - 10.1109/38.824531

M3 - Article

AN - SCOPUS:0034158857

SN - 0272-1716

VL - 20

SP - 29

EP - 37

JO - IEEE Computer Graphics and Applications

JF - IEEE Computer Graphics and Applications

IS - 2

ER -

Speech/gesture interface to a visual-computing environment

Abstract

ASJC Scopus subject areas

Online availability

Library availability

Related links

Cite this