Speech/gesture interface to a visual-computing environment

Rajeev Sharma, Michael Zeller, Vladimir I. Pavlovic, Thomas S. Huang, Zion Lo, Stephen Chu, Yunxin Zhao, James C. Phillips, Klaus Schulten

Research output: Contribution to journalArticlepeer-review


A bimodal speech/gesture interface that lets researchers interact with 3D graphical objects in a virtual environment using spoken words and simple, free hand gestures is presented. In this initial implementation, new users needed only a few minutes to get acquainted with the setup. Every user reported that working with the interface is more convenient and, in most cases, more efficient than the traditional interaction with visual molecular dynamics.

Original languageEnglish (US)
Pages (from-to)29-37
Number of pages9
JournalIEEE Computer Graphics and Applications
Issue number2
StatePublished - Mar 2000

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Cite this