A bimodal speech/gesture interface that lets researchers interact with 3D graphical objects in a virtual environment using spoken words and simple, free hand gestures is presented. In this initial implementation, new users needed only a few minutes to get acquainted with the setup. Every user reported that working with the interface is more convenient and, in most cases, more efficient than the traditional interaction with visual molecular dynamics.
ASJC Scopus subject areas
- Computer Graphics and Computer-Aided Design