Spoken natural language may appeal to users in the general public since it is the main modality used, together with pointing gestures or gaze, in face-to-face human communication. Our work on multimodal human-computer interaction is based on the two following observations. On the one hand, speech- and gesture-based multimodality has been extensively studied, both from a software and an ergonomic point of view. However, speech plus graphics as an output form of multimodality has raised fewer research studies, especially regarding the utility and
The research on Virtual Reality being carried out at VRLAB is around the topic of multimodal human-computer interaction in virtual environments. We focus mainly on developing new interaction metaphors integrating 3D sound, stereo visualization, and force feedback, towards more intuitive and immersive systems for several applications.
Multimodal Interactive VR Systems
One of the investigated topics concerns the use of intelligent avatars (or autonomous virtual assistants) to efficiently perform tasks in cooperation with the user. In this context,
There is a lot of interesting research going on in the group (feel free to contact anyone in the group if you want to know more - contact details are on the home page). We are really interested in multimodal human-computer interaction - using different sensory modalities to communicate information. Most current interfaces rely almost entirely on vision to present information. This is not natural and can cause sighted users to become overloaded and is a major problem for people with sight impairments.
What we are doing is investigating the use of
RSS/XML