Corsaire

Combinations of Sensori-motor Rendering for Immersive Result Analysis

Work Description/Objectives

This project develops new methods for observation/interaction with large and complex data by making use of the principle of multi-sensory exploration in the context of virtual reality systems. In the long term, the goal is to explore how the different senses can be combined to improve the "understanding" of data and more generally to offer new methods of interaction.

The project is made up of three initial stages: the development of a multi-modal environment based on virtual reality techniques, the study of multi-modal interaction and the proposition of models for the distribution of information to different senses, the application of the results in different concrete cases of observation and scientific data.

The part played by IRCAM in the project centers on the following points:

• the study of visio-audio-haptic interaction (associating image, sound and movement),
• spatial sonification: development of a repertory of spatial interactions in terms of the quality of the information to be presented,
• application to different sound reproduction systems: Wavefield Synthesis (holophony), Binaural Synthesis (headphones).

Project Details

Participants