CROSSMOD

Cross-modal perceptual interaction and rendering: a New Generation of Audiovisual Virtual Environments

The project's goal is to capitalize multi-sensorial perceptive properties to optimize the quality and interactivity of virtual reality applications. Currently, the two principal senses that capitalized on in 3DEV are sight and hearing. Recent research carried out in these fields has shown the significance of integrating rules of perception for more effectual reproduction.

However, our senses do not function independently. Different studies revealed phenomena of sensorial integration in which one sensorial structure may be affected by another, particularly in terms of spatial or temporal congruence.

The main idea of the project was to make use of the properties of resolution, of masking, or of hierarchy among perceptive dimensions to control the synthesis of a sound or visual stage.

Project Details

Participants