Opera

PErceptual Optimizations for Audio Rendering

Introduction

This project is dedicated to researching and developing new methods to optimize the spatialization possibilities of a complex sound scene (i.e. containing a large number of sound sources/ listeners).

Work Description/Objectives

In order to reduce the computation resources, the general procedure involves the segmentation and hierarchical organization of a sound scene using a small number of spatial elements (sonic imposters) yet preserving the scene’s spatial qualities. This segmentation is based on criteria of spatial proximity (in distance or in degrees) but must also take perceptive properties, such as the spectral or temporal masking of signals associated to the sound source, into consideration. More generally, segmentation is based on the perception of audio flux and the localization of multiple sound sources.

IRCAM’s mission is to study the perceptive metrics that allow us to control the segmentation of a sound source in accordance with the interaction of its sources with the room effect and to offer hierarchical encoding formats of a sound scene. As part of the project, prototypes will be developed for massively extensive multi-user online games and for the design of urban sound scenes.

Project Details

Participants