Acoustic and Cognitive Spaces

Sub title:
The Acoustic and Cognitive Spaces activity of research and development centers on the reproduction, the analysis/synthesis, and the perception of sound spaces.

App:

Model:

Id:

Fields:

Content:
<p>The main team&rsquo;s scientific disciplines are signal processing and acoustics for the elaboration of spatialized audio reproduction techniques and methods for the analysis/synthesis of a sound field.</p> <p>In parallel, the team devotes a large percentage of its time to cognitive studies on multisensorial integration for a rational development of new sonic mediations based on body/hearing/space interaction. The scientific activities described below are combined with the development of software libraries. These developments build on the team&rsquo;s expertise, and its academic and experimental research activities and are the major vector of our relationship with musical creation and other application domains.</p> <p>The work carried out concerning spatialization techniques are concentrated on models based on a physical formalism of the sound field. The primary objective is the development of a formal framework for the analysis/synthesis of the sound field using spatial room impulse responses (SRIR). The SRIRs are generally measured using spherical arrays featuring several dozen transducers (microphones and/or loudspeakers). The principal application concerns the development of convolution reverberators using these high spatial resolution SRIRs to faithfully reproduce the complexity of a sound field.</p> <p>Binaural Spatialization techniques using headphones is also a focus of our attention. The evolution of listening practices and the democratization of interactive applications tend to favor listening with headphones through smartphones. Taking advantage of this sonic immersion, binaural listening has become the primary vector of tridimensional listening. Based on the exploitation of headrelated transfer functions (HRTFs), it is the only approach that currently ensures a precise and dynamic reconstruction of the perceptual cues responsible for auditory localization. It has become the reference tool for experimental research in connection with spatial cognition in a multisensorial context and for virtual reality applications.</p> <p>These 3D audio spatialization techniques associated with a tracking system that captures the movements of a performer or a member of the audience, constitute an organological base essential for addressing the issues of "musical, sound, and multimedia interaction". At the same time, they nourish research on the cognitive mechanisms related to the sensation of space, in particular on the necessary coordination between the various sensory modalities (hearing, vision, proprioception, motricity, ...) for the perception and the representation of space. We seek to uncover the influence of the different acoustic cues (location, distance, reverberation...) used by the human central nervous system on the integration of sensory information and their interaction with emotional processes.</p> <p>On the musical level, our ambition is to provide models and tools that enable composers to include sounds in a given space throughout the compositional process: from writing to concert. This contributes to making spatialization a parameter of musical writing. In the arts, this research also applies to post-production, to interactive sound installations, and to dance via the questions related to sound/space/body interaction. The incorporation of sound spatialization in virtual reality environments creates the opportunity for scientific applications to be used in neuroscience research, therapeutic systems, or transportation simulators.</p> <p></p> <h2>Major themes</h2> <p></p> <ul> <li>Sound Spatialization: hybrid reverberation and spatial room impulse&nbsp;responses (SRIR), &nbsp;SRIR analysis-synthesis, hybrid reverberation and spatialized impulse responses; synthesis of&nbsp;sound fields via high-density spatial networks, WFS and HOA&nbsp;systems in the Espace de Projection, binaural listening, CONTINUUM Distributed spatialization</li> <li>Cognitive foundations: auditory spatial cognition, multisensory&nbsp;integration and emotion, entrecorps project, music and cerebral&nbsp;plasticity, perception of distance in augmented reality</li> <li>Creation / Mediation: audio rendering of spaces in the RASPUTIN</li> </ul> <p></p> <p style="text-align: right;"><a href="https://www.stms-lab.fr/team/espaces-acoustiques-et-cognitifs/" target="_blank" class="wys-button">Team Website</a></p>

App:

Model:

Id:

Fields: