Sound Analysis-Synthesis

The Sound Analysis & Synthesis team carries out research and development activity in sound analysis, transformation, and synthesis of sound signals.

The analysis of sounds includes methods enabling the permanent extraction or automatic structuring of diverse sorts of information given off by the signal, such as the fundamental frequency or the spectral evolution determining the pitch and timbre of a perceived sound.

Information outside what is strictly musical is also taken into consideration, notably concerning industrial acoustics, sound design and multimedia as well as the automatic indexing of recorded sounds. The methods used are based on signal processing, statistical analysis, learning techniques and deep learning, recognition techniques, but also on knowledge of auditory perception.

Techniques of transformation and synthesis are initially created to respond to the needs of musicians in the production of new sounds and new music. A typical example of this is the computer synthesis of a virtual choir for an opera. However, the work is frequently applied to the fields of mobile telecommunications, video games, and virtual reality.
Analysis and synthesis is based on the conception of both signal models (the modeling of sound effects produced via their signals) and physical models (the acoustical modeling of the source of sound production). These models are integrated into pieces of computer software for PC or Macintosh (Mac OS X, Windows, or Linux) equipped with graphical interfaces specifically designed for musicians, but adaptable for sound engineers, acousticians and amateurs.

Major Themes

  • Signal Models
  • Sound Characterization
  • Analysis, transformation, and synthesis of the voice and speech, models of the voice, conversion of speakers
  • Analysis of sound scenes

Specialist Areas

Signal processing, statistics, information theory, learning techniques, form recognition, digital analysis, modeling.

Team Website

  • Dans le laboratoire de l'équipe  © Philippe Barbosa
    Dans le laboratoire de l'équipe © Philippe Barbosa
  • Dans le laboratoire de l'équipe  © Philippe Barbosa
    Dans le laboratoire de l'équipe © Philippe Barbosa
  • Logiciel The Snail  © Philippe Barbosa
    Logiciel The Snail © Philippe Barbosa
  • Dans le laboratoire de l'équipe  © Philippe Barbosa
    Dans le laboratoire de l'équipe © Philippe Barbosa
  • Dans le laboratoire de l'équipe  © Philippe Barbosa
    Dans le laboratoire de l'équipe © Philippe Barbosa
  • Logiciel AudioSculpt  © Philippe Barbosa
    Logiciel AudioSculpt © Philippe Barbosa

Research topics and related projects

Automatic Music Indexing

Automatic extraction of musical descriptors for a piece of music

Orchestration Assistance

Tool to assist orchestration that is integrated in the software created at IRCAM

Processing by Phase Vocoder

Techniques for the analysis and transformation of sounds

European and national projects

FuturePulse

FuturePulse: Multimodal Predictive Analytics and Recommendation Services for the Music Industry

IRiMaS

Interactive Research in Music as Sound:Transforming Digital Musicology

3DTVS

Study of techniques for description of 3D audiovisual contents

ABC_DJ

Artist-to-business-to-business-to-Consumer Audio branding System

Cagima

global Acoustic Conception of Reed Musical Instruments, In Tune and Homogeneous

ChaNTeR

Real-time controlled digital singing

FuturePulse

FuturePulse: Multimodal Predictive Analytics and Recommendation Services for the Music Industry

Houle

Hierarchical Object based Unsupervised Learning

IRiMaS

Interactive Research in Music as Sound:Transforming Digital Musicology

ROUTE

Robot à l'écoute

Skat-VG

Sketching Audio Technologies using Vocalizations and Gestures

TheVoice

Voice design for the creatives industries


Softwares (design & development)

product

AudioSculpt

included in your membership
AudioSculpt uses a graphical approach to “sculpt” (to modify) a sound file. After a phase of analysis, the user modifies the analysis’ result directly, using only a mouse to apply the desired changes to the sound. Several types of analysis of the spectral content are shown and the user can modify the sound several different ways.
product

Diphone Studio

Diphone Studio for sound morphing.
product

Max Sound Box

free
A collection of Max externals with help files and examples for real-time interactions including tools for real-time analysis, transformations and synthesis of sound. Max Sound Box technologies are completed by Forum Max Apps providing tutorials and ready-to-use modules.
product

SuperVP for Max

free
SuperVP is a phase vocodeur for Max. The SuperVP Max externals are based on the same advanced phase vocoder engine as the analysis/synthesis functionalities of AudioSculpt, providing high-quality sound processing in real-time. A first set of externals gives access to time-stretching, pitch transposition, spectral envelope transformations, and s...
product

The Snail-Absolute Tuning

Offers novel ways of tuning a musical instrument, working on intonation, and visualizing music and sounds in real time.


Publications