Sound Analysis-Synthesis

The Sound Analysis & Synthesis team carries out research and development activity in sound analysis, transformation, and synthesis of sound signals.

The analysis of sounds includes methods enabling the permanent extraction or automatic structuring of diverse sorts of information given off by the signal, such as the fundamental frequency or the spectral evolution determining the pitch and timbre of a perceived sound.

Information outside what is strictly musical is also taken into consideration, notably concerning industrial acoustics, sound design and multimedia as well as the automatic indexing of recorded sounds. The methods used are based on signal processing, statistical analysis, learning techniques and deep learning, recognition techniques, but also on knowledge of auditory perception.

Techniques of transformation and synthesis are initially created to respond to the needs of musicians in the production of new sounds and new music. A typical example of this is the computer synthesis of a virtual choir for an opera. However, the work is frequently applied to the fields of mobile telecommunications, video games, and virtual reality.
Analysis and synthesis is based on the conception of both signal models (the modeling of sound effects produced via their signals) and physical models (the acoustical modeling of the source of sound production). These models are integrated into pieces of computer software for PC or Macintosh (Mac OS X, Windows, or Linux) equipped with graphical interfaces specifically designed for musicians, but adaptable for sound engineers, acousticians and amateurs.

Major Themes

  • Signal Models
  • Sound Characterization
  • Analysis, transformation, and synthesis of the voice and speech, models of the voice, conversion of speakers
  • Analysis of sound scenes

Specialist Areas

Signal processing, statistics, information theory, learning techniques, form recognition, digital analysis, modeling.

Team Website

  • Dans le laboratoire de l'équipe  © Philippe Barbosa
    Dans le laboratoire de l'équipe © Philippe Barbosa
  • Dans le laboratoire de l'équipe  © Philippe Barbosa
    Dans le laboratoire de l'équipe © Philippe Barbosa
  • Logiciel The Snail  © Philippe Barbosa
    Logiciel The Snail © Philippe Barbosa
  • Dans le laboratoire de l'équipe  © Philippe Barbosa
    Dans le laboratoire de l'équipe © Philippe Barbosa
  • Dans le laboratoire de l'équipe  © Philippe Barbosa
    Dans le laboratoire de l'équipe © Philippe Barbosa
  • Logiciel AudioSculpt  © Philippe Barbosa
    Logiciel AudioSculpt © Philippe Barbosa

Research topics and related projects

Automatic Music Indexing

Automatic extraction of musical descriptors for a piece of music

Orchestration Assistance

Tool to assist orchestration that is integrated in the software created at IRCAM

Processing by Phase Vocoder

Techniques for the analysis and transformation of sounds

European and national projects

FuturePulse

FuturePulse: Multimodal Predictive Analytics and Recommendation Services for the Music Industry

IRiMaS

Interactive Research in Music as Sound:Transforming Digital Musicology

3DTVS

Study of techniques for description of 3D audiovisual contents

ABC_DJ

Artist-to-business-to-business-to-Consumer Audio branding System

Cagima

global Acoustic Conception of Reed Musical Instruments, In Tune and Homogeneous

ChaNTeR

Real-time controlled digital singing

FuturePulse

FuturePulse: Multimodal Predictive Analytics and Recommendation Services for the Music Industry

Houle

Hierarchical Object based Unsupervised Learning

ROUTE

Robot à l'écoute

Skat-VG

Sketching Audio Technologies using Vocalizations and Gestures

TheVoice

Voice design for the creatives industries


Softwares (design & development)

product

AudioSculpt

Lets you “sculpt” sound visually
product

Diphone Studio

Diphone Studio for sound morphing.
product

Max Sound Box

A collection of real-time Max objects for sound analysis intended for real-time synthesis.
product

SuperVP for Max

Phase vocodeur for Max.
product

The Snail-Absolute Tuning

Offers novel ways of tuning a musical instrument, working on intonation, and visualizing music an...

Team


Head Researcher : Axel Roebel
Researchers & Engineers : Luc Ardaillon, Rémi Mignot, Gabriel Meseguer Brocal, Nicolas Obin, Frédéric Cornu
Doctoral Students : Hadrien Foroughmand Aarabi, Adelino Rafael Mendes Ferro, Guillaume Doras, Hugo Caracalla
Doctoral Student : Alice Cohen-Hadria
Chargé(e) de recherche et de développement : Frederik Bous
Trainee : Clement LeMoineVeillon

Publications