Sound Analysis-Synthesis
The analysis of sounds includes methods enabling the permanent extraction or automatic structuring of diverse sorts of information given off by the signal, such as the fundamental frequency or the spectral evolution determining the pitch and timbre of a perceived sound.
Information outside what is strictly musical is also taken into consideration, notably concerning industrial acoustics, sound design and multimedia as well as the automatic indexing of recorded sounds. The methods used are based on signal processing, statistical analysis, learning techniques and deep learning, recognition techniques, but also on knowledge of auditory perception.
Techniques of transformation and synthesis are initially created to respond to the needs of musicians in the production of new sounds and new music. A typical example of this is the computer synthesis of a virtual choir for an opera. However, the work is frequently applied to the fields of mobile telecommunications, video games, and virtual reality.
Analysis and synthesis is based on the conception of both signal models (the modeling of sound effects produced via their signals) and physical models (the acoustical modeling of the source of sound production). These models are integrated into pieces of computer software for PC or Macintosh (Mac OS X, Windows, or Linux) equipped with graphical interfaces specifically designed for musicians, but adaptable for sound engineers, acousticians and amateurs.
Major Themes
- Signal Models
- Sound Characterization
- Analysis, transformation, and synthesis of the voice and speech, models of the voice, conversion of speakers
- Analysis of sound scenes
Specialist Areas
Signal processing, statistics, information theory, learning techniques, form recognition, digital analysis, modeling.
- Dans le laboratoire de l'équipe © Philippe Barbosa
- Dans le laboratoire de l'équipe © Philippe Barbosa
- Logiciel The Snail © Philippe Barbosa
- Dans le laboratoire de l'équipe © Philippe Barbosa
- Dans le laboratoire de l'équipe © Philippe Barbosa
- Logiciel AudioSculpt © Philippe Barbosa
Collaborations
Aalto University (Finlande), Ableton (Germany), Acapela Group, Acoustic Research Institute (Autria), AudioGaming, Arte, Artipolis (Luxembourg), Dualo, Mines Paris Tech, Exalead, ExeQuo, France Télécom R&D/ Orange, Flying Eye (Germany), Game Audio Factory, Genesis SA, HHI Berlin (Germany), Idol, INESC, ISAE-SUPAERO, ISIR/Sorbonne Université, IUAV (Italia), Kantar Media, KTH (Sweden), LIMSI, LMA Marseille, LIA (univ. d’Avignon), Laboratoire Parole et Langage - Hôpital La Conception, NuHag (Autria), OFAI, ParisTech, Queen Mary University of London (United Kingdom), SCREAM National Cheng Kung University (Taïwan), Sky Deutschland (Germany), Smartlog, Smartsound, Sony Music France, Stupeflix, Ubisoft, UPF/MTG (Spain), université Huddersfield (United Kingdom), université Lumière-Lyon-2, université Paris-8, Univers Sons (UVI), Viddiga, Vizion’R, Voxygen, Yacast.Deutschland (Germany).
Research topics and related projects
Automatic Music Indexing
Automatic extraction of musical descriptors for a piece of music
Orchestration Assistance
Tool to assist orchestration that is integrated in the software created at IRCAM
Processing by Phase Vocoder
Techniques for the analysis and transformation of sounds
European and national projects
3DTVS
Study of techniques for description of 3D audiovisual contents
ABC_DJ
Artist-to-business-to-business-to-Consumer Audio branding System
AI4Media
A European Excellence Centre for Media, Society and Democracy
ARS
Analyse et transformation de style de chant
BRUEL
ElaBoRation d’Une méthodologie d’EvaLuation des systèmes d’identification par la voix
Cagima
global Acoustic Conception of Reed Musical Instruments, In Tune and Homogeneous
ChaNTeR
Real-time controlled digital singing
FuturePulse
FuturePulse: Multimodal Predictive Analytics and Recommendation Services for the Music Industry
Houle
Hierarchical Object based Unsupervised Learning
ROUTE
Robot à l'écoute
Skat-VG
Sketching Audio Technologies using Vocalizations and Gestures
TheVoice
Voice design for the creatives industries
Aqua-Rius
Aqua-Rius
Exovoices
Exovoices
Softwares (design & development)
AudioSculpt
Max Sound Box
SuperVP for Max
The Snail-Absolute Tuning
Team
Head Researcher : Axel Roebel
Researchers & Engineers : Luc Ardaillon, Remi Mignot, Nicolas Obin, Frédéric Cornu, Pierre-Hugo Vial, Frederik Bous, Théodor Lemerle, Antoine Caillon, Guillaume Doras, alice cohenhadria
Doctoral Students : Yann Teytaut, Lenny Renault, Antoine Lavault
: Leane Salais, Lisa LaPietra
Collaborations
Aalto University (Finlande), Ableton (Germany), Acapela Group, Acoustic Research Institute (Autria), AudioGaming, Arte, Artipolis (Luxembourg), Dualo, Mines Paris Tech, Exalead, ExeQuo, France Télécom R&D/ Orange, Flying Eye (Germany), Game Audio Factory, Genesis SA, HHI Berlin (Germany), Idol, INESC, ISAE-SUPAERO, ISIR/Sorbonne Université, IUAV (Italia), Kantar Media, KTH (Sweden), LIMSI, LMA Marseille, LIA (univ. d’Avignon), Laboratoire Parole et Langage - Hôpital La Conception, NuHag (Autria), OFAI, ParisTech, Queen Mary University of London (United Kingdom), SCREAM National Cheng Kung University (Taïwan), Sky Deutschland (Germany), Smartlog, Smartsound, Sony Music France, Stupeflix, Ubisoft, UPF/MTG (Spain), université Huddersfield (United Kingdom), université Lumière-Lyon-2, université Paris-8, Univers Sons (UVI), Viddiga, Vizion’R, Voxygen, Yacast.Deutschland (Germany).