WWW Ircam: Real-Time Musical Interactions

Activities

The Real-Time Musical Interactions team carries out research and development on interactive systems dedicated to music and performances.

Our work relates to all aspects of the interactive process, including the capture and multimodal analysis of the gestures and sounds created by musicians, tools for the synchronization and management of interaction, as well as techniques for real-time synthesis and sound processing. These research projects and their associated computer developments are generally carried out within the framework of interdisciplinary projects that include scientists, artists, teachers, and designers and find applications in creative projects, music education, or in digital audio industrial fields.

Resources of the team

Interest Areas

Modeling and Analysis of Sounds and Gestures. This theme covers the theoretical developments concerning the analysis of the sound and gesture flow, or more generally, multi-modal temporal morphologies. This research concerns diverse techniques for audio analysis, the study of the gestures of performing musicians or dancers.

Technologies for Multimodal Interaction. This theme concerns our tools for analysis and multimodal recogntion of movements and sound; tools for synchronization (gesture following, for example) and visualization.

Interactive Sound Synthesis and Processing. This focuses essentially on synthesis and sound processing methods based on recorded sounds or large sound bodies.

Systems for Gesture Capture and Augmented Instruments. This theme focuses on the developments the team has made in terms of gestural interfaces and augmented instruments for music and performances.

Interest Areas and Associated Projects

National and European Research Projects

Physis : Modeling, Transformation, and Synthesis of Sounds for Interactive Virtual Worlds
Wave : Web Audio: Editing/Visualization
Legos : Sensori-motor learning in gesture-based interactive sound systems
Voice4Games : Voice Processing for Video Game Production
Sample Orchestrator 2 : Hybrid sound processing and interactive arrangements for a new generation of samplers
Topophonie
Same : Sound And Music for Everyone Everyday Everywhere Every way
Interlude : New Digital Paradigms for Exploration and Interaction of Expressive Movement with Music.
EarToy : Sound Avatars and Real-Time Musical Interactions
Caspar : Cultural, Artistic and Scientific knowledge for Preservation, Access and Retrieval
2PIM/MI3
Sample Orchestrator
VoxStruments : Intuitive and Expressive Digital Instrument-Making: a New Concept in Vocally Controlled Instruments
i-Maestro : Interactive Multimedia Environment for Technology Enhanced Music Education and Creative Collaborative Composition and Performance
Conceptmove : Together, artists imagine a model for an interactive digital performance
SemanticHIFI : Browsing, listening, interacting, performing, sharing on future HIFI systems
Windset

Software (design and development)

FTM & Co, CataRT, Max/MSP externals, MuBu...

Specialist Areas

Interactivity, real-time computer science, human-computer interaction, signal processing, motion capture, modeling sound and gesture, statistical modeling and automatic learning, real-time sound analysis and synthesis.

Participants

Head Researcher: Frédéric Bevilacqua
Researchers/developers: Tommaso Bianco, Julien Bloit, Riccardo Borghesi, Fabien Cesari, Emmanuel Fléty, Jean-Philippe Lambert, Norbert Schnell, Diemo Schwarz, Victor Zappi
Doctoral Students: Éric Boyer, Sarah Fdili Alaoui, Jules Françoise, Ianis Lallemand, Bruno Zamborlin

Collaborations

Goldsmiths University of London, Phonotonic (Paris), McGill University (Canada), CNMAT Berkeley (USA), Genoa University (Italy), ENSCI (Paris), LIMSI (Paris-Sud University), GRAME (Lyon), ICK Amsterdam, Atelier des Feuillantines (Paris), Association Puce Muse (Rungis), Univers Sons/Ultimate Sound Bank (Paris), Cycling'74 (USA), Da Fact (Paris), Voxler (Paris), No Design (Paris), BEK (Norway), IEM (Austria), STEIM (Amsterdam), PSA (France), University Pompeu Fabra (Spain), Nokia Research Center (Finland), TKK (Finland), KTH (Sweden), UCL (Belgium), UCSD (USA).

Journal articles

Refereed journals

F. Bevilacqua, F. Baschet, S. Lemouton « The Augmented String Quartet: Experiments and Gesture Following », Journal of New Music Research, vol. 1, n° 41, 2012
T. Bianco, V. Freour, I. Cossette, F. Bevilacqua, R. Caussé « Measures of facial muscle activation, intraoral pressure and mouthpiece force in trumpet playing », Journal of New Music Research, 2012
B. Caramiaux, M. Wanderley, F. Bevilacqua « Segmenting and Parsing Instrumentalists' Gestures », Journal of New Music Research, vol. 1, n° 41, Avril, 2012
S. Fdili Alaoui, F. Bevilacqua, B. Bermudez, C. Jacquemin « Dance Interaction with physical model visualization based on movement qualities », International Journal of Arts and Technologies, 2012
N. Rasamimanana « Towards a Conceptual Framework for Exploring and Modelling Expressive Musical Gestures », Journal of New Music Research,, vol. 1, n° 41, 2012
B. Bermudez, S. DeLahunta, M. Hoogenboom, C. Ziegler, F. Bevilacqua, S. Fdili Alaoui « The Double Skin/Double Mind Interactive Installation », The Journal for Artistic Research (JAR), Janvier, 2011
A. Bonardi, F. Rousseaux, D. Schwarz, B. Roadley « La collection numérique comme modèle pour la synthèse sonore, la composition et l'exploration multimédia interactives », Revue Musimédiane, n° 6, Juin, 2011
J. Bloit, N. Rasamimanana, F. Bevilacqua « Modeling and segmentation of audio descriptor profiles with Segmental Models », Pattern Recognition Letters, 2010
A. Bonardi, F. Rousseaux « Interactions médiatisées sur scène », TECHNIQUE ET SCIENCE INFORMATIQUES, vol. 29, n° 8, Décembre, 2010
A. Cont « A coupled duration-focused architecture for realtime music to score alignment », IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 32, n° 6, Juin, 2010
N. Rasamimanana, F. Kaiser, F. Bevilacqua « Perspectives on gesture-sound relationships informed from acoustic instrument studies », Organised Sound, vol. 14, n° 2, 2009
N. Rasamimanana, F. Bevilacqua « Effort-based Analysis of Bowing Movements: Evidence of Anticipation Effects », Journal of New Music Research, vol. 37, n° 4, 2008
D. Schwarz, E. Brunet « theconcatenator CD Contributors' Notes », Leonardo Music Journal, n° 18, Novembre, 2008
S. DeLahunta, F. Bevilacqua « Sharing Descriptions of Movement », International Journal of Performance and Digital Media, vol. 1, n° 3, 2007
D. Schwarz « Corpus-Based Concatenative Synthesis : Assembling sounds by content-based selection of units from large sound databases », IEEE Signal Processing, vol. 24, n° 2, Mars, 2007
D. Schwarz « Concatenative Sound Synthesis: The Early Years », Journal of New Music Research, vol. 35, n° 1, Mars, 2006

Non-refereed journals

F. Guédy « L'expérimentation musicale et pédagogique sur le geste de l'Atelier des Feuillantines avec l'équipe Interaction Musicale Temps Réel de l'Ircam », L'Education Musicale, 2011

Book sections

A. Dessein, A. Cont, G. Lemaitre « Real-time detection of overlapping sound events with non-negative matrix factorization », Matrix Information Geometry, ed. Nielsen, Frank and Bhatia, Rajendra (Springer), 2012
F. Bevilacqua, N. Schnell, S. Fdili Alaoui « Gesture capture: Paradigms in interactive music/dance systems », Emerging Bodies, ed. G. Klein and S. Noeth (transcript Verlag), 2011
F. Bevilacqua, N. Schnell, N. Rasamimanana, B. Zamborlin, F. Guédy « Online Gesture Analysis and Control of Audio Processing », Musical Robots and Interactive Multimodal Systems. Springer Tracts in Advanced Robotics Vol 74, ed. Jorge Solis and Kia C. Ng (Springer Verlag), 2011
A. Bonardi « Les Petites Absences. Du théâtre à la musique en passant par l'informatique temps réel », Les interactions entre musique et théâtre, ed. Guy Freixe et Bertrand Porot (Editions l'Entretemps, Montpellier), 2011
N. Schnell, F. Bevilacqua, F. Guedy, N. Rasamimanana « Playing and Replaying – Sound, Gesture and Music Analysis and Re-Synthesis for the Interactive Control and Re-Embodiment of Recorded Music », Klang und Begriff. Gemessene Interpretation - Computergestützte Aufführungsanalyse im Kreuzverhör der Disziplinen, ed. Heinz von Loesch, Stefan Weinzierl (Schott Verlag, Mainz), 2011
F. Bevilacqua, B. Zamborlin, A. Sypniewski, N. Schnell, F. Guédy, N. Rasamimanana « Continuous realtime gesture following and recognition », Gesture in Embodied Communication and Human-Computer Interaction. Lecture Notes in Computer Science (LNCS) volume 5934, (Springer Verlag, Mainz), 2010
T. Bianco, V. Freour, N. Rasamimanana, F. Bevilacqua, R. Caussé « On gestural variation and coarticulation effects in sound control », Gesture in Embodied Communication and Human-Computer Interaction. Lecture Notes in Computer Science (LNCS) volume 5934, (Springer Verlag, Mainz), 2010
B. Caramiaux, F. Bevilacqua, N. Schnell « Towards a Gesture-Sound Cross-Modal Analysis », Gesture in Embodied Communication and Human-Computer Interaction. LNAI 5934, (Springer Verlag, Mainz), 2010
S. Dahl, F. Bevilacqua, N. Rasamimanana, R. Bresin, M. Clayton, L. Leante « Gesture in Performance », Musical Gestures. Sound, Movement, and Meaning, (R. I Godoy and M. Leman, Mainz), 2009
R. Cahen, C. Jacquemin, D. Schwarz « Navigation et composition dans un univers graphique 3D de grains sonores », Information & Visualisation: Enjeux, recherches et applications, ed. Sophie Chauvin (Cépaduès Editions, Toulouse), 2008
F. Bevilacqua « Momentary notes on capturing gestures », capturing intentions, ed. Scott deLahunta (Emio Greco/PC and the Amsterdam School fo the Arts, Toulouse), 2007
A. Cont, S. Dubnov, G. Assayag « Anticipatory Model of Musical Style Imitation using Collaborative and Competitive Reinforcement Learning », Anticipatory Behavior in Adaptive Learning Systems, (Martin Butz and Olivier Sigaud and Gianluca Baldassarre, Berlin), 2007
N. Rasamimanana, D. Bernardin, M. Wanderley, F. Bevilacqua « String Bowing Gestures at Varying Bow Stroke Frequencies: A Case Study », Advances in Gesture-Based Human-Computer Interaction and Simulation, (Springer Verlag, Berlin), 2007
F. Bevilacqua, N. Rasamimanana, N. Schnell « Interfaces gestuelles, captation du mouvement et création artistique », L'inouï #2. Revue de l'Ircam, (Editions Léo Scheer, Berlin), 2006
N. Rasamimanana, E. Fléty, F. Bevilacqua « Gesture Analysis of Violin Bow Strokes », Lecture Notes in Computer Science, Vol. 3881. Gesture in Human-Computer Interaction and Simulation: 6th International Gesture Workshop, GW 2005, Berder Island, France, May 18-20, 2005, Revised Selected Papers, ed. Sylvie Gibet, Nicolas Courty, Jean-François Kamp (Springer Berlin / Heidelberg, Berlin), 2006

Conference proceedings articles

G. Beller « In-vivo : laboratoire de recherche et d'expérimentation autour du son pour le théâtre », Towards a History of Sound in Theatre, Montreal, 2012
A. Einbond, C. Trapani, D. Schwarz « Precise Pitch Control in Real Time Corpus-Based Concatenative Synthesis », International Computer Music Conference (ICMC), Ljubljana, 2012
S. Fdili Alaoui, B. Caramiaux, M. Serrano, F. Bevilacqua « Movement Qualities as Interaction Modality », Designing Interactive Systems (DIS'2012), Newcastle, 2012
J. Françoise, B. Caramiaux, F. Bevilacqua « A Hierarchical Approach for the Design of Gesture-to-Sound Mappings », Sound and Music Computing, Copenhague, 2012
M. Kimura, N. Rasamimanana, F. Bevilacqua, N. Schnell, B. Zamborlin, E. Fléty « Extracting Human Expression For Interactive Composition with the Augmented Violin », International Conference on New Interfaces for Musical Expression (NIME 2012), 2012
I. Lallemand, D. Schwarz, T. Artières « Content-based Retrieval of Environmental Sounds by Multiresolution Analysis », SMC2012, Copenhague, 2012
N. Rasamimanana, F. Bevilacqua, J. Bloit, N. Schnell, E. Fléty, A. Cera « The urban musical game: using sport balls as musical interfaces », CHI EA '12 Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems, 2012
M. Savary, D. Schwarz, D. Pellerin « DIRTI — Dirty Tangible Interfaces », New Interfaces for Musical Expression (NIME), Ann Arbour, 2012
D. Schwarz « The Sound Space as Musical Instrument: Playing Corpus-Based Concatenative Synthesis », New Interfaces for Musical Expression (NIME), Ann Arbour, 2012
D. Schwarz, B. Hackbarth « Navigating Variation: Composing for Audio Mosaicing », International Computer Music Conference (ICMC), Ljubljana, 2012
B. Caramiaux, P. Susini, T. Bianco, F. Bevilacqua, O. Houix, N. Schnell « Gestural Embodiment of Environmental Sounds: an Experimental Study », New Interfaces for Musical Expression (NIME), 2011
B. Caramiaux, F. Bevilacqua, N. Schnell « Sound Selection by Gestures », New Interfaces for Musical Expression (NIME), 2011
B. Caramiaux, S. Fdili Alaoui, T. Bouchara, G. Parseihian, M. Rebillat « Gestural Auditory and Visual Interactive Platform », 14th International Conference on Digital Audio Effects (DAFx-11), Paris, 2011
A. Cont, A. Dessein « Applications de la géométrie de l'information au traitement des flux audio temps-réel », 5e Biennale Française des Mathématiques Appliquées, Congrès de la Société de Mathématiques Appliquées et Industrielles (SMAI), Guidel, 2011
N. Delprat, C. Leroux, S. Fdili Alaoui « In the clouds : Virtual experience of a matter », Proceedings of Virtual Reality International Conference (VRIC 2011), Laval, 2011
A. Dessein, A. Cont « Applications of information geometry to audio signal processing », Indo-French Workshop on Matrix Information Geometry (MIG), Palaiseau, 2011
A. Dessein, A. Cont « Segmentation statistique de flux audio en temps-réel dans le cadre de la géométrie de l'information. », 23e Colloque du Groupe de Recherche et d'Etudes du Traitement du Signal (GRETSI), Bordeaux, 2011
A. Dessein, A. Cont « Applications of information geometry to audio signal processing : Tutorial », 14th International Conference on Digital Audio Effects (DAFx), Paris, 2011
H. Ding, D. Schwarz, C. Jacquemin, R. Cahen « Spatial Audio–Graphic Modeling for X3D », Web3D, Paris, 2011
A. Einbond, D. Schwarz « Corpus-Based Concatenative Synthesis: Perceptual Descriptors as an Approach to Composing and Analyzing Timbre », Crossing the Corpus Callosum II: Neuroscience, Healing & Music, Cambridge, MA, 2011
S. Fdili Alaoui, B. Caramiaux, M. Serrano « From Dance to Touch: Movement Qualities for Interaction Design », CHI, Vancouver, 2011
S. Fdili Alaoui « Gestural Auditory and Visual Interactive Platform », JJCAAS 2011, 2011
E. Flety, C. Maestracci « Latency improvement in sensor wireless transmission using IEEE 802.15.4 », NIME 2011, OSLO, 2011
I. Lallemand, D. Schwarz « Interaction-optimized Sound Database Representation », DAFx, Paris, 2011
K. Nymoen, B. Caramiaux, M. Kozak, J. Torresen « Analyzing Sound Tracings - A Multimodal Approach to Music Information Retrieval », ACM Multimedia, Workshop MIRUM, 2011
N. Rasamimanana, F. Bevilacqua, N. Schnell, F. Guedy,, E. Come Maestracci, B. Zamborlin « Modular Musical Objects Towards Embodied Control Of Digital Music », Tangible Embedded and Embodied Interaction, 2011
N. Schnell, F. Bevilacqua, N. Rasamimanana, J. Bloit, F. Guedy, E. Flety « Playing the MO – Gestural Control and Re-Embodiment of Recorded Sound and Music », NIME, Oslo, 2011
D. Schwarz « Distance Mapping for Corpus-Based Concatenative Synthesis », Sound and Music Computing (SMC), Padova, 2011
D. Schwarz, R. Cahen, F. Brument, H. Ding, C. Jacquemin « Sound Level of Detail in Interactive Audiographic 3D Scenes », International Computer Music Conference (ICMC), Huddersfield, 2011
D. Schwarz « State of the Art in Sound Texture Synthesis », Digital Audio Effects (DAFx), Paris, 2011
D. Schwarz, V. Johnson « Corpus-Based Improvisation », (Re)thinking Improvisation, Malmö, 2011
B. Zamborlin, M. Liuni, G. Partesana « (Land)Moves », New Interfaces for Musical Expression (NIME), Oslo, 2011
B. Zamborlin, G. Partesana, M. Liuni « (LAND)MOVES », Conference on New Interfaces for Musical Expression, NIME, Oslo, 2011
F. Bevilacqua, B. Zamborlin, N. Rasamimanana, N. Schnell « Contrôle gestuel continu de médias sonores et visuels », Forum on tactile and gestural interaction, Lille, 2010
F. Bevilacqua « Following movements in interactive dance installations », Kinesthetic Empathy: Concepts and Contexts, Manchester, 2010
T. Bianco, M. Wanderley, F. Bevilacqua « Mimicry of tone production: results from a pilot experiment », Sound and Music Computing Conference, Barcelona, 2010
T. Bianco « Effects of coarticulation in mimicry of tone production », JJCAAS, Paris, 2010
A. Bonardi, I. Truck « Introducing Fuzzy Logic And Computing With Words Paradigms In Realtime Processes For Performance Arts », International Computer Music Conference, New York & Stony Brook, 2010
B. Caramiaux, F. Bevilacqua, N. Schnell « Study on Gesture-Sound Similarity », Music and Gesture, Montreal, 2010
B. Caramiaux, F. Bevilacqua, N. Schnell « Analysing Gesture and Sound Similarities with a HMM-based Divergence Measure », Sound and Music Computing (SMC2010), 2010
B. Caramiaux, F. Bevilacqua, N. Schnell « Analysing Gesture and Sound Similarities with a HMM-based Divergence Measure », Sound and Music Computing, Barcelona, 2010
B. Caramiaux « Modélisation du Geste Musical », Journées des Jeunes Chercheurs en Audition, Acoustique musicale et Signal audio, Paris, 2010
A. Dessein, A. Cont, G. Lemaitre « Real-time polyphonic music transcription with non-negative matrix factorization and beta-divergence », International Society for Music Information Retrieval (ISMIR), Utrecht, 2010
A. Dessein, A. Cont, G. Lemaitre « Real-time polyphonic music transcription with non-negative matrix factorization and beta-divergence », 6th Music Information Retrieval Evaluation eXchange (MIREX), Utrecht, 2010
A. Einbond, D. Schwarz « Spatializing Timbre with Corpus-Based Concatenative Synthesis, Wave Field Synthesis, CataRT, Max/MSP », International Computer Music Conference (ICMC), New York, 2010
S. Fdili Alaoui « Reconnaissance de qualités de mouvement/geste [dansé] et contrôle de modèles physiques pour la pédagogie de la danse », JJCAAS2010, Paris, 2010
V. Freour, T. Bianco, I. Cossette « Coordination of facial muscle activation, intraoral pressure and mouthpiece force during trumpet playing: preliminary findings », The 3rd International Conference on Music and Gesture, Montreal, 2010
G. Leslie, D. Schwarz, O. Warusfel, F. Bevilacqua, B. Zamborlin, P. Jodlowski « Grainstick: A Collaborative, Interactive Sound Installation », International Computer Music Conference (ICMC), New York, 2010
F. Maniatakos, G. Assayag, F. Bevilacqua, C. Agon « On architecture and formalisms for computer assisted improvisation », Sound and Music Computing conference, Barcelona, 2010
F. Maniatakos, C. Agon « On control of interaction for computer assisted improvisation: formulating advanced music queries with finite automata », Digital Music Research Network DMRN+5, London, 2010
F. Maniatakos, C. Agon « On a Graph Based Theoretical Framework for Computer Assisted Improvisation », Commment analyser l'improvisation ?, IRCAM Paris, 2010
N. Schnell, M. Suárez Cifuentes, J. Lambert « First Steps in Relaxed Real-Time Typo-Morphological Audio Analysis/Synthesis », Sound and Music Computing, Barcelone, 2010
D. Schwarz, N. Schnell « Descriptor-based Sound Texture Sampling », Sound and Music Computing (SMC), Barcelona, 2010
D. Schwarz, N. Schnell « A Modular Sound Descriptor Analysis Framework for Relaxed-real-time Applications », International Computer Music Conference (ICMC), New York, 2010
P. Tremblay, D. Schwarz « Surfing the Waves: Live Audio Mosaicing of an Electric Bass Performance as a Corpus Browsing Interface », New Interfaces for Musical Expression (NIME), Sydney, 2010
F. Bevilacqua, B. Zamborlin, A. Sypniewski, N. Schnell, F. Guédy « Continuous realtime gesture following and recognition », The 8th International Gesture Workshop, 2009
T. Bianco, V. FRÉOUR, N. Rasamimanana, F. Maniatakos, F. Bevilacqua « Parametric modeling of gestural co-articulation effects in music performance », The 8th International Gesture Workshop, 2009
J. Bloit, N. Rasamimanana, F. Bevilacqua « Towards morphological sound description using segmental models », DAFX, Milan, Italie, 2009
A. Bonardi, I. Truck « Designing a libray for computing [performances] with words », 4th International Conference on Intelligent Systems and Knowledge Engineering, Hasselt, 2009
B. Caramiaux, N. Schnell « Similarity Measures between Gesture and Sound », The International Summer School in Systematic, Comparative and Cognitive Musicology, Jyväskylä, 2009
B. Caramiaux « Similarités Morphologiques entre Geste et Son et leur Détection Temporelle », JJCAAS (Journées des Jeunes Chercheurs en Acoustique, Auditon et Signal audio), Marseille, 2009
M. Demoucron, N. Rasamimanana « Score based real-time performance with a virtual violin », DAFx, Milan, 2009
A. Dessein « La géométrie de l'information pour l'analyse et le traitement des flux audio », 5e Journées Jeunes Chercheurs en Audition, Acoustique musicale et Signal audio, Marseille, 2009
A. Einbond, D. Schwarz, J. Bresson « Corpus-Based Transcription as an Approach to the Compositional Control of Timbre », International Computer Music Conference (ICMC), Montreal, QC, 2009
S. Fdili Alaoui, C. Jacquemin, F. Bevilacqua « Reconnaissance du geste expert et contrôle de systèmes complexes : cas de l'interface entre le geste dansé et le rendu graphique par modèle physique », JJCAAS (Journées des Jeunes Chercheurs en Acoustique, Auditon et Signal, Marseille, 2009
S. Lemouton « Utilisation musicale de dispositifs de captation du mouvement de l'archet dans quelques oeuvres récentes : Bogenlied, StreicherKreis de Florence Baschet, Partita 1 de Philippe Manoury », 14èmes journées d'informatique musicale, Grenoble, 2009
G. Leslie, D. Schwarz, O. Warusfel, F. Bevilacqua, P. Jodlowski « Wavefield synthesis for interactive sound installations », 127th AES Convention, New-York, 2009
G. Nouno, A. Cont, G. Carpentier, J. Harvey « Making an orchestra speak », Sound and Music Computing, Porto, 2009
N. Schnell, A. Röbel, D. Schwarz, G. Peeters, R. Borghesi « MuBu & Friends –  Assembling Tools for Content Based Real-Time Interactive Audio Processing in Max/MSP », ICMC, Montreal, 2009
D. Schwarz, N. Schnell, S. Gulluni « Scalability in Content-Based Navigation of Sound Databases », International Computer Music Conference (ICMC), Montreal, 2009
D. Schwarz, N. Schnell « Sound Search by Content-Based Navigation in Large Databases », Sound and Music Computing (SMC), Porto, 2009
J. Bloit, X. Rodet « Short-time Viterbi for online HMM decoding : evaluation on a real-time phone recognition task », ICASSP, Las Vegas, 2008
A. Cont « ANTESCOFO: Anticipatory Synchronization and Control of Interactive Parameters in Computer Music », International Computer Music Conference, North Irland, 2008
T. Grosshauser, D. Schwarz, N. Schnell « Seeing the Inaudible : Descriptors for generating objective and reproducible data in real-time for musical instrument playing standard situations », Audio Engineering Society Convention (AES), Amsterdam, 2008
T. Koerselman, O. Larkin, B. Ong, N. Leroy, J. Lambert, D. Schwarz « SDIF Integration in i-Maestro Gesture Tools », 4th i-Maestro Workshop on Technology-Enhanced Music Education, co-located with the 8th International Conference on New Interfaces for Musical Expression (NIME), Genova, 2008
F. Maniatakos, C. Jacquemin « Towards an affective gesture interface for expressive music performance », NIME 08, Genova, 2008
N. Rasamimanana, F. Guédy, N. Schnell, J. Lambert, F. Bevilacqua « Three Pedagogical Scenarios using the Sound and Gesture Lab », 4th i-Maestro Workshop on Technology Enhanced Music Education, 2008
E. Schoonderwaldt, M. Demoucron, N. Rasamimanana « A setup for measurement of bowing parameters in bowed-string instrument performance », Acoustics08, Paris, 2008
D. Schwarz, R. Cahen, S. Britton « Principles and Applications of Interactive Corpus-Based Concatenative Synthesis », Journées d'Informatique Musicale (JIM), Albi, 2008
D. Schwarz, S. Cadars, N. Schnell « What Next? Continuation in Real-Time Corpus-Based Concatenative Synthesis », International Computer Music Conference (ICMC), Belfast, 2008
M. Vassilios-Fivos, C. Jacquemin « Towards an affective gesture interface for expressive music performance », NIME 08, Genova, 2008
F. Bevilacqua, F. Guédy, E. Fléty, N. Leroy, N. Schnell « Wireless sensor interface and gesture-follower for music pedagogy », International Conference on New Interfaces for Musical Expression, New York, 2007
A. Cont, S. Dubnov, D. Wessel « Realtime Multiple-pitch and Multiple-instrument Recognition For Music Signals using Sparse Non-negative Constraints », Digital Audio Effects (DAFx), Bordeaux, 2007
A. Cont, S. Dubnov, G. Assayag « GUIDAGE: A Fast Audio Query Guided Assemblage », International Computer Music Conference, Copenhagen, 2007
A. Cont « Real-time Transcription of Music Signals : MIREX2007 Submission Description », ISMIR 2007 / MIREX 2007, Vienna, 2007
A. Cont, D. Schwarz, N. Schnell, C. Raphael « Evaluation of Real-Time Audio-to-Score Alignment », International Conference on Music Information Retrieval (ISMIR), Vienna, 2007
S. Dubnov, A. Cont, G. Assayag « Audio Oracle: A New Algorithm for Fast Learning of Audio Structures », International Computer Music Conference, Copenhague, 2007
F. Guédy, J. Bresson, G. Assayag « Musique Lab 2 - Un environnement d'aide à la pédagogie musicale », Journées d'Informatique Musicale - JIM'07, 2007
F. Guédy, N. Leroy, F. Bevilacqua, T. Grosshauser, N. Schnell « Pedagogical experimentation using the Sound and Gesture Lab », 3rd i-Maestro Workshop on Technology-Enhanced Music Education, Barcelone, 2007
C. Jacquemin, R. Ajaj, R. Cahen, Y. Ollivier, D. Schwarz « Plumage: Design d'une interface 3D pour le parcours d'échantillons sonores granularisés », Conférence Francophone sur l'Interaction Homme-Machine IHM, Paris, 2007
A. Jensenius, A. Camurri, N. Castagné, E. Maestre, J. Malloch, D. McGilvray « Panel: The Need Of Formats For Streaming And Storing Music-Related Movement And Gesture Data », International Computer Music Conference (ICMC), Copenhagen, 2007
A. Jensenius, A. Camurri, N. Castagné, E. Maestre, J. Malloch, D. McGilvray « A Summary of Formats for Streaming and Storing Music-Related Movement and Gesture Data », ENACTIVE/07 4th International Conference on Enactive Interfaces, Grenoble, 2007
K. Ng, O. Larkin, T. Koerselman, B. Ong, D. Schwarz, F. Bevilacqua « The 3D Augmented Mirror: Motion Analysis for String Practice Training », International Computer Music Conference (ICMC), Copenhagen, 2007
N. Rasamimanana, D. Bernardin, M. Wanderley, F. Bevilacqua « String Bowing Gestures at Varying Bow Stroke Frequencies: A Case Study (abstract) », Gesture Workshop 2007, 2007
D. Schwarz, S. Britton, R. Cahen, T. Goepfer « Musical Applications of Real-Time Corpus-Based Concatenative Synthesis », International Computer Music Conference (ICMC), Copenhaguen, 2007
J. Thiebaut, J. Bello, D. Schwarz « How Musical are Images? From Sound Representation to Image Sonification: An Eco Systemic Approach », International Computer Music Conference (ICMC), Copenhaguen, 2007
F. Bevilacqua, N. Rasamimanana, E. Fléty, S. Lemouton, F. Baschet « The augmented violin project: research, composition and performance report », 6th International Conference on New Interfaces for Musical Expression (NIME 06), Paris, 2006
A. Cont « Realtime Audio to Score Alignment for Polyphonic Music Instruments Using Sparse Non-negative constraints and Hierarchical HMMs », IEEE International Conference in Acoustics and Speech Signal Processing (ICASSP), Toulouse, 2006
A. Cont « Realtime Multiple Pitch Observation using Sparse Non-negative Constraints », International Symposium on Music Information Retrieval (ISMIR), Victoria, 2006
A. Cont, S. Dubnov, G. Assayag « A framework for Anticipatory Machine Improvisation and Style Imitation », Anticipatory Behavior in Adaptive Learning Systems (ABiALS), Rome, 2006
N. Leroy, E. Fléty, F. Bevilacqua « Reflective Optical Pickup For Violin », 6th International Conference on New Interfaces for Musical Expression, 2006
N. Rasamimanana, F. Bevilacqua « Studies of bowing gesture and applications to music performance », International Conference on Music and Gesture, 2006
N. Schnell, F. Bevilacqua, D. Schwarz, N. Rasamimanana, F. Guédy « Technology and Paradigms to Support the Learning of Music Performance », 2nd i-Maestro Workshop on Technology Enhanced Music Education, Leeds, 2006
N. Schnell, D. Schwarz,, M. Remy « X-Micks – Interactive Content Based Real-Time Audio Processing », 9th International Conference on Digital Audio Effects (DAFx-06), Montreal, 2006
E. Schoonderwaldt, N. Rasamimanana, F. Bevilacqua « Combining accelerometer and video camera: Reconstruction of bow velocity profiles », 6th International Conference on New Interfaces for Musical Expression, 2006
D. Schwarz, G. Beller, B. Verbrugghe, S. Britton « Real-Time Corpus-Based Concatenative Synthesis with CataRT », 9th International Conference on Digital Audio Effects (DAFx), Montreal, 2006
D. Schwarz, A. Cont, N. Orio « Score Following at Ircam », 7th International Conference on Music Information Retrieval (ISMIR), Victoria, 2006
G. Beller, D. Schwarz, T. Hueber, X. Rodet « Hybrid Concatenative Synthesis In The Intersection of Speech and Music », JIM, 2005
F. Bevilacqua, R. Muller, N. Schnell « MnM: a Max/MSP mapping toolbox », New Interfaces for Musical Expression, Vancouver, 2005
F. Bevilacqua, R. Muller « A Gesture follower for performing arts », Gesture Workshop, 2005
A. Cont, D. Schwarz, N. Schnell « Training Ircam's Score Follower », IEEE International Conference on Acoustics, Speech, and Signal Processing, Philadelphia, 2005
N. Rasamimanana, E. Fléty, F. Bevilacqua « Gesture Analysis of Violin Bow Strokes (abstract) », Gesture Workshop, 2005
N. Schnell, D. Schwarz « Gabor, Multi-Representation Real-Time Analysis/Synthesis », COST-G6 Conference on Digital Audio Effects (DAFx), Madrid, 2005
N. Schnell, R. Borghesi, D. Schwarz, F. Bevilacqua, R. Müller « FTM — Complex data structures for Max », International Computer Music Conference (ICMC), Barcelona, 2005
D. Schwarz, A. Cont, N. Schnell « From Boulez to Ballads: Training Ircam's Score Follower », International Computer Music Conference (ICMC), Barcelona, 2005
D. Schwarz « Current Research in Concatenative Sound Synthesis », International Computer Music Conference (ICMC), Barcelona, 2005
F. Bevilacqua, E. Fléty « Captation et analyse du mouvement pour l'interaction entre danse et musique », Rencontres Musicales Pluridisciplinaires - le corps & la musique, Lyon, 2004
A. Cont, D. Schwarz, N. Schnell « Implicit Learning of Musical Performance Parameters : Training Ircam's Score Follower », AAAI Symposium 2004 Style and Meaning in Language, Art, Music, and Design, Washington, 2004
E. Fléty, N. Leroy, J. Ravarini, F. Bevilacqua « Versatile sensor acquisition system utilizing Network Technology », International Conference on New Interfaces for Musical Expression (NIME), Hamamatsu, 2004
D. Schwarz, N. Orio, N. Schnell « Robust Polyphonic Midi Score Following with Hidden Markov Models », International Computer Music Conference (ICMC), Miami, 2004
N. Orio, S. Lemouton, D. Schwarz, N. Schnell « Score Following: State of the Art and New Developments », New Interfaces for Musical Expression (NIME), Montreal, 2003
N. Schnell, B. Marc « Introducing Composed Instruments : Technical and Musicological Implications », International Conference on New Interfaces for Musical Expression (NIME 2002), Dublin, 2002

Phd Thesis

T. Bianco « Gestural control in trumpet performance: experiments and modeling. », Université Pierre et Marie Curie (UPMC), 2012
B. Caramiaux « Studies on the Gesture – Sound Relationship for Musical Performance », Université Université Pierre et Marie Curie (Paris 6), 2012
F. Maniatakos « Graphs and Automata for the Control of Interaction in Computer Music Improvisation. », Thèse de Doctorat de l'Université Pierre et Marie Curie, 2012
J. Bloit « Interaction musicale et geste sonore : modélisation temporelle de descripteurs audio », Paris 6, 2010
A. Bonardi « Vers des environnements homme-machine pour ressaisir les intentions dans la création scénique : Habilitation à diriger des recherches - Réflexions sur la médiation des nouvelles technologies dans la conception de spectacles vivants et leur recréation par les spectateurs », Université de Reims Champagne Ardenne, 2008
A. Cont « Modeling Musical Anticipation: From the time of music to the music of time », University of Paris 6 (UPMC), and University of California San Diego (UCSD), 2008
N. Rasamimanana « Geste instrumental du violoniste en situation de jeu : analyse et modélisation », Université Pierre et Marie Curie (Paris 6), 2008
D. Schwarz « Data-Driven Concatenative Sound Synthesis », Université Paris 6 - Pierre et Marie Curie, 2004

Training course reports

Q. Pyanet « Contrôle gestuel de la synthèse sonore : vers une évaluation des gestes d'utilisateurs », Université Pierre et Marie Curie - IRCAM [Master ATIAM], 2012
J. Françoise « Realtime Segmentation and Recognition of Gestures using Hierarchical Markov Models », UPMC - Ircam [Master ATIAM], 2011
A. Masurelle « Towards a gestural control of environmental sound texture synthesis », UPMC [master ATIAM], 2011
C. Maestracci « Architecture modulaire pour le controle gestuel », ECE [Ingénieur en électronique], 2010
A. Dessein « Incremental multi-source recognition with non-negative matrix factorization », Université Pierre et Marie Curie [Master's Thesis], 2009
P. Machart « Morphological Segmentation », UPMC / IRCAM [Master ATIAM], 2009
B. Caramiaux « "Gestification" du son : mapping adaptatif geste/son dans un contexte d'écoute et de performance musicale », Université Pierre et Marie Curie (Paris 6) [Master ATIAM], 2008
S. Cadars « Modélisation temporelle et synthèse concatenative de boucles rythmiques », Universitée Pierre et Marie Curie [ATIAM], 2007
A. Sypniewski « Suivi du geste pour l'interaction musicale », Université Pierre et Marie Curie [Mémoire de Stage de Master 2eme année], 2007
B. Verbrugghe « Stratégies de visualisation et de navigation pour le contrôle gestuel de la synthèse par corpus sonore », Université Paris 6 - Pierre et Maris Curie [Rapport de stage de Master 2 - ATIAM], 2006
J. Bloit « Analyse temps réel de la voix pour le contrôle de synthèse audio », UPMC (Paris 6) [Master-2/SAR parcours ATIAM], 2005
A. Devergie « Segmentation of Bowstrokes Using the Hidden Markov Model », INP Grenoble [Master 2R ICA AST], 2005
F. Leau « Human Gesture Segmentation Applied to Dance Performances », ENSEA, Cergy-Pontoise section STC [Pro jet de Fin d'Etudes], 2005
J. Rachedi « Reconnaissance et classification de phonèmes », Ircam [DEA ATIAM], 2005
A. Cont « Improvement of Observation Modeling for Score Following », University of Paris 6, IRCAM [DEA ATIAM], 2004
H. Kaprykowsky « Time modeling in Hidden Markov Models », Universität Karlsruhe, Allemagne [stage], 2004
R. Muller « Human Motion Following using Hidden Markov Models », INSA Lyon, Laboratoire CREATIS [DEA Images et Systèmes], 2004
N. Rasamimanana « Gesture Analysis of Bow Strokes Using an Augmented Violin », Universite Pierre et Marie Curie, Paris VI [DEA ATIAM], 2004
T. Pellegrini, R. Duée, L. Georges « Suivi de Voix Parlée grace aux Modèles de Markov Cachés », IRCAM [DEA ATIAM], 2003