Writing Timed Interactions and Musical Synchronizations
In a context of the performance of contemporary works with instrumental and computer parts, score following is a technique often used for the synchronization of the electronic accompaniment with a solo performer. An augmented score is recorded in the computer using a specific format that contains both the essential elements of the instrumental score a specification for the computer part written in a dedicated musical language. During the performance, the analysis in real-time of the performer’s sound and/or of the captured movement is aligned with the symbolic score. At every instant throughout the performance, the score follower’s algorithm determines the location in the score and synchronizes the processes programmed in the electronic part of the work.
The score follower (Antescofo) now includes a real-time reactive, synchronous and timed programming language, enabling the definition of complex interactions between performers and live electronics. The use of this technology makes it possible to ensure coherent writing between the electronic and instrumental parts of the composition, and a synchronous and polyphonic performance of electronic modules with musicians in real-time. Its development will include an adaptation for different families of musical instruments and recognition of musical forms as well as the extension of dedicated expressive structures to address various paradigms for the electronic parts.
This system includes two important issues in computer music: the recognition and extraction of musical data in real-time (artificial listening) from an audio signal and reactive synchronous programming for writing time and interaction.
IRCAM's team: Musical Representations .