Sensors, Interfaces, and Interactive Machine Learning for Music
Objectives
Upon completion of this training program, participants will have acquired the theoretical and practical notions for realization of interactive sound and music systems using R-IoT sesnsors (9-axis sensor with accelerometres, WIFI), as well as pattern-recognition systems. Programming interfaces such as the Arduino or R-IoT will also be addressed
Public
Composers, musicians, performers, teachers, designers
Prerequisites
Good understanding of programming in Max or have successfully completed the course Max Initiation.
Educational Resources and Techniques
Classroom equipped with computers with all the necessary software installed, headphones, and MIDI keyboards
Class Format: training alternates between presentations, explanations on theory, studying examples to analyze, and hands-on exercises
Didactic Materials: video-projected presentations and PDF documents
Participants will have kits available made up of a R-IoT card and two physiological sensors (respiration, heartbeat). The R-IoT module is included in the cost of the training (value: 99 euros).
Supervision and Assessment
Welcome the first day of training beginning at 9:45am
Attendance controlled: signature of an attendance sheet required every morning and afternoon
Assessment: hands-on exercises throughout the course
A certificate at the end of the program is given to each participant with the results of the exam
Training Period and Organization
24 hours of training. Tuesday-Friday, May 9-12, 2023. 10am-1pm/2:30pm-5:30pm
10 students maximum
This training program will be held at IRCAM on-site in accordance with local sanitary guidelines and measures in place at the current time. These guidelines and measures may change. In the event that IRCAM cannot physically welcome students for a program that requires face-to-face instruction, the program will be cancelled.
Program
Tuesday
| Morning | Overview of different types of sensors, interfaces, and suppliers. The particular case of wireless sensors Hands-on exercises: use the programming environments Arduino and Energia |
| Afternoon | Hands-on exercises : master the basics of programming in Arduino and Energia, first simple examples of coding, uploading code towards the Arduino and R-IoT interfaces. |
Wednesday
| Morning | Recuperation and processing of sensor data in Max (Arduino and R-Iots) Filtering (average, median filter, low pass filter) and normalization |
| Afternoon | Implementation of a mapping system Direct use of sensor data with simple sound processes. Synthesis control, playback of sound files |
Thursday
| Morning | Hands-on exercises: create a sonification system: physiological capture (heart beats, breathing) via sensors connected to the R-IoT interface, recuperation of data and sonification in Max |
| Afternoon | Introduction to the MuBu library and Gesture follower. |
Friday
| Morning | Theory: introduction to "machine learning" with the Mubu for Max library allowing advanced applications for gesture and motion recognition. Presentation of examples of use in sonic and artistic projects (performance art) |
| Afternoon | Hands-on exercises: produce a system with sensors connected to the R-IoT interface, learning, and recognition in Max with MuBu |