Perceptual and technical aspects of live coding music performance using statistical learning
Övrigt konferensbidrag, 2021

Live coding is the creative act of interactive code evaluations and multimodal assessments during the execution of a running program. In the context of music-making, the composer-programmer employs auditory percepts by means of appreciation and planning of present and future code evaluations. Thus, a weave of musical imagery and music listening facilitates the interplay between novel code evaluations and rigidly structured computations. Machine listening has been shown to be a prominent approach to control live coding and is typically correlated with perceptual assessments. Such developments have enabled the advent of statistical analysis of sequential dependencies between acoustical features during performance. Here, we will present a demo of a live coding session based on an OSC protocol binding between SuperCollider and Python libraries for statistical learning. The system presented can perform window-based feature transformation of the extracted acoustical features, which consequently modify numerical parameters of the composition. A typical window size may be hundreds of milliseconds long, so that is multiple times the window size of feature extraction. This is done by storing the numerical values of the extracted features in plain text files. The approach used here aims to facilitate the understanding of the user and promote a human-centric approach to AI. Possible applications may be used for educational purposes and live music performances.

music performance

statistical learning

live coding

Författare

Georgios Diapoulis

Chalmers, Data- och informationsteknik, Interaktionsdesign

3rd International Conference Digital Culture & AudioVisual Challenges Interdisciplinary Creativity in Arts and Technology (DCAC2021), EASTN-DC Open Day Presentations
Corfu, Greece,

Ämneskategorier

Musikvetenskap

Musik

Datavetenskap (datalogi)

Relaterade dataset

Live coding demo @ DCAC2021- EASTN-DC [dataset]

URI: Live coding is the creative act of interactive code evaluations and multimodal assessments during the execution of a running program. In the context of music-making, the composer-programmer employs auditory percepts by means of appreciation and planning of present and future code evaluations. Thus, a weave of musical imagery and music listening facilitates the interplay between novel code evaluations and rigidly structured computations. Machine listening has been shown to be a prominent approach to control live coding and is typically correlated with perceptual assessments. Such developments have enabled the advent of statistical analysis of sequential dependencies between acoustical features during performance. Here, we will present a demo of a live coding session based on an OSC protocol binding between SuperCol￾lider and Python libraries for statistical learning. The system presented can perform window-based feature transformation of the extracted acoustical features, which consequently modify numerical parameters of the composition. A typical window size may be hundreds of milliseconds long, so that is multiple times the window size of feature extraction. This is done by storing the numerical values of the extracted features in plain text files. The approach used here aims to facilitate the understanding of the user and promote a human-centric approach to AI. Possible applications may be used for educational purposes and live music performances.

Mer information

Senast uppdaterat

2021-11-15