Latent Timbre Synthesis: Audio-based Variational Auto-Encoders for Music Composition Applications
Artikel i vetenskaplig tidskrift, 2020

We present the Latent Timbre Synthesis, a new audio synthesis method using deep learning. The synthesis method allows composers and sound designers to interpolate and extrapolate between the timbre of multiple sounds using the latent space of audio frames. We provide the details of two Variational Autoencoder architectures for the Latent Timbre Synthesis and compare their advantages and drawbacks. The implementation includes a fully working application with a graphical user interface, called interpolate_two, which enables practitioners to generate timbres between two audio excerpts of their selection using interpolation and extrapolation in the latent space of audio frames. Our implementation is open source, and we aim to improve the accessibility of this technology by providing a guide for users with any technical background. Our study includes a qualitative analysis where nine composers evaluated the Latent Timbre Synthesis and the interpolate_two application within their practices.

Författare

Kivanc Tatar

Simon Fraser University

Daniel Bisig

Zurich University of the Arts

Philippe Pasquier

Simon Fraser University

Neural Computing and Applications

0941-0643 (ISSN) 1433-3058 (eISSN)

Vol. 33 The Special Issue of Neural Computing and Applications: “Networks in Art, Sound and Design.” 67-84

Ämneskategorier

Medieteknik

Systemvetenskap, informationssystem och informatik med samhällsvetenskaplig inriktning

Datavetenskap (datalogi)

DOI

10.1007/s00521-020-05424-2

Mer information

Senast uppdaterat

2023-10-06