Papers Read on AI

Papers Read on AI header image 1
September 5, 2022  

Musika! Fast Infinite Waveform Music Generation

September 5, 2022

Fast and user-controllable music generation could enable novel ways of composing or performing music. However, state-of-the-art music generation systems require large amounts of data and computational resources for training, and are slow at inference. This makes them impractical for real-time interactive use. In this work, we introduce Musika, a music generation system that can be trained on hundreds of hours of music using a single consumer GPU, and that allows for much faster than real-time generation of music of arbitrary length on a consumer CPU. We perform quantitative evaluations to assess the quality of the generated samples and showcase options for user control in piano and techno music generation. We release the source code and pretrained autoencoder weights at, such that a GAN can be trained on a new music domain with a single GPU in a matter of hours.

2022: Marco Pasini, Jan Schl├╝ter