LiveBand: Live Accompaniment Generation in the Audio Domain

LiveBand is a real-time music accompaniment generation system that utilizes a causal transformer generator trained in the continuous latent space of a pre-trained causal audio autoencoder. It operates under strict causal constraints, enabling high-fidelity audio generation without future context, achieving superior performance on a multi-instrument music accompaniment benchmark in terms of audio quality, beat alignment, and mix adherence. This advancement is significant for practitioners as it facilitates real-time music generation on consumer hardware, enhancing interactive applications in live performance settings.