Hybrid Spectrogram and Waveform Source Separation. (arXiv:2111.03600v3 [eess.AS] UPDATED)

Source separation models either work on the spectrogram or waveform domain.
In this work, we show how to perform end-to-end hybrid source separation,
letting the model decide which domain is best suited for each source, and even
combining both. The proposed hybrid version of the Demucs architecture won the
Music Demixing Challenge 2021 organized by Sony. This architecture also comes
with additional improvements, such as compressed residual branches, local
attention or singular value regularization. Overall, a 1.4 dB improvement of …

arxiv hybrid spectrogram