NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Rates. (arXiv:2206.08545v1 [eess.AS])

Web: http://arxiv.org/abs/2206.08545

Conventionally, audio super-resolution models fixed the initial and the
target sampling rates, which necessitate the model to be trained for each pair
of sampling rates. We introduce NU-Wave 2, a diffusion model for neural audio
upsampling that enables the generation of 48 kHz audio signals from inputs of
various sampling rates with a single model. Based on the architecture of
NU-Wave, NU-Wave 2 uses short-time Fourier convolution (STFC) to generate
harmonics to resolve the main failure modes of NU-Wave, and …

arxiv audio general model neural sampling