Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversion

arXiv:2402.10009v1 Announce Type: cross
Abstract: Editing signals using large pre-trained models, in a zero-shot manner, has recently seen rapid advancements in the image domain. However, this wave has yet to reach the audio domain. In this paper, we explore two zero-shot editing techniques for audio signals, which use DDPM inversion on pre-trained diffusion models. The first, adopted from the image domain, allows text-based editing. The second, is a novel approach for discovering semantically meaningful editing directions without supervision. When applied …

arxiv audio audio editing cs.lg cs.sd ddpm editing eess.as text type unsupervised zero-shot