Leveraging Symmetrical Convolutional Transformer Networks for Speech to Singing Voice Style Transfer. (arXiv:2208.12410v1 [cs.SD])

In this paper, we propose a model to perform style transfer of speech to
singing voice. Contrary to the previous signal processing-based methods, which
require high-quality singing templates or phoneme synchronization, we explore a
data-driven approach for the problem of converting natural speech to singing
voice. We develop a novel neural network architecture, called SymNet, which
models the alignment of the input speech with the target melody while
preserving the speaker identity and naturalness. The proposed SymNet model is
comprised …

arxiv networks speech style transfer transfer transformer voice