Camb AI Releases MARS5 TTS: A Novel Open Source Text to Speech Model for Insane Prosody

This innovative model offers exceptional prosodic control and voice cloning capabilities, requiring less than 5 seconds of audio input. The system employs a two-stage architecture consisting of a 750M Auto-Regressive (AR) model and a 450M Non-Auto-Regressive (NAR) model. MARS5 utilizes a BPE tokenizer, enabling precise control over punctuation, pauses, and stops, thus advancing the field of speech synthesis

The model’s architecture follows a unique two-stage AR-NAR pipeline. In the initial stage, an autoregressive transformer model generates coarse (L0) encodec speech …

architecture audio auto camb ai capabilities cloning control enabling input machinelearningnews novel open source releases speech stage text tts voice voice cloning