[N] Meta/Facebook releases CM3leon, a more efficient, state-of-the-art generative model for text and images

**Abstract**

We present CM3Leon (pronounced “Chameleon”), a retrieval-augmented, tokenbased, decoder-only multi-modal language model capable of generating and infilling both text and images. CM3Leon uses the CM3 multi-modal architecture but additionally shows the extreme benefits of scaling up and tuning on more diverse instruction-style data. It is the first multi-modal model trained with a recipe adapted from text-only language models, including a large-scale retrieval-augmented pretraining stage and a second multi-task supervised fine-tuning (SFT) stage. It is also a general-purpose model that …

abstract architecture art benefits cm3leon data decoder diverse facebook generative images language language model machinelearning meta releases retrieval scaling scaling up shows state text