[D] Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction

​

https://preview.redd.it/12c372dv0fsc1.png?width=2833&format=png&auto=webp&s=0d88f98929854f3de18b8c623d3aff5a7ed14b79

**Abstract:**

>We present Visual AutoRegressive modeling (VAR), a new generation paradigm that redefines the autoregressive learning on images as coarse-to-fine "next-scale prediction" or "next-resolution prediction", diverging from the standard raster-scan "next-token prediction". This simple, intuitive methodology allows autoregressive (AR) transformers to learn visual distributions fast and generalize well: VAR, for the first time, makes AR models surpass diffusion transformers in image generation. On ImageNet 256x256 benchmark, VAR significantly improve AR baseline by improving Frechet inception distance (FID) from …

abstract image image generation images learn machinelearning methodology modeling next paradigm prediction resolution scalable scale simple standard token transformers via visual