[D] Dreambooth Stable Diffusion training in just 12.5 GB VRAM, using the 8bit adam optimizer from bitsandbytes along with xformers while being 2 times faster.

Tested on Nvidia A10G, took 15-20 mins to train. We can finally run on colab notebooks.

Code: [https://github.com/ShivamShrirao/diffusers/blob/main/examples/dreambooth/](https://github.com/ShivamShrirao/diffusers/blob/main/examples/dreambooth/)

More details [https://github.com/huggingface/diffusers/pull/554#issuecomment-1259522002](https://github.com/huggingface/diffusers/pull/554#issuecomment-1259522002)

https://preview.redd.it/y19vz2ecpeq91.png?width=949&format=png&auto=webp&s=8e5c8f0bf0b4b6dd1ae92fb6df5713d9bb094096

8bit adam diffusion machinelearning stable diffusion training