[P] Implementation of MagicMix from ByteDance researchers, - New way to interpolate concepts with much more natural, geometric coherency (implemented with Stable Diffusion!)

Hi. Today I've came across this interesting paper [https://arxiv.org/abs/2210.16056](https://arxiv.org/abs/2210.16056) that proposes interesting method to combine semantics of text and image in diffusion process.

In short, this mixes "layout" with "content", however unlike style transfer,


>"...semantic mixing aims to fuse multiple semantics into one single object."

I was surprised by the examples they showed, so I wanted to try it but the code wasn't available. I've implemented the method myself, and I wanted to share it here!

[https://github.com/cloneofsimo/magicmix](https://github.com/cloneofsimo/magicmix)

[ Layout of …

bytedance diffusion implementation machinelearning natural researchers stable diffusion