Use Hugging Face's ControlNet

Source Code
Explore Other Examples

Hugging Face's ControlNet allows to condition Stable Diffusion on various modalities. In this example we condition on edges detected by the Canny edge detector to keep our shape intact while generating an image with Stable Diffusion. This generates a new image based on the text prompt, but that still retains the structure of the control image. We visualize the whole generation process with Rerun.

The visualizations in this example were …

ai code controlnet diffusion edge example examples explore face hugging face image machinelearning opensource prompt python stable diffusion text while