How to make a variation from a depth map.

[tykim9999]

Inspired by this tweet. https://twitter.com/justLV/status/1605280983468584962

He made a great variations from a depth map. Do you guys know how to do it?

[thygate]

He's using the stable diffusion 2.0 depth conditional model

For automatic1111's webui, see the wiki section on depth-guided-model for instructions :

• download the 512-depth-ema.ckpt checkpoint
• place it in models/Stable-diffusion
• grab the config and place it in the same folder as the checkpoint
• rename the config to 512-depth-ema.yaml
• select the new checkpoint from the UI

The depth-guided model will only work in img2img tab.

[thygate]

There is a blender addon that uses it to texture an entire scene at once.

[tykim9999]

Thank you! In img2img tab, the depth map as a input right? How's the denoising strength? I tried 0.7 but it fills it with all white.

[thygate]

I think I misunderstood, and you're supposed to just feed it a regular image, I get the bad output too when using an actual depthmap..

[tykim9999]

Thanks :) It works well with a regular image.