How can I use multi gpu on stable diffusion pipeline?

ViktorsDe
Sat, 03 Dec 2022 11:50:05 +0000

If could be nice to run batch img_to_img on two GPUs. It could be possible by setting CUDA_VISIBLE_DEVICES to a number of the specific GPU before the launch of each WebUI instance.
127.0.0.1:7860 on GPU 0 and 127.0.0.1:7861 on GPU 1, for example.

Will have to try it out.