Can StableDiffusionBrushNetPipeline be connected to the openpose ControlNet like the StableDiffusionControlNetPipeline?

[woshiodoman]

Can StableDiffusionBrushNetPipeline be connected to the openpose ControlNet like the StableDiffusionControlNetPipeline? Cause I want to maintain the original image's pose while using BrushNet.

[MasaiahHan]

Hi, I have already implement brushnet with comtrolnet pipeline, just need to modify either brushnetpipline or controller pipeline!

[woshiodoman]

Hi, I have already implement brushnet with comtrolnet pipeline, just need to modify either brushnetpipline or controller pipeline!

Thank you very much for your reply. May I ask which part of the StableDiffusionBrushNetPipeline code you have modified?

[MasaiahHan]

Hi, I have already implement brushnet with comtrolnet pipeline, just need to modify either brushnetpipline or controller pipeline!

Thank you very much for your reply. May I ask which part of the StableDiffusionBrushNetPipeline code you have modified?

Actually StableDiffusionBrushNetPipeline is writing based on StableDiffusionControlNetPipeline, so you just need to add additional controlnet imag condition, processor, controlnet(forward) according to the StableDiffusionControlNetPipeline source code.

[xduzhangjiayu]

Hi, I have already implement brushnet with comtrolnet pipeline, just need to modify either brushnetpipline or controller pipeline!

Thank you very much for your reply. May I ask which part of the StableDiffusionBrushNetPipeline code you have modified?

Actually StableDiffusionBrushNetPipeline is writing based on StableDiffusionControlNetPipeline, so you just need to add additional controlnet imag condition, processor, controlnet(forward) according to the StableDiffusionControlNetPipeline source code.

Hi,
After you combining SD + BrushNet + ControlNet, i am curious that the performance is still good? Have you tried it?
Appreciate for the reply!

[TianyangHan]

us that the performance is still good? Have

The performance is great as long as you implement it properly.

[xduzhangjiayu]

us that the performance is still good? Have

The performance is great as long as you implement it properly.

Thanks! Is there the open source code for this (BrushNet + ControlNet) in github?

[henbucuoshanghai]

no