Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request - ControlNet Pose Parameters Node #21

Open
ronan36880 opened this issue Oct 22, 2024 · 2 comments
Open

Feature Request - ControlNet Pose Parameters Node #21

ronan36880 opened this issue Oct 22, 2024 · 2 comments

Comments

@ronan36880
Copy link

ronan36880 commented Oct 22, 2024

First of all, apologies if this issue should instead be moved over to the https://github.com/Acly/krita-ai-diffusion/ repo.

I noticed that commit 9a9cbe7, which introduced the KritaStyle node, has the message High level krita parameters (style, control-net, ip-adapter), but it only introduced style settings.

Would it be possible to add a node similar to Krita Image Layer, where the user could pick vector layer in Krita and the custom workflow receives the a pose vector ready to input into ControlNet?

@Acly
Copy link
Owner

Acly commented Oct 22, 2024

That should already work (with Krita Image Layer). ControLNet expects a pixel image with pose vectors rendered on black background.

I wanted to implement the high level UI used by the plugin for control layers too, as a more convenient way to select control-net model and parameters. I ended up removing the code again because it wasn't possible to detect which model architecture (SD1.5, SDXL, Flux...) to select at workflow generation time.

@ronan36880
Copy link
Author

ronan36880 commented Oct 22, 2024

That should already work (with Krita Image Layer). ControLNet expects a pixel image with pose vectors rendered on black background.

This does work, but when using the workflow mode, I don't see extra UI elements that let me add a pose skeleton to a vector layer directly from there. I'm guessing that would be part of the high level UI you mentioned?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants