Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About model size and human pose #14

Open
CS123n opened this issue Oct 26, 2023 · 2 comments
Open

About model size and human pose #14

CS123n opened this issue Oct 26, 2023 · 2 comments

Comments

@CS123n
Copy link

CS123n commented Oct 26, 2023

Thanks for your wonderful job.
I want to ask two questiones:

  1. If I want a larger controlnet-xs, do I only need to change the contol_model_ratio configuration?
  2. Does your pipeline work well for human poses?
@Sipirius
Copy link
Collaborator

Sipirius commented Oct 26, 2023

1: With the current version, the only thing you need to change is indeed the control_model_ratio
2: We did not explicitly train on human poses, but there is no conceptual difference, so it should work just as well

cheers

@CS123n
Copy link
Author

CS123n commented Oct 28, 2023

Thanks for your feedback!
I have two more questiones:

  1. Is learning embeddings important? It causes the initialization state to be incorrect.
  2. What amount of data and number of steps are needed to train ControlNet-xs?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants