Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

gather_norm issue #527

Open
YanzuoLu opened this issue Nov 20, 2024 · 2 comments
Open

gather_norm issue #527

YanzuoLu opened this issue Nov 20, 2024 · 2 comments
Assignees
@zRzRzRzRzRzRzR

Comments

@YanzuoLu
Copy link

YanzuoLu commented Nov 20, 2024 •
edited
Loading

As the comments I write here, I'm wondering is the gather_norm settings during training are identical to the configs given in this repo?

I see that CogVideoX-1.0(2B & 5B) is using gather_norm for encoder only, so that the decoder can be run in frame-wise manner.

But in CogVideo-1.5 it seems that both encoder and decoder are using gather_norm, does it indicate that framewise decoding is always at loss and cannot be aligned?

Thanks for your time.
@zRzRzRzRzRzRzR zRzRzRzRzRzRzR self-assigned this Nov 20, 2024
@YanzuoLu YanzuoLu mentioned this issue Nov 21, 2024
Closed
2 tasks
@a-r-r-o-w
Copy link

Sorry for the delay! I have responded in the diffusers thread

@YanzuoLu YanzuoLu reopened this Nov 21, 2024
@YanzuoLu
Copy link
Author

@zRzRzRzRzRzRzR Any updates on this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zRzRzRzRzRzRzR zRzRzRzRzRzRzR

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@YanzuoLu @a-r-r-o-w @zRzRzRzRzRzRzR