Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Video embedding does not match the model #1

Open
jameslovestudy opened this issue Nov 21, 2023 · 2 comments
Open

Video embedding does not match the model #1

jameslovestudy opened this issue Nov 21, 2023 · 2 comments

Comments

@jameslovestudy
Copy link

Thanks a lot for the open source. I'm new to deep learning and I'm having problems running the model after processing the dataset. Using visual_frontend to extract the video embedding and store it as npz, the final dimension I get is n×512, while the dimension of ImageNet input is required to be 256, may I know how to solve this problem without affecting the training result.

@zexupan
Copy link
Owner

zexupan commented Nov 21, 2023

Hi, in the model, you can change
self.v_ds = nn.Linear(256, 256, bias=False)
to
self.v_ds = nn.Linear(512, 256, bias=False)

@jameslovestudy
Copy link
Author

Thanks for the reply. I change N which is the parameter of the video decoder to 512 as well and it works fine.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants