Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ti2v-models #39

Open
YIFanH opened this issue Nov 26, 2024 · 5 comments
Open

ti2v-models #39

YIFanH opened this issue Nov 26, 2024 · 5 comments

Comments

@YIFanH
Copy link

YIFanH commented Nov 26, 2024

HI, thank you for your excellent work in open source,I want to try using the model ability of the video below, but I couldn't find the corresponding model download link, do you have any open source plans this week?

@hyang0511
Copy link
Contributor

The model will be online today.

@maazel-rhymes
Copy link

HI, thank you for your excellent work in open source,I want to try using the model ability of the video below, but I couldn't find the corresponding model download link, do you have any open source plans this week?

The model is now public.

@YIFanH
Copy link
Author

YIFanH commented Nov 27, 2024

thanks

@ai-anchorite
Copy link

ai-anchorite commented Nov 27, 2024

thanks for releasing!

be interesting to see other people's experiences.

I'm finding it spiking to 30GB vram during the pre-inference phase (with off-load), which is taking ages,
then inference acts very similar to t2v at about 8GB. The vae and masking phase doubles the total generation time however.

Around 90 minutes on a 3090.

Looks like input images need to be landscape ratio (16:9). the portrait i tried on the test-run (doh) was zoomed in, so assume a hard crop.

Very curious about prompting. Are long, descriptive prompts required?

@xiao2mo
Copy link

xiao2mo commented Nov 28, 2024

Hi, is there any chance for training code release?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants