New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LargeDiT T2i - how much GPU memory is needed for sampling? #185

Open

SapirW opened this issue Apr 11, 2024 · 1 comment

SapirW commented Apr 11, 2024

for 1024 resolution - I seem to get CUDA OOM on an A100 40GB machine. Does it make sense?
How much memory is needed?

Contributor

gaopengpjlab commented Apr 12, 2024

LLaMa-7B utilize lots of GPU memory. Currently, A100 80 GB is a must for inference.

We will release a model using CLIP or Gemma-2B soon. Please keep an eye on the final version of LargeDiT-T2I
https://github.com/Alpha-VLLM/Lumina-T2X/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment