Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

如何解决"CUDA out of memory" #29

Open
Ashes-of-Midgard opened this issue Apr 21, 2024 · 1 comment
Open

如何解决"CUDA out of memory" #29

Ashes-of-Midgard opened this issue Apr 21, 2024 · 1 comment

Comments

@Ashes-of-Midgard
Copy link

我的硬件是单张RTX 3050，使用指令
python -m torch.distributed.launch --use_env -m dipoorlet -I dipoorlet_work_dir/ -N 1000 -D trt -M models/mobilev2_model.onnx -A mse -O dipoorlet_brecq/ --brecq
执行模型量化，产生了CUDA out of memory的运行报错。我检查了所有可以使用的命令行参数，没有发现可以调整数据加载批次的命令，请问有什么手段可以消除这个报错吗？
@gushiqiao
Copy link
Contributor

可以减少-N后的数量

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@gushiqiao @Ashes-of-Midgard