New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Number of V100s used for training #6

Open

funkyyyyyy opened this issue Dec 1, 2021 · 3 comments

funkyyyyyy commented Dec 1, 2021

Hello

Thank you for the work :)

May I ask the number of V100s you used for training the model?

Trying to estimate the total batch size you used (understand that its 22 per V100 GPU)

Author

funkyyyyyy commented Dec 1, 2021

Found out that its 8. Thanks.

EmreOzkose commented Mar 13, 2022

Hi @funkyyyyyy, what is the gpu memory?

Author

funkyyyyyy commented Mar 15, 2022

hi @EmreOzkose, its 32 GB per GPU

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment