Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CUDA out of memory error #22

Open
Anji-Builds opened this issue Apr 10, 2024 · 3 comments
Open

CUDA out of memory error #22

Anji-Builds opened this issue Apr 10, 2024 · 3 comments

Comments

@Anji-Builds
Copy link

Thanks a lot for your interesting work!!

I am trying to run the code in ubuntu 22.04 using GeForce GTX TITAN X (12gb) and i am getting out of memory error. Could someone suggest how I can solve this?

Also if the batch size needs to be changed, which file should I find the variable in?

Screenshot from 2024-04-10 14-15-45

I got this error when for scene id 114 and no other changes.

Screenshot from 2024-04-10 14-14-44

Got this error after I changed the ray_batch_size from 8192 to 4096.

I am new to this, please need guidance!

@Mayakshamanjirinesht
Copy link

@Anji-Builds Hi, I am also facing the same issue, when i am done training, and evaluation starts. My GPU memory is 8GB, so how can we change the batch size? is changing the ray_batch_size same as changing the batch size?
Also how to do the inference just on camera images alone?

@Anji-Builds
Copy link
Author

@Mayakshamanjirinesht No, I have not got a solution and even I am confused about the same things.

@Mayakshanesht
Copy link

Mayakshanesht commented Jul 2, 2024

@Anji-Builds can we connect by email at [email protected] or maybe on LinkedIn (https://www.linkedin.com/in/mayur-waghchoure-a5aba5ab?utm_source=share&utm_campaign=share_via&utm_content=profile&utm_medium=android_app)
To discuss this emernerf architecture, I am using it as a backbone. I trained it for the 1000 epochs but when I ran it in the eval model, the state dict of the saved checkpoint and new model which is supposed to adjust to the new scene had different sizes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants