Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] add task.unload() function to free up memory #197

Open
sgbaird opened this issue Oct 7, 2022 · 0 comments
Open

[Feature Request] add task.unload() function to free up memory #197

sgbaird opened this issue Oct 7, 2022 · 0 comments

Comments

@sgbaird
Copy link
Contributor

sgbaird commented Oct 7, 2022

On free tier, Colab runs out of RAM during the dummy benchmark: https://colab.research.google.com/drive/15YLOWHB_NkIIqKLO0ik784fsK2xJD08l?usp=sharing

A task.unload() function would delete task.df, and call gc.collect(), i.e.:

import gc
...
	task.load()
	...
	del task.df
	gc.collect()
...

This gets it a bit further (completes mp_e_form which it didn't before, but crashes at mp_gap). What other large objects could be safely deleted while preserving the benchmark results?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant