Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Save the memory buffer #178

Closed
PKWadsy opened this issue Jul 4, 2024 · 1 comment · Fixed by #196
Closed

Save the memory buffer #178

PKWadsy opened this issue Jul 4, 2024 · 1 comment · Fixed by #196
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@PKWadsy
Copy link
Contributor

PKWadsy commented Jul 4, 2024

Sometimes things stop training e.g. application crashes, accidentally hitting ctrl-c on the wrong terminal, power outages, running out of memory etc. It would be handy to have the system save the memory buffer at fixed intervals and be able to load these back in to continue training if anything does go wrong.
@PKWadsy PKWadsy added the enhancement New feature or request label Jul 4, 2024
@beardyFace beardyFace added the help wanted Extra attention is needed label Jul 4, 2024
@beardyFace
Copy link
Member

#141 same concept

@beardyFace beardyFace linked a pull request Sep 20, 2024 that will close this issue
Saving Memory Buffer #196
Merged
@beardyFace beardyFace mentioned this issue Oct 21, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Saving Memory Buffer UoA-CARES/cares_reinforcement_learning
2 participants
@beardyFace @PKWadsy