Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Info in the documentation about the importance of JULIA_DEPOT_PATH #270

Open
glwagner opened this issue Nov 20, 2024 · 2 comments
Open

Info in the documentation about the importance of JULIA_DEPOT_PATH #270

glwagner opened this issue Nov 20, 2024 · 2 comments
Labels
documentation Improvements or additions to documentation

Comments

@glwagner
Copy link
Member

ClimaOcean uses Scratch.jl to save big datasets like ECCO and JRA55 at JULIA_DEPOT_PATH (which by default is ~/.julia. This means that on clusters, it's important to change JULIA_DEPOT_PATH environment variable to a location that has a lot of storage; often this is different from the default choice. We should document this, probably in a section "setting up ClimaOcean on clusters" in the documentation or something.

cc @sandreza

@glwagner glwagner added the documentation Improvements or additions to documentation label Nov 20, 2024
@navidcy
Copy link
Collaborator

navidcy commented Nov 20, 2024

It’s important to change that anyway regardless of ClimaOcean. Eg on the Australian HPC there is a 10GB limit in home directory so the .julia dir would fill that up even before Scratch.jl.

@glwagner
Copy link
Member Author

That's fair; that's also why its ok to use the depot in the first place for scratch, since changing the depot path to a place that can hold lots of data is more generally important.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

2 participants