Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate Slurm to use rockylinux #650

Merged
merged 2 commits into from
Aug 5, 2024
Merged

Conversation

jacobtomlinson
Copy link
Member

@jacobtomlinson jacobtomlinson commented Aug 2, 2024

It looks like the container that the Slurm container was previously based on hasn't been updated on Docker Hub for four years. However the GitHub repo is still active, you just have to clone and build the image yourself.

It felt easier to vendor in the Dockerfile and add our modifications to install Python. In dask-docker we used to do a remote build, but since docker buildx was made the default this got a lot harder, so I'm apprehensive to go down that road again. I also explored cloning the repo locally and building it before building the main container but using docker compose build to build images for pushing doesn't support using cached images that are on Docker Hub.

@jacobtomlinson jacobtomlinson added SLURM CI Continuous Integration tools labels Aug 2, 2024
@jacobtomlinson jacobtomlinson marked this pull request as ready for review August 2, 2024 16:55
@jacobtomlinson
Copy link
Member Author

Builds are passing again so I'm going to go ahead and merge.

@jacobtomlinson jacobtomlinson merged commit 9d4c371 into dask:main Aug 5, 2024
7 of 10 checks passed
@jacobtomlinson jacobtomlinson deleted the slurm-ci branch August 5, 2024 13:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI Continuous Integration tools SLURM
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant