Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a new release with each new build #1

Open
phargogh opened this issue Mar 27, 2023 · 2 comments
Open

Create a new release with each new build #1

phargogh opened this issue Mar 27, 2023 · 2 comments
Labels
enhancement New feature or request

Comments

@phargogh
Copy link
Member

While the meat of the devstack is complete (a docker container, with container tags), there are several QOL improvements that we could do to make it easier to use. I think it would be helpful to create a new release with each new build. This would enable:

  1. We would tag the git repository with the same datestamp tag (YYYY-MM-DD) as the docker container, which would make it easier to link a specific container back to the source code.
  2. Creating a new release gives us a chance to update the text of the release body with the specific instructions, including the correct SHA digest, for that specific container and also a report of all the packages included in this release for later reference.
  3. Creating a new release allows us to pre-build a singularity container and attach it as a release artifact, provided that the file is less than 2GB in size. If the devstack image exceeds that, we'll need to rethink this approach, trim the size of the container, or else host the container somewhere else, like on GCS.
@phargogh phargogh added the enhancement New feature or request label Mar 27, 2023
@phargogh
Copy link
Member Author

I just ran the following on sherlock on the latest devstack tag (currently at 2023-03-24, sha256:f4d6caee97b6fac7535bf9fd8bc53dbb76c87260aa86eed11532c78aeb246c05), and am relieved to see that even though we're installing a whole lot of dependencies (including GDAL), the singularity image size is under 1GB:

[sh03-ln02 login ~]$ srun apptainer pull $SCRATCH/natcap-devstack.sif docker://ghcr.io/natcap/devstack:latest
[sh03-ln02 login ~]$ du -h $SCRATCH/natcap-devstack.sif
873M	/scratch/users/jadoug06/natcap-devstack.sif

@dcdenu4
Copy link
Member

dcdenu4 commented Mar 28, 2023

This seems like a nice clean approach to me!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants