Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Podman slow to push images when using zstd:chunked #2157

Open
noelmiller opened this issue Nov 1, 2024 · 0 comments
Open

Podman slow to push images when using zstd:chunked #2157

noelmiller opened this issue Nov 1, 2024 · 0 comments
Labels
area/zstd:chunked Issues relating to zstd:chunked

Comments

@noelmiller
Copy link

Problem

Pushing to a registry takes far longer using ZSTD chunked than using traditional gzip compression. We believe the reason for this is because it needs to do compression on each of the many layers in an OS Image. This issue compounds itself if you are pushing multiple tags rather than just a single tag. The upload of a gzip image takes about 3 - 10 minutes with 5 tags. A ZSTD chunked image takes about 35 minutes with 5 tags. If there is a failure in the push at any point, you will need to push it again. This results in far longer build times for us.

Examples

Here is a recent push for Bazzite using ZSTD chunked: https://github.com/ublue-os/bazzite/actions/runs/11604220311/job/32315410778#step:28:1

Here is a previous build using gzip: https://github.com/ublue-os/bazzite/actions/runs/11332889740/job/31515959369#step:28:1

@cgwalters cgwalters added the area/zstd:chunked Issues relating to zstd:chunked label Nov 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/zstd:chunked Issues relating to zstd:chunked
Projects
None yet
Development

No branches or pull requests

2 participants