Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

nodeinstaller: add nydus-pull container #1103

Merged
merged 1 commit into from
Jan 13, 2025
Merged

Conversation

davidweisse
Copy link
Contributor

@davidweisse davidweisse commented Dec 23, 2024

This adds the nydus-pull container, which is running inside the Node Installer as a workaround for the containerd bug described in containerd/containerd#8674. When using different snapshotters, such as the nydus-snapshotter, it may happen that some layers were previously pulled using K8s default snapshotter which can then cause the pod to run into this error.

The nydus-pull container watches for all pod events and tries to manually pull failing images that are likely to be caused by this bug. We saw this previously in the regression E2E tests on bare metal, specifically with the redis container.

A successful run of the regression test can be found here: https://github.com/edgelesssys/contrast/actions/runs/12745494675
First, the redis container gets a CreateContainerError, which is then caught by the nydus-pull container. On the next backoff, the container starts normally.

@davidweisse davidweisse added the no changelog PRs not listed in the release notes label Dec 23, 2024
@davidweisse davidweisse marked this pull request as ready for review December 23, 2024 15:08
nyduspull/main.go Outdated Show resolved Hide resolved
@katexochen katexochen added changelog PRs that should be part of the release notes and removed no changelog PRs not listed in the release notes labels Dec 30, 2024
@katexochen katexochen added this to the v1.3.0 milestone Jan 3, 2025
internal/kuberesource/parts.go Outdated Show resolved Hide resolved
packages/containers.nix Outdated Show resolved Hide resolved
tools/nydus-pull/go.mod Outdated Show resolved Hide resolved
Copy link
Contributor

@burgerdev burgerdev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm % comments

tools/nydus-pull/main.go Outdated Show resolved Hide resolved
@katexochen
Copy link
Member

Please remember to ping devs so they can make the new image public in their registry.

Copy link
Member

@katexochen katexochen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

otherwise lgtm

@davidweisse davidweisse merged commit f4b5a31 into main Jan 13, 2025
11 checks passed
@davidweisse davidweisse deleted the dav/nydus-ctr-pull branch January 13, 2025 12:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
changelog PRs that should be part of the release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants