Kapp delete hangs

[antwacky]

What steps did you take:

kapp delete --kubeconfig-context ${KUBECONFIG} -a ${APP_NAME} -n ${APP_NAMESPACE}

What happened:

Sometimes, the delete will not delete some resources, and loops with ongoing: delete ....

The same resources can be deleted via kubectl and kapp acknowledges that they are gone - so this is not an issue with kubeconfig or connection to cluster.

What did you expect:

The resources to be deleted.

Anything else you would like to add:

Debug does not show anything relevant, and there are no useful events/logs within the cluster.

Environment:

• kapp version (use kapp --version):

0.64.0

• OS (e.g. from /etc/os-release):

PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
NAME="Debian GNU/Linux"
VERSION_ID="12"
VERSION="12 (bookworm)"
VERSION_CODENAME=bookworm
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"

• Kubernetes version (use kubectl version)

Client Version: version.Info{Major:"1", Minor:"25", GitVersion:"v1.25.16", GitCommit:"c5f43560a4f98f2af3743a59299fb79f07924373", GitTreeState:"clean", BuildDate:"2023-11-15T22:39:12Z", GoVersion:"go1.20.10", Compiler:"gc", Platform:"linux/amd64"}
Kustomize Version: v4.5.7
Server Version: version.Info{Major:"1", Minor:"26", GitVersion:"v1.26.15", GitCommit:"1649f592f1909b97aa3c2a0a8f968a3fd05a7b8b", GitTreeState:"clean", BuildDate:"2024-03-14T00:54:27Z", GoVersion:"go1.21.8", Compiler:"gc", Platform:"linux/amd64"}

---

Vote on this request

This is an invitation to the community to vote on issues, to help us prioritize our backlog. Use the "smiley face" up to the right of this comment to vote.

👍 "I would like to see this addressed as soon as possible"
👎 "There are other more important things to focus on right now"

We are also happy to receive and review Pull Requests if you want to help working on this issue.

[praveenrewar]

@antwacky Could you share an example resource that kapp is not able to delete? My guess is that kapp might not be owning it and just waiting for the cluster to delete it.

[antwacky]

Apologies, I don't have a copy of the resources.

I'm afraid I don't have much to go on here as the issue is intermittent - I use Kapp to deploy microservices within CI, and it randomly fails to fully delete every now and then. I assume that due to the issue being intermittent, ownership is not the problem (although I could be wrong).

One point of note is that it seems to happen mostly with Strimzi Helm chart deployed resources - now I say that, it may be resources that are created by Strimzi CRDs, maybe there is a rare race condition where the CRD is deleted before being fully cleaned up.

Appreciate this is not exactly a solid reproducible issue, maybe I could leave this open and come back with more detail the next time it happens.