[bug] Helm uninstall does not remove all resources

[bnallapeta]

Describe the bug

Once you uninstall hmc by running helm uninstall, it does not do a clean uninstall and leaves behind certain resources.

k get ns hmc-system
NAME         STATUS        AGE
hmc-system   Terminating   23m

And the reason it gets stuck in Terminating is because of this:

k get ns hmc-system -oyaml
apiVersion: v1
kind: Namespace
metadata:
  creationTimestamp: "2025-01-13T07:19:20Z"
  deletionTimestamp: "2025-01-13T07:35:35Z"
  labels:
    kubernetes.io/metadata.name: hmc-system
    name: hmc-system
  name: hmc-system
  resourceVersion: "7147330"
  uid: c7c887fb-fb2d-40df-8a2d-c88135a3b2ec
spec:
  finalizers:
  - kubernetes
status:
  conditions:
  - lastTransitionTime: "2025-01-13T07:35:41Z"
    message: All resources successfully discovered
    reason: ResourcesDiscovered
    status: "False"
    type: NamespaceDeletionDiscoveryFailure
  - lastTransitionTime: "2025-01-13T07:35:41Z"
    message: All legacy kube types successfully parsed
    reason: ParsedGroupVersions
    status: "False"
    type: NamespaceDeletionGroupVersionParsingFailure
  - lastTransitionTime: "2025-01-13T07:35:41Z"
    message: All content successfully deleted, may be waiting on finalization
    reason: ContentDeleted
    status: "False"
    type: NamespaceDeletionContentFailure
  - lastTransitionTime: "2025-01-13T07:35:41Z"
    message: 'Some resources are remaining: helmcharts.source.toolkit.fluxcd.io has
      20 resource instances, helmreleases.helm.toolkit.fluxcd.io has 1 resource instances'
    reason: SomeResourcesRemain
    status: "True"
    type: NamespaceContentRemaining
  - lastTransitionTime: "2025-01-13T07:35:41Z"
    message: 'Some content in the namespace has finalizers remaining: finalizers.fluxcd.io
      in 21 resource instances'
    reason: SomeFinalizersRemain
    status: "True"
    type: NamespaceFinalizersRemaining
  phase: Terminating

There are HelmReleases (and HelmCharts) resources left behind stopping the deletion of the namespace.

To Reproduce
Steps to reproduce the behavior:

Install HMC following the helm install command given in readme

helm install hmc oci://ghcr.io/k0rdent/kcm/charts/hmc --version 0.0.6 -n hmc-system --create-namespace

Wait for all resources to be provisioned. Now, run the below command:

helm uninstall hmc

Expected behavior
A clean uninstall removing all the resources related to HMC

Additional context
Add any other context about the problem here.

[bnallapeta]

Same for mgmt and projectsveltos namespaces.

[a13x5]

Related to #724 .
TL;DR helm operations should only be used to install kcm for the first time. Upgrade/Uninstall will not be covered for a number of reasons and design decisions.

The proper uninstall procedure will be documented in scope of k0rdent/docs#49

Closing.

cc: @Kshatrix @DinaBelova

[bnallapeta]

@a13x5 any chance these reasons are documented? as to why we don't want to support helm uninstall?