Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] timed out waiting for cache to be synced for Kind *v1alpha1.ClusterDefinition #5837

Closed
JashBook opened this issue Nov 15, 2023 · 0 comments · Fixed by #5844
Closed
Assignees
Labels
bug kind/bug Something isn't working
Milestone

Comments

@JashBook
Copy link
Collaborator

JashBook commented Nov 15, 2023

Describe the bug
kubeblocks error:
ERROR Could not wait for Cache to sync {"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "error": "failed to wait for cluster caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.Cluster"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1

kbcli version
Kubernetes: v1.26.3
KubeBlocks: 0.8.0-alpha.3
kbcli: 0.8.0-alpha.3

To Reproduce
Steps to reproduce the behavior:

  1. install kubeblocks
kbcli kubeblocks install --create-namespace --version 0.8.0-alpha.3  --namespace default

Kubernetes version 1.26.3
kbcli version 0.8.0-alpha.3
Collecting data from cluster                       OK
Kubernetes cluster preflight                       OK
  Warn
  - This application requires at least 3 nodes
  - The default storage class was not found. You can use option --set storageClass=<storageClassName> when creating cluster
Add and update repo kubeblocks                     OK
Install KubeBlocks 0.8.0-alpha.3                   OK
⣷ Wait for addons to be enabled     

Failed to wait for auto-install addons to be enabled, run "kbcli kubeblocks status" to check the status
error: timed out waiting for the condition
  1. See error
➜  ~ kubectl get pod
NAME                                         READY   STATUS    RESTARTS       AGE
kubeblocks-5fbc76c456-s4vpv                  0/1     Error     1 (2m2s ago)   4m4s
kubeblocks-dataprotection-844b895c45-649zx   1/1     Running   0              4m4s

➜  ~ kubectl get crd | grep kubeblocks
actionsets.dataprotection.kubeblocks.io           2023-11-15T02:19:19Z
addons.extensions.kubeblocks.io                   2023-11-15T02:19:19Z
backuppolicies.dataprotection.kubeblocks.io       2023-11-15T02:19:19Z
backuppolicytemplates.apps.kubeblocks.io          2023-11-15T02:19:18Z
backuprepos.dataprotection.kubeblocks.io          2023-11-15T02:19:19Z
backups.dataprotection.kubeblocks.io              2023-11-15T02:19:19Z
backupschedules.dataprotection.kubeblocks.io      2023-11-15T02:19:19Z
clusterdefinitions.apps.kubeblocks.io             2023-11-15T02:19:18Z
clusters.apps.kubeblocks.io                       2023-11-15T02:19:19Z
clusterversions.apps.kubeblocks.io                2023-11-15T02:19:19Z
componentclassdefinitions.apps.kubeblocks.io      2023-11-15T02:19:19Z
componentdefinitions.apps.kubeblocks.io           2023-11-15T02:19:19Z
componentresourceconstraints.apps.kubeblocks.io   2023-11-15T02:19:19Z
components.apps.kubeblocks.io                     2023-11-15T02:19:19Z
configconstraints.apps.kubeblocks.io              2023-11-15T02:19:19Z
configurations.apps.kubeblocks.io                 2023-11-15T02:19:19Z
opsrequests.apps.kubeblocks.io                    2023-11-15T02:19:19Z
replicatedstatemachines.workloads.kubeblocks.io   2023-11-15T02:19:19Z
restores.dataprotection.kubeblocks.io             2023-11-15T02:19:19Z
servicedescriptors.apps.kubeblocks.io             2023-11-15T02:19:19Z
storageproviders.storage.kubeblocks.io            2023-11-15T02:19:19Z

logs kubeblocks pod

kubectl logs kubeblocks-5fbc76c456-s4vpv --previous 
Defaulted container "manager" out of: manager, tools (init), datascript (init)
2023-11-15T02:21:25.381Z	INFO	setup	config file: /etc/kubeblocks/config.yaml
2023-11-15T02:21:25.381Z	INFO	setup	config settings: map[apps:true cert_dir:/tmp/k8s-webhook-server/serving-certs cm_namespace:default cm_recon_retry_duration_ms:1000 config_manager_grpc_port:9901 config_manager_log_level:info data_plane_affinity:{"nodeAffinity":{"preferredDuringSchedulingIgnoredDuringExecution":[{"preference":{"matchExpressions":[{"key":"kb-data","operator":"In","values":["true"]}]},"weight":100}]}} data_plane_tolerations:[{"effect":"NoSchedule","key":"kb-data","operator":"Equal","value":"true"}] default_storage_class: enable_debug_sysaccounts:false enablerbacmanager:true extensions:true health_probe_bind_address::8081 kb_max_lag:10 kb_ttl:15 kubeblocks_addon_helm_install_options:--atomic --cleanup-on-fail --wait --insecure-skip-tls-verify kubeblocks_addon_helm_uninstall_options:[] kubeblocks_addon_sa_name:kubeblocks-addon-installer kubeblocks_datascript_clients_image:infracreate-registry.cn-zhangjiakou.cr.aliyuncs.com/apecloud/kubeblocks-datascript:0.8.0-alpha.3 kubeblocks_serviceaccount_name:kubeblocks kubeblocks_tools_image:infracreate-registry.cn-zhangjiakou.cr.aliyuncs.com/apecloud/kubeblocks-tools:0.8.0-alpha.3 kubeconfig: kubernetes_cluster_domain:cluster.local leader_elect:true leader_elect_id:001c317f maxconcurrentreconciles_addon:14 maxconcurrentreconciles_clusterdef:7 maxconcurrentreconciles_clusterversion:7 metrics_bind_address::8080 pod_min_ready_seconds:10 probe_service_grpc_port:50001 probe_service_http_port:3501 probe_service_log_level:info replicated_state_machine:true rsm_compatibility_mode:true storage:true volumesnapshot_api_beta:false workloads:true zap_devel:false zap_encoder:console zap_log_level: zap_stacktrace_level: zap_time_encoding:iso8601]
2023-11-15T02:21:25.382Z	INFO	controller-runtime.metrics	Metrics server is starting to listen	{"addr": ":8080"}
2023-11-15T02:21:25.387Z	INFO	setup	starting manager
2023-11-15T02:21:25.388Z	INFO	Starting server	{"kind": "health probe", "addr": "[::]:8081"}
2023-11-15T02:21:25.388Z	INFO	starting server	{"path": "/metrics", "kind": "metrics", "addr": "[::]:8080"}
I1115 02:21:25.388784       1 leaderelection.go:250] attempting to acquire leader lease default/001c317f.kubeblocks.io...
I1115 02:21:25.394041       1 leaderelection.go:260] successfully acquired lease default/001c317f.kubeblocks.io
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1alpha1.Cluster"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1alpha1.Component"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.Service"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.Secret"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.ConfigMap"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1alpha1.BackupPolicy"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1alpha1.BackupSchedule"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1alpha1.Restore"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.Job"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1alpha1.Configuration"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.Pod"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "clusterversion", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterVersion", "source": "kind source: *v1alpha1.ClusterVersion"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "clusterversion", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterVersion"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "clusterdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterDefinition", "source": "kind source: *v1alpha1.ClusterDefinition"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "clusterdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterDefinition"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "componentdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentDefinition", "source": "kind source: *v1alpha1.ComponentDefinition"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "componentdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentDefinition"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: *v1alpha1.Component"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "source": "kind source: *v1alpha1.OpsRequest"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "source": "kind source: *v1alpha1.Cluster"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: *v1alpha1.ReplicatedStateMachine"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "source": "kind source: *v1alpha1.ReplicatedStateMachine"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: *v1.Service"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "source": "kind source: *v1alpha1.Backup"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: *v1.Secret"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "source": "kind source: *v1.PersistentVolumeClaim"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "configconstraint", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ConfigConstraint", "source": "kind source: *v1alpha1.ConfigConstraint"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "configconstraint", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ConfigConstraint", "source": "kind source: *v1.ConfigMap"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "configconstraint", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ConfigConstraint"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: *v1.ConfigMap"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: *v1alpha1.Backup"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: *v1alpha1.Restore"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: *v1.PersistentVolumeClaim"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: *v1.PodDisruptionBudget"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: *v1.Job"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: *v1.ClusterRoleBinding"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: *v1.RoleBinding"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: *v1.ServiceAccount"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "source": "kind source: *v1.Pod"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "event", "controllerGroup": "", "controllerKind": "Event", "source": "kind source: *v1.Event"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "event", "controllerGroup": "", "controllerKind": "Event"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "configuration", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Configuration", "source": "kind source: *v1alpha1.Configuration"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "configuration", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Configuration", "source": "kind source: *v1.ConfigMap"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "configuration", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Configuration"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1alpha1.Cluster"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.Secret"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "source": "kind source: *v1.ConfigMap"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "source": "kind source: *v1.Job"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "configmap", "controllerGroup": "", "controllerKind": "ConfigMap"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "servicedescriptor", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ServiceDescriptor", "source": "kind source: *v1alpha1.ServiceDescriptor"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "servicedescriptor", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ServiceDescriptor"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "componentclassdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentClassDefinition", "source": "kind source: *v1alpha1.ComponentClassDefinition"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "componentclassdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentClassDefinition"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "addon", "controllerGroup": "extensions.kubeblocks.io", "controllerKind": "Addon", "source": "kind source: *v1alpha1.Addon"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "addon", "controllerGroup": "extensions.kubeblocks.io", "controllerKind": "Addon", "source": "kind source: *v1.Job"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "addon", "controllerGroup": "extensions.kubeblocks.io", "controllerKind": "Addon"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "backuppolicytemplate", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "BackupPolicyTemplate", "source": "kind source: *v1alpha1.BackupPolicyTemplate"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "backuppolicytemplate", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "BackupPolicyTemplate"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "storageprovider", "controllerGroup": "storage.kubeblocks.io", "controllerKind": "StorageProvider", "source": "kind source: *v1alpha1.StorageProvider"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "storageprovider", "controllerGroup": "storage.kubeblocks.io", "controllerKind": "StorageProvider", "source": "kind source: *v1.CSIDriver"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "storageprovider", "controllerGroup": "storage.kubeblocks.io", "controllerKind": "StorageProvider"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "replicatedstatemachine", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "ReplicatedStateMachine", "source": "kind source: *v1alpha1.ReplicatedStateMachine"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "replicatedstatemachine", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "ReplicatedStateMachine", "source": "kind source: *v1.StatefulSet"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "replicatedstatemachine", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "ReplicatedStateMachine", "source": "kind source: *v1.Job"}
2023-11-15T02:21:25.394Z	INFO	Starting EventSource	{"controller": "replicatedstatemachine", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "ReplicatedStateMachine", "source": "kind source: *v1.Pod"}
2023-11-15T02:21:25.394Z	INFO	Starting Controller	{"controller": "replicatedstatemachine", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "ReplicatedStateMachine"}
W1115 02:21:25.429875       1 reflector.go:535] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E1115 02:21:25.430091       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
2023-11-15T02:21:25.520Z	INFO	Starting workers	{"controller": "configuration", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Configuration", "worker count": 1}
2023-11-15T02:21:25.524Z	INFO	Starting workers	{"controller": "configmap", "controllerGroup": "", "controllerKind": "ConfigMap", "worker count": 1}
W1115 02:21:27.030050       1 reflector.go:535] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E1115 02:21:27.030082       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W1115 02:21:30.168313       1 reflector.go:535] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E1115 02:21:30.168428       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W1115 02:21:33.558738       1 reflector.go:535] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E1115 02:21:33.558769       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W1115 02:21:45.354220       1 reflector.go:535] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E1115 02:21:45.354252       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W1115 02:22:05.150910       1 reflector.go:535] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E1115 02:22:05.151033       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W1115 02:22:35.273592       1 reflector.go:535] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E1115 02:22:35.273803       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
W1115 02:23:08.494488       1 reflector.go:535] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E1115 02:23:08.494547       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:serviceaccount:default:kubeblocks" cannot list resource "statefulsets" in API group "apps" at the cluster scope
2023-11-15T02:23:25.395Z	ERROR	Could not wait for Cache to sync	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "error": "failed to wait for cluster caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.Cluster"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:202
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:207
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:233
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219
2023-11-15T02:23:25.395Z	ERROR	Could not wait for Cache to sync	{"controller": "event", "controllerGroup": "", "controllerKind": "Event", "error": "failed to wait for event caches to sync: timed out waiting for cache to be synced for Kind *v1.Event"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:202
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:207
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:233
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219
2023-11-15T02:23:25.395Z	ERROR	Could not wait for Cache to sync	{"controller": "backuppolicytemplate", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "BackupPolicyTemplate", "error": "failed to wait for backuppolicytemplate caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.BackupPolicyTemplate"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:202
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:207
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:233
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219
2023-11-15T02:23:25.395Z	ERROR	Could not wait for Cache to sync	{"controller": "componentclassdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentClassDefinition", "error": "failed to wait for componentclassdefinition caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.ComponentClassDefinition"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:202
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:207
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:233
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219
2023-11-15T02:23:25.395Z	ERROR	Could not wait for Cache to sync	{"controller": "componentdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ComponentDefinition", "error": "failed to wait for componentdefinition caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.ComponentDefinition"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:202
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:207
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:233
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219
2023-11-15T02:23:25.395Z	ERROR	Could not wait for Cache to sync	{"controller": "clusterdefinition", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterDefinition", "error": "failed to wait for clusterdefinition caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.ClusterDefinition"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:202
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:207
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:233
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219
2023-11-15T02:23:25.395Z	ERROR	Could not wait for Cache to sync	{"controller": "configconstraint", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ConfigConstraint", "error": "failed to wait for configconstraint caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.ConfigConstraint"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:202
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:207
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:233
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219
2023-11-15T02:23:25.395Z	ERROR	Could not wait for Cache to sync	{"controller": "clusterversion", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ClusterVersion", "error": "failed to wait for clusterversion caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.ClusterVersion"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:202
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:207
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:233
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219
2023-11-15T02:23:25.395Z	ERROR	Could not wait for Cache to sync	{"controller": "opsrequest", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "OpsRequest", "error": "failed to wait for opsrequest caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.OpsRequest"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:202
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:207
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:233
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219
2023-11-15T02:23:25.395Z	ERROR	Could not wait for Cache to sync	{"controller": "addon", "controllerGroup": "extensions.kubeblocks.io", "controllerKind": "Addon", "error": "failed to wait for addon caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.Addon"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:202
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:207
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:233
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219
2023-11-15T02:23:25.395Z	ERROR	Could not wait for Cache to sync	{"controller": "cluster", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Cluster", "error": "failed to wait for cluster caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.Cluster"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:202
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:207
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:233
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219
2023-11-15T02:23:25.395Z	ERROR	Could not wait for Cache to sync	{"controller": "component", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Component", "error": "failed to wait for component caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.Component"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:202
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:207
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:233
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219
2023-11-15T02:23:25.395Z	ERROR	Could not wait for Cache to sync	{"controller": "storageprovider", "controllerGroup": "storage.kubeblocks.io", "controllerKind": "StorageProvider", "error": "failed to wait for storageprovider caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.StorageProvider"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:202
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:207
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:233
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219
2023-11-15T02:23:25.395Z	INFO	Stopping and waiting for non leader election runnables
2023-11-15T02:23:25.395Z	ERROR	Could not wait for Cache to sync	{"controller": "servicedescriptor", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "ServiceDescriptor", "error": "failed to wait for servicedescriptor caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.ServiceDescriptor"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:202
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:207
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:233
sigs.k8s.io/controller-runtime/pkg/manager.(*runnableGroup).reconcile.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/runnable_group.go:219
2023-11-15T02:23:25.395Z	ERROR	error received after stop sequence was engaged	{"error": "failed to wait for event caches to sync: timed out waiting for cache to be synced for Kind *v1.Event"}
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:555
2023-11-15T02:23:25.395Z	INFO	shutting down server	{"path": "/metrics", "kind": "metrics", "addr": "[::]:8080"}
2023-11-15T02:23:25.395Z	ERROR	error received after stop sequence was engaged	{"error": "failed to wait for backuppolicytemplate caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.BackupPolicyTemplate"}
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:555
2023-11-15T02:23:25.395Z	ERROR	error received after stop sequence was engaged	{"error": "failed to wait for componentclassdefinition caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.ComponentClassDefinition"}
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:555
2023-11-15T02:23:25.395Z	ERROR	error received after stop sequence was engaged	{"error": "failed to wait for componentdefinition caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.ComponentDefinition"}
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:555
2023-11-15T02:23:25.395Z	ERROR	error received after stop sequence was engaged	{"error": "failed to wait for clusterdefinition caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.ClusterDefinition"}
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:555
2023-11-15T02:23:25.395Z	ERROR	error received after stop sequence was engaged	{"error": "failed to wait for configconstraint caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.ConfigConstraint"}
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:555
2023-11-15T02:23:25.395Z	ERROR	error received after stop sequence was engaged	{"error": "failed to wait for clusterversion caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.ClusterVersion"}
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:555
2023-11-15T02:23:25.395Z	ERROR	error received after stop sequence was engaged	{"error": "failed to wait for opsrequest caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.OpsRequest"}
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:555
2023-11-15T02:23:25.395Z	ERROR	error received after stop sequence was engaged	{"error": "failed to wait for addon caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.Addon"}
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:555
2023-11-15T02:23:25.395Z	INFO	Stopping and waiting for leader election runnables
2023-11-15T02:23:25.395Z	ERROR	error received after stop sequence was engaged	{"error": "failed to wait for cluster caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.Cluster"}
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:555
2023-11-15T02:23:25.395Z	ERROR	error received after stop sequence was engaged	{"error": "failed to wait for component caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.Component"}
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:555
2023-11-15T02:23:25.395Z	ERROR	error received after stop sequence was engaged	{"error": "failed to wait for storageprovider caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.StorageProvider"}
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:555
2023-11-15T02:23:25.395Z	ERROR	error received after stop sequence was engaged	{"error": "failed to wait for servicedescriptor caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.ServiceDescriptor"}
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).engageStopProcedure.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/manager/internal.go:555
2023-11-15T02:23:25.395Z	INFO	Shutdown signal received, waiting for all workers to finish	{"controller": "configmap", "controllerGroup": "", "controllerKind": "ConfigMap"}
2023-11-15T02:23:25.395Z	INFO	Shutdown signal received, waiting for all workers to finish	{"controller": "configuration", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Configuration"}
2023-11-15T02:23:25.396Z	INFO	All workers finished	{"controller": "configmap", "controllerGroup": "", "controllerKind": "ConfigMap"}
2023-11-15T02:23:25.396Z	INFO	Starting workers	{"controller": "replicatedstatemachine", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "ReplicatedStateMachine", "worker count": 1}
2023-11-15T02:23:25.396Z	INFO	All workers finished	{"controller": "configuration", "controllerGroup": "apps.kubeblocks.io", "controllerKind": "Configuration"}
2023-11-15T02:23:25.396Z	INFO	Shutdown signal received, waiting for all workers to finish	{"controller": "replicatedstatemachine", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "ReplicatedStateMachine"}
2023-11-15T02:23:25.396Z	INFO	All workers finished	{"controller": "replicatedstatemachine", "controllerGroup": "workloads.kubeblocks.io", "controllerKind": "ReplicatedStateMachine"}
2023-11-15T02:23:25.396Z	INFO	Stopping and waiting for caches
2023-11-15T02:23:25.396Z	ERROR	controller-runtime.source.EventHandler	failed to get informer from cache	{"error": "Timeout: failed waiting for *v1.StatefulSet Informer to sync"}
sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind).Start.func1.1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/source/kind.go:68
k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext.func1
	/go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/loop.go:49
k8s.io/apimachinery/pkg/util/wait.loopConditionUntilContext
	/go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/loop.go:50
k8s.io/apimachinery/pkg/util/wait.PollUntilContextCancel
	/go/pkg/mod/k8s.io/[email protected]/pkg/util/wait/poll.go:33
sigs.k8s.io/controller-runtime/pkg/internal/source.(*Kind).Start.func1
	/go/pkg/mod/sigs.k8s.io/[email protected]/pkg/internal/source/kind.go:56
2023-11-15T02:23:25.397Z	INFO	Stopping and waiting for webhooks
2023-11-15T02:23:25.397Z	INFO	Wait completed, proceeding to shutdown the manager
2023-11-15T02:23:25.400Z	ERROR	setup	problem running manager	{"error": "failed to wait for cluster caches to sync: timed out waiting for cache to be synced for Kind *v1alpha1.Cluster"}
main.main
	/src/cmd/manager/main.go:512
runtime.main
	/usr/local/go/src/runtime/proc.go:267

Expected behavior
A clear and concise description of what you expected to happen.

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

  • OS: [e.g. iOS]
  • Browser [e.g. chrome, safari]
  • Version [e.g. 22]

Additional context
Add any other context about the problem here.

@JashBook JashBook added the kind/bug Something isn't working label Nov 15, 2023
@JashBook JashBook added this to the Release 0.8.0 milestone Nov 15, 2023
@Y-Rookie Y-Rookie linked a pull request Nov 15, 2023 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug kind/bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants