Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kubeflow setup fails with GCR image error #833

Open
KK-LTIM opened this issue Mar 3, 2025 · 0 comments
Open

Kubeflow setup fails with GCR image error #833

KK-LTIM opened this issue Mar 3, 2025 · 0 comments

Comments

@KK-LTIM
Copy link

KK-LTIM commented Mar 3, 2025

I'm trying to install Kubeflow on my EKS cluster and it fails to provision the authservice pod with 401 error.

"Failed to pull image "gcr.io/arrikto/kubeflow/oidc-authservice:e236439": failed to pull and unpack image "gcr.io/arrikto/kubeflow/oidc-authservice:e236439": failed to resolve reference "gcr.io/arrikto/kubeflow/oidc-authservice:e236439": unexpected status from HEAD request to https://gcr.io/v2/arrikto/kubeflow/oidc-authservice/manifests/e236439: 401 Unauthorized"

karthik@U-1BB4IDIUHCE8V:~/kubeflow/kubeflow-manifests/awsconfigs$ kubectl describe pod authservice-0 -n istio-system
Name: authservice-0
Namespace: istio-system
Priority: 0
Service Account: authservice
Node: ip-10-229-237-94.ec2.internal/10.229.237.94
Start Time: Mon, 03 Mar 2025 01:08:34 +0530
Labels: app=authservice
apps.kubernetes.io/pod-index=0
controller-revision-hash=authservice-7bd6b4b965
statefulset.kubernetes.io/pod-name=authservice-0
Annotations: sidecar.istio.io/inject: false
Status: Pending
IP: 10.229.237.102
IPs:
IP: 10.229.237.102
Controlled By: StatefulSet/authservice
Containers:
authservice:
Container ID:
Image: gcr.io/arrikto/kubeflow/oidc-authservice:e236439
Image ID:
Port: 8080/TCP
Host Port: 0/TCP
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Readiness: http-get http://:8081/ delay=0s timeout=1s period=10s #success=1 #failure=3
Environment Variables from:
oidc-authservice-client Secret Optional: false
oidc-authservice-parameters ConfigMap Optional: false
Environment:
Mounts:
/var/lib/authservice from data (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-pcpbk (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
data:
Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)
ClaimName: authservice-pvc
ReadOnly: false
kube-api-access-pcpbk:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional:
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors:
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message


Warning Failed 50m (x169 over 14h) kubelet Failed to pull image "gcr.io/arrikto/kubeflow/oidc-authservice:e236439": failed to pull and unpack image "gcr.io/arrikto/kubeflow/oidc-authservice:e236439": failed to resolve reference "gcr.io/arrikto/kubeflow/oidc-authservice:e236439": unexpected status from HEAD request to https://gcr.io/v2/arrikto/kubeflow/oidc-authservice/manifests/e236439: 401 Unauthorized
Normal Pulling 35m (x172 over 14h) kubelet Pulling image "gcr.io/arrikto/kubeflow/oidc-authservice:e236439"
Normal BackOff 40s (x3934 over 14h) kubelet Back-off pulling image "gcr.io/arrikto/kubeflow/oidc-authservice:e236439"
karthik@U-1BB4IDIUHCE8V:~/kubeflow/kubeflow-manifests/awsconfigs$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant