From 0673bdbefe3a77fd5a8d6392009d7937dbc820b7 Mon Sep 17 00:00:00 2001 From: Poornima Krishnasamy Date: Fri, 23 Feb 2024 14:52:32 +0000 Subject: [PATCH] Merge prod cluster upgrade --- .../cloud-platform-k8s-upgrade-template.md | 52 +++++++------------ 1 file changed, 18 insertions(+), 34 deletions(-) diff --git a/.github/ISSUE_TEMPLATE/cloud-platform-k8s-upgrade-template.md b/.github/ISSUE_TEMPLATE/cloud-platform-k8s-upgrade-template.md index d4c2e406..e141b518 100644 --- a/.github/ISSUE_TEMPLATE/cloud-platform-k8s-upgrade-template.md +++ b/.github/ISSUE_TEMPLATE/cloud-platform-k8s-upgrade-template.md @@ -4,16 +4,6 @@ about: Create new Cloud Platform Kubernetes Upgrade story --- ## Issue 1: -### Terraform AWS EKS Modules support for -Check to see if there are any issues with using with Kubernetes - -## Issue 2: -### Check for deprecated resources for -Scan to see if we have any in the production clusters live/live-2/manager. If any present, take actions to address that. - -Refer to the deprecations note on runbook: https://runbooks.cloud-platform.service.justice.gov.uk/upgrade-eks-cluster.html#compatibility-check - -## Issue 3: ### Update vpc-cni from to the version needed for current k8s version Check for the latest supported addon version for the current kubernetes version and update the clusters @@ -30,7 +20,7 @@ See the [Amazon EKS add-ons](https://docs.aws.amazon.com/eks/latest/userguide/ek - [vpc-cni](https://docs.aws.amazon.com/eks/latest/userguide/managing-vpc-cni.html) -## Issue 4: +## Issue 2: ### Update kube-proxy from to the version needed for current k8s version Check for the latest supported addon version for the current kubernetes version and update the clusters @@ -47,7 +37,7 @@ See the [Amazon EKS add-ons](https://docs.aws.amazon.com/eks/latest/userguide/ek - [vpc-cni](https://docs.aws.amazon.com/eks/latest/userguide/managing-vpc-cni.html) -## Issue 5: +## Issue 3: ### Update core-dns from to the version needed for current k8s version Check for the latest supported addon version for the current kubernetes version and update the clusters @@ -63,33 +53,27 @@ See the [Amazon EKS add-ons](https://docs.aws.amazon.com/eks/latest/userguide/ek - [kube-proxy](https://docs.aws.amazon.com/eks/latest/userguide/managing-kube-proxy.html) - [vpc-cni](https://docs.aws.amazon.com/eks/latest/userguide/managing-vpc-cni.html) -## Issue 6: +## Issue 4: ### Test EKS on test cluster Follow instructions from Upgrade runbook: https://runbooks.cloud-platform.service.justice.gov.uk/upgrade-eks-cluster.html#upgrade-eks-cluster -## Issue 7: +## Issue 5: ### Test EKS on live-like cluster Follow instructions from creating a live like cluster runbook: https://runbooks.cloud-platform.service.justice.gov.uk/creating-a-live-like.html#creating-a-live-like-cluster -## Issue 8: -### EKS: Upgrade live-2 to Kubernetes -https://runbooks.cloud-platform.service.justice.gov.uk/upgrade-eks-cluster.html - -## Issue 9: -### EKS: Upgrade manager to Kubernetes +## Issue 6: +### EKS: Upgrade Production clusters to Kubernetes https://runbooks.cloud-platform.service.justice.gov.uk/upgrade-eks-cluster.html -## Issue 10: -### EKS: Upgrade live to Kubernetes -https://runbooks.cloud-platform.service.justice.gov.uk/upgrade-eks-cluster.html +Production Clusters Checklist: -## Issue 11: -### EKS: Upgrade live to Kubernetes -https://runbooks.cloud-platform.service.justice.gov.uk/upgrade-eks-cluster.html +- [ ] live-2 +- [ ] manager +- [ ] live -## Issue 12: +## Issue 7: ### Update vpc-cni from to the version needed for the upgraded k8s version Check for the latest supported addon version for the upgraded kubernetes version and update the clusters @@ -106,7 +90,7 @@ See the [Amazon EKS add-ons](https://docs.aws.amazon.com/eks/latest/userguide/ek - [vpc-cni](https://docs.aws.amazon.com/eks/latest/userguide/managing-vpc-cni.html) -## Issue 13: +## Issue 8: ### Update kube-proxy from to the version needed for the upgraded k8s version Check for the latest supported addon version for the upgraded kubernetes version and update the clusters @@ -123,7 +107,7 @@ See the [Amazon EKS add-ons](https://docs.aws.amazon.com/eks/latest/userguide/ek - [vpc-cni](https://docs.aws.amazon.com/eks/latest/userguide/managing-vpc-cni.html) -## Issue 14: +## Issue 9: ### Update core-dns from to the version needed for the upgraded k8s version Check for the latest supported addon version for the upgraded kubernetes version and update the clusters @@ -139,13 +123,13 @@ See the [Amazon EKS add-ons](https://docs.aws.amazon.com/eks/latest/userguide/ek - [kube-proxy](https://docs.aws.amazon.com/eks/latest/userguide/managing-kube-proxy.html) - [vpc-cni](https://docs.aws.amazon.com/eks/latest/userguide/managing-vpc-cni.html) -## Issue 15: +## Issue 10: ### Review cluster components for upgrading https://runbooks.cloud-platform.service.justice.gov.uk/container-images.html#container-images-used-by-cluster-components Review the compatibility matrix for all cluster components and verify if the image is compatible with the upgraded kuebrnetes version -## Issue 16: +## Issue 11: ### Review and upgrade kube-state-metrics for the upgraded cluster version https://runbooks.cloud-platform.service.justice.gov.uk/container-images.html#container-images-used-by-cluster-components @@ -153,21 +137,21 @@ https://github.com/kubernetes/kube-state-metrics?tab=readme-ov-file#compatibilit Review the compatibility matrix of kube-state-metrics and verify if the image is compatible with the upgraded kuebrnetes version. If the version is mismatch, check if the whole kube-prometheus-chart needs updating to get the default version of kube-state-metrics from the chart-> values. Otherwise, pin the kube-state-metrics image to match the kubernetes-version -## Issue 17: +## Issue 12: ### Upgrade cluster autoscalar for k8s version The Cloud Platform Cluster is in k8s version . Hence upgrade the cluster-autoscalar to match the k8s version. https://github.com/kubernetes/autoscaler/tree/master/charts/cluster-autoscaler https://github.com/ministryofjustice/cloud-platform-terraform-cluster-autoscaler -## Issue 18: +## Issue 13: ### Upgrade cluster descheudler for k8s version The Cloud Platform Cluster is in k8s version . Hence upgrade the descheduler to match the k8s version. https://github.com/kubernetes-sigs/descheduler?tab=readme-ov-file#%EF%B8%8F--documentation-versions-by-release https://github.com/ministryofjustice/cloud-platform-terraform-descheduler -## Issue 19: +## Issue 14: ### Post k8s version Cleanup Following upgrade from EKS , there will be a number of cleanup activities that need addressing: