Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changes to Kubespray 2.21.0 to adapt to Jetstream 2 #21

Draft
wants to merge 69 commits into
base: reference_v2.21.0
Choose a base branch
from

Conversation

zonca
Copy link
Owner

@zonca zonca commented Feb 22, 2023

Changes to kubespray to customize it for Jetstream 2

zonca and others added 5 commits February 22, 2023 12:08
OS images are regularly updated on JetStream2, resulting in changing
image IDs. Thus, when running `terraform apply` on an existing cluster
(for example, to up/downscale the cluster), terraform recieves a
different image ID than the one the cluster was first created with,
prompting terraform to destroy/re-creates VMs. This can cause loss of
data, particularly if the k8s master nodes are affected.

Add the
[lifecycle](https://www.terraform.io/language/meta-arguments/lifecycle)
block to ensure changes to image IDs are ignored when updating k8s
master nodes.
Virutal routers on JS2 should be used more sparingly, as they take up a
floating ip. Routers can be re-used as long as subnet CIDRs do not
overlap. This is ensured by telling terraform to create subnets through
JetStream2's default subnetpool.
@zonca
Copy link
Owner Author

zonca commented Feb 22, 2023

happily cherry-picked all changes to kubespray from #15
Next will import inventory

@zonca
Copy link
Owner Author

zonca commented Feb 23, 2023

everything seems to be working fine on Kubernetes, only actual change was a4660ad.
Also managed to deploy Jupyterhub.

Just having issues with Designate, it seems like it is not assigning me a DNS record. Opened a ticket.

@zonca
Copy link
Owner Author

zonca commented Feb 22, 2024

Now also supports GPUs and hybrid clusters, see https://www.zonca.dev/posts/2024-02-09-kubernetes-gpu-jetstream2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants