Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add lima provider for macOS #1536

Merged
merged 33 commits into from
Sep 18, 2024
Merged
Changes from 1 commit
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
57dff1b
Add yaml wraper
nirs Aug 29, 2024
5dcb66f
Add kubeconfig module
nirs Aug 29, 2024
889fa30
Update kubectl-gather to 0.5.1
nirs Sep 4, 2024
559674a
Add setup for macOS
nirs Sep 4, 2024
4085ea9
Add lima provider for Apple silicon
nirs Aug 29, 2024
30b1494
Add development environment for lima
nirs Sep 2, 2024
465467e
Add a delay after starting a stopped cluster
nirs Sep 2, 2024
80d5415
Log limactl errors
nirs Sep 9, 2024
3593ea8
Log invalid json logs in debug mode
nirs Sep 12, 2024
03efd51
Disable port forwarding
nirs Aug 30, 2024
24cf10d
Change API server to use the shared network
nirs Aug 30, 2024
fc5c1cc
Configure kubelet to use the right IP address
nirs Aug 31, 2024
3e52ba6
Configure kubelet to pull images in parallel
nirs Aug 31, 2024
903aaf4
Configure kubelet feature gates
nirs Sep 1, 2024
f885412
Increase fs.inotify limits
nirs Sep 5, 2024
043ced2
Update minio to latest release
nirs Aug 31, 2024
48c8a99
Use hostpath storage for minio
nirs Aug 31, 2024
57e7bfc
Support commands reading from stdin
nirs Sep 8, 2024
ee12fef
Support command work directory
nirs Sep 8, 2024
cbd2cd7
Introduce drenv load command
nirs Sep 8, 2024
7d4e8cd
Use drenv load to load images
nirs Aug 31, 2024
4efdcf7
Disable broker certificate check on macOS
nirs Sep 5, 2024
a6b43b8
Annotate nodes with submariner public ip
nirs Sep 6, 2024
13e763b
Promote vmnet shared network route
nirs Sep 8, 2024
babea99
Upgrade submariner to 0.18.0
nirs Sep 8, 2024
4f8deb4
Wait for all clusters before deploying submariner
nirs Sep 6, 2024
9a31fee
Simplify connectivity check
nirs Sep 7, 2024
f1fc909
Fix submariner test container to keep running
nirs Sep 7, 2024
9276a56
Enable submariner for lima
nirs Sep 8, 2024
e077171
Add external-snapshotter addon
nirs Sep 9, 2024
75dd239
Replace volumesnapshot with external-snapshotter
nirs Sep 9, 2024
b3b4a4e
Fix argocd deployment on macOS
nirs Sep 10, 2024
345418a
Avoid random failures when deleting environment
nirs Sep 13, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Increase fs.inotify limits
Currently we have:

    $ sysctl fs.inotify
    fs.inotify.max_queued_events = 16384
    fs.inotify.max_user_instances = 128
    fs.inotify.max_user_watches = 45827

And we see errors like this on managed clusters even with trivial
busybox workloads:

    failed to create fsnotify watcher: too many open files

We use OpenShift worker defaults, already used for minikube[1].

[1] kubernetes/minikube#18832

Signed-off-by: Nir Soffer <nsoffer@redhat.com>
  • Loading branch information
nirs committed Sep 18, 2024
commit f885412a10c40a98dac88c3e90d9670bc0812608
6 changes: 6 additions & 0 deletions test/drenv/providers/lima/k8s.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -48,6 +48,12 @@ provision:
net.ipv4.ip_forward = 1
net.bridge.bridge-nf-call-ip6tables = 1
EOF
# Avoid "failed to creating a fsnotify watcher: too many open files"
# errors with bigger setups.
cat <<EOF | sudo tee /etc/sysctl.d/99-fs-inotify.conf
fs.inotify.max_user_instances = 8192
fs.inotify.max_user_watches = 65536
EOF
sysctl --system
# Installing kubeadm, kubelet and kubectl
export DEBIAN_FRONTEND=noninteractive
Expand Down