Get started with kubectl-ai
with open LLMs using AIKit easily
If you don't have OpenAI API access, you can set up a local OpenAI API-compatible endpoint using AIKit on your local machine without any GPUs! For more information, see the AIKit documentaton.
docker run -d --rm -p 8080:8080 ghcr.io/sozercan/llama3.1:8b
export OPENAI_ENDPOINT="http://localhost:8080/v1"
export OPENAI_DEPLOYMENT_NAME="llama-3.1-8b-instruct"
export OPENAI_API_KEY="n/a"
After setting up the environment like above, you can use kubectl-ai
as usual.
Changelog
- 645159f update readme with local instructions (#172)
- 694bd72 chore: use system prompt (#136)
- 1b62f83 chore: bump the actions-all group across 1 directory with 5 updates (#170)
- 611003e chore: bump the k8s group across 1 directory with 3 updates (#167)
- d61dc7f chore: bump github.com/sashabaranov/go-openai from 1.26.2 to 1.27.1 (#169)
- acbd25c chore: bump github.com/spf13/cobra from 1.8.0 to 1.8.1 (#157)
- 4736ab3 chore: bump the k8s group across 1 directory with 3 updates (#152)
- 48c3ea8 chore: bump the actions-all group across 1 directory with 6 updates (#163)
- a5d5ac8 chore: bump github.com/sashabaranov/go-openai from 1.24.0 to 1.26.2 (#162)
- 9248c3d chore: bump the actions-all group across 1 directory with 8 updates (#151)
- 645fde0 chore: bump github.com/sashabaranov/go-openai from 1.21.0 to 1.24.0 (#150)
- adb09b3 chore: bump golang.org/x/net from 0.21.0 to 0.23.0 in the go_modules group (#142)
- bc15913 chore: bump github.com/sashabaranov/go-openai from 1.20.5 to 1.21.0 (#140)
- 6c0e85d chore: bump github/codeql-action from 3.24.10 to 3.25.0 in the actions-all group (#141)
- 523e8c2 chore: bump github/codeql-action from 3.24.9 to 3.24.10 in the actions-all group (#138)
- 7a48d9a chore: bump github.com/sashabaranov/go-openai from 1.20.4 to 1.20.5 (#137)
- 0f97f46 chore: bump github.com/charmbracelet/glamour from 0.6.0 to 0.7.0 (#134)
- a6ad689 chore: bump the actions-all group with 1 update (#135)
- 0052302 chore: bump the actions-all group with 2 updates (#133)
- 61dd51c chore: bump the actions-all group with 2 updates (#132)
- aeb9421 chore: bump the k8s group with 3 updates (#131)
- 5ba3940 build(deps): bump github.com/sashabaranov/go-openai from 1.20.3 to 1.20.4 (#126)
- f230ab4 ci: dependabot group stuff (#130)
- 259e2d7 build(deps): bump github.com/sashabaranov/go-openai from 1.20.2 to 1.20.3 (#118)
- 7063175 build(deps): bump ossf/scorecard-action from 2.0.6 to 2.3.1 (#119)
- 828eb5b build(deps): bump actions/dependency-review-action from 2.5.1 to 4.1.3 (#120)
- bc03dae build(deps): bump actions/upload-artifact from 3.1.3 to 4.3.1 (#121)
- 706f9b7 build(deps): bump github/codeql-action from 2.24.6 to 3.24.6 (#122)
- 18d0993 chore: improve ui and prompt (#117)
- a6f47c3 chore: use toolcalls (#116)
- 0043908 Krew manifest update for kubectl-ai version v0.0.12 (#115)
- e42b24b Brew formula update for kubectl-ai version v0.0.12 (#114)