Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add CNAI Patterns/Blueprints #175

Open
zanetworker opened this issue Jul 22, 2024 · 3 comments
Open

Add CNAI Patterns/Blueprints #175

zanetworker opened this issue Jul 22, 2024 · 3 comments
Assignees
Labels
cnai Issues related to the CNAI WG

Comments

@zanetworker
Copy link
Collaborator

zanetworker commented Jul 22, 2024

Add a section for patterns/blueprints under https://tag-runtime.cncf.io/wgs/cnaiwg/

Blueprints/patterns are:

  • Actionable/Hands-on
  • Encapsulates well-accommodated patterns of Cloud Native for (or AI for cloud native).

Patterns/blueprints are are not a replacement to white papers. White papers cover more ground on a large topic (e.g., scheduling, sustainability,...). Blueprints cover a pattern towards a particular outomce. For example, how to scale functions for quick and cost-efficient LLM inferencing.

@zanetworker zanetworker added the cnai Issues related to the CNAI WG label Jul 22, 2024
@zanetworker zanetworker self-assigned this Jul 22, 2024
@pierDipi
Copy link

pierDipi commented Jul 26, 2024

In case this helps with coordinating efforts with other groups, there are 2 proposals related to CNAI blueprints that were discussed in the Kubernetes WG Serving:

  1. “Blueprint” Is All You Need: https://docs.google.com/document/d/1tNWnDAhLj9lsTg5dOIBbe7olPH0-4efe2uN-FZIc_KU/edit
  2. K8s LLM Serving Catalog: https://docs.google.com/document/d/1yXOhEXltc69_WFX90kMrHs3NcJGsD-U6-RejvK3XQtE/edit

@andreyvelich
Copy link

Additionally, here is the KEP from Kubeflow Training WG and Kubernetes Batch WG to create Training Runtimes with blueprints for LLM Fine-Tuning and Distributed Training on Kubernetes: kubeflow/training-operator#2171

@zanetworker
Copy link
Collaborator Author

Very nice, thank you, @andreyvelich and @pierDipi; I will take a closer look at the pointers you shared. This might end up being just the place to consolidate and point to all other blueprints as well (or create new ones for new topics).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cnai Issues related to the CNAI WG
Projects
Status: Backlog
Development

No branches or pull requests

3 participants