Home for Cluster API, a subproject of sig-cluster-lifecycle

NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes

A generative world for general-purpose robotics & embodied AI learning.

Images of various MLOps tools, and easily run on Kubernetes.

Kubernetes-native Job Queueing

Heterogeneous AI Computing Virtualization Middleware

Let your Claude able to think

Main repository for Datadog Agent

eBPF Observability - Distributed Tracing and Profiling

Meta's fleetwide profiler framework

Dynolog is a telemetry daemon for performance monitoring and tracing. It exports metrics from different components in the system like the linux kernel, CPU, disks, Intel PT, GPUs etc. Dynolog also …

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Ascend Device Plugin

HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container

Use PEFT or Full-parameter to finetune 350+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-V…

Ongoing research training transformer models at scale

The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.

DLRover: An Automatic Distributed Deep Learning System

本项目旨在分享大模型相关技术原理以及实战经验。

Locality Sensitive Hashing using MinHash in Python/Cython to detect near duplicate text documents

Unofficial implementation of https://arxiv.org/pdf/2407.14679

The simplest, fastest repository for training/finetuning medium-sized GPTs.

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Building a quick conversation-based search demo with Lepton AI.

Code and documentation to train Stanford's Alpaca models, and generate the data.

Hwameistor is an HA local storage system for cloud-native stateful workloads.