Popular repositories Loading

1. llama_index llama_index Public

   Forked from run-llama/llama_index

   LlamaIndex (formerly GPT Index) is a data framework for your LLM applications

   Python

2. trt-llm-as-openai-windows trt-llm-as-openai-windows Public

   Forked from NVIDIA/trt-llm-as-openai-windows

   This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.

   Python

3. llms llms Public

   Python

4. onnxruntime onnxruntime Public

   Forked from microsoft/onnxruntime

   ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

   C++

5. onnxruntime-genai onnxruntime-genai Public

   Forked from microsoft/onnxruntime-genai

   Generative AI extensions for onnxruntime

   C++

6. Olive Olive Public

   Forked from microsoft/Olive

   Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.

   Python