Skip to content

@neuralmagic Neural Magic

Change the repository type filter

All

    Repositories list

    61 repositories

    • nm-vllm-certs

      Public
      General Information, model certifications, and benchmarks for nm-vllm enterprise distributions
      vllm
      1•8•1•0•Updated Dec 26, 2024Dec 26, 2024

    • vllm-flash-attention

      Public
      Fast and memory-efficient exact attention
      C++
      •
      BSD 3-Clause "New" or "Revised" License
      •1.4k•0•0•0•Updated Dec 24, 2024Dec 24, 2024

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •5k•7•0•20•Updated Dec 24, 2024Dec 24, 2024

    • compressed-tensors

      Public
      A safetensors extension to efficiently store sparse quantized tensors on disk
      Python
      •
      Apache License 2.0
      •4•57•2•10•Updated Dec 23, 2024Dec 23, 2024

    • yolov5

      Public
      YOLOv5 in PyTorch > ONNX > CoreML > TFLite
      Python
      •
      GNU General Public License v3.0
      •17k•20•0•2•Updated Dec 23, 2024Dec 23, 2024

    • upstream-transformers

      Public
      🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
      Python
      •
      Apache License 2.0
      •27k•1•0•1•Updated Dec 23, 2024Dec 23, 2024

    • axolotl

      Public
      Go ahead and axolotl questions
      Python
      •
      Apache License 2.0
      •898•0•0•1•Updated Dec 20, 2024Dec 20, 2024

    • nm-actions

      Public
      Neural Magic GHA
      Python
      •
      Apache License 2.0
      •0•0•0•2•Updated Dec 18, 2024Dec 18, 2024

    • guidellm

      Public
      Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
      Python
      •
      Apache License 2.0
      •14•178•10•9•Updated Dec 11, 2024Dec 11, 2024

    • quant_kernel_benchmarks

      Public
      Benchmarking code for running quantized kernels from vLLM and other libraries
      Python
      •0•4•1•0•Updated Dec 3, 2024Dec 3, 2024

    • lm-evaluation-harness

      Public
      A framework for few-shot evaluation of language models.
      Python
      •
      MIT License
      •2k•3•0•1•Updated Nov 27, 2024Nov 27, 2024

    • docs

      Public
      Top-level directory for documentation and general content
      MDX
      •7•120•0•4•Updated Nov 25, 2024Nov 25, 2024

    • flash-attention

      Public
      Fast and memory-efficient exact attention
      C++
      •
      BSD 3-Clause "New" or "Revised" License
      •1.4k•0•0•0•Updated Nov 23, 2024Nov 23, 2024

    • mistral-evals

      Public
      Python
      •4•0•0•0•Updated Nov 21, 2024Nov 21, 2024

    • evalplus

      Public
      NeuralMagic fork of EvalPlus (Rigourous evaluation of LLM-synthesized code - NeurIPS 2023)
      Python
      •
      Apache License 2.0
      •114•0•0•0•Updated Nov 21, 2024Nov 21, 2024

    • graphs

      Public
      Apache License 2.0
      •0•0•0•0•Updated Nov 15, 2024Nov 15, 2024

    • temp-llm-compressor

      Public
      Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
      Python
      •
      Apache License 2.0
      •66•0•0•0•Updated Nov 14, 2024Nov 14, 2024

    • alpaca_eval

      Public
      An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
      Jupyter Notebook
      •
      Apache License 2.0
      •246•0•0•0•Updated Nov 12, 2024Nov 12, 2024

    • upstream-llm-foundry

      Public
      LLM training code for MosaicML foundation models
      Python
      •
      Apache License 2.0
      •534•0•0•0•Updated Oct 24, 2024Oct 24, 2024

    • nm-vllm

      Public archive
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Other
      •5k•254•0•0•Updated Oct 11, 2024Oct 11, 2024

    • mteb

      Public
      MTEB: Massive Text Embedding Benchmark
      Jupyter Notebook
      •
      Apache License 2.0
      •289•0•0•1•Updated Oct 2, 2024Oct 2, 2024

    • transformers

      Public
      🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
      Python
      •
      Apache License 2.0
      •27k•9•0•13•Updated Oct 1, 2024Oct 1, 2024

    • AutoFP8

      Public
      Python
      •
      Apache License 2.0
      •23•165•10•3•Updated Oct 1, 2024Oct 1, 2024

    • OmniQuant

      Public
      [ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.
      Python
      •
      MIT License
      •56•0•0•1•Updated Sep 27, 2024Sep 27, 2024

    • temp-AutoGPTQ

      Public
      An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
      Python
      •
      MIT License
      •491•0•0•0•Updated Sep 16, 2024Sep 16, 2024

    • upstream-composer

      Public
      Supercharge Your Model Training
      Python
      •
      Apache License 2.0
      •427•0•0•0•Updated Aug 27, 2024Aug 27, 2024

    • MixEval

      Public
      NM fork of MixEval compatible with SparseAutoModel.
      Python
      •37•0•0•1•Updated Aug 20, 2024Aug 20, 2024

    • mamba

      Public
      Mamba SSM architecture
      Python
      •
      Apache License 2.0
      •1.2k•0•0•0•Updated Aug 12, 2024Aug 12, 2024

    • causal-conv1d

      Public
      Causal depthwise conv1d in CUDA, with a PyTorch interface
      Cuda
      •
      BSD 3-Clause "New" or "Revised" License
      •69•0•0•0•Updated Aug 8, 2024Aug 8, 2024

    • sparseml

      Public
      Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
      sparsitykerasdeep-learning-algorithmsdeep-learning-librarypruningobject-detectioncomputer-vision-algorithmsonnxdeep-learning-modelssparsification
      Python
      •
      Apache License 2.0
      •148•2.1k•7•60•Updated Aug 1, 2024Aug 1, 2024