Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

Inference code for LLaMA models

Ongoing research training transformer models at scale

Making big AI models cheaper, easier, and more scalable

A fast MoE impl for PyTorch

⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF etc.

Contrastive Language-Image Pretraining

AutoML tools chain

Several simple examples for popular neural network toolkits calling custom CUDA operators.

Deep Learning Book Chinese Translation

Python Implementation of Reinforcement Learning: An Introduction

code for "Fast Patch-based Style Transfer of Arbitrary Style".

This contains my past machine learning notes

Basic Machine Learning and Deep Learning

Matlab/Octave toolbox for deep learning. Includes Deep Belief Nets, Stacked Autoencoders, Convolutional Neural Nets, Convolutional Autoencoders and vanilla Neural Nets. Each method has examples to …

GraphCut

Code and hyperparameters for the paper "Generative Adversarial Networks"