From 33a65e94d0511e4ba5785cbb6bfda17e874e348e Mon Sep 17 00:00:00 2001 From: Chivier Humber Date: Fri, 22 Nov 2024 22:54:48 +0000 Subject: [PATCH] Document Sync by Tina --- docs/stable/models/supported_models.md | 13 +++++++++++++ 1 file changed, 13 insertions(+) create mode 100644 docs/stable/models/supported_models.md diff --git a/docs/stable/models/supported_models.md b/docs/stable/models/supported_models.md new file mode 100644 index 0000000..6077615 --- /dev/null +++ b/docs/stable/models/supported_models.md @@ -0,0 +1,13 @@ +# Supported Models + +ServerlessLLM supports a plethora of language models from [Huggingface (HF) Transformers](https://huggingface.co/models). This page lists the models and model architectures currently supported by ServerlessLLM. + +To test a model, simply add it to the `supported_models.json` inside `/ServerlessLLM/tests/inference_tests` and the Github Actions will automatically test whether not it is supported. + +## Text-only Language Models + +Architecture |Models |Example HF Models |vLLM |Transformers +------------------|--------------|--------------------|-----|------------- +`OPTForCausalLM` |OPT, OPT-IML |`facebook/opt-6.7b` |✅ |✅ + +