Document Sync by Tina

ServerlessLLM · Nov 22, 2024 · 33a65e9 · 33a65e9
1 parent b36dea7
commit 33a65e9
Showing 1 changed file with 13 additions and 0 deletions.
diff --git a/docs/stable/models/supported_models.md b/docs/stable/models/supported_models.md
@@ -0,0 +1,13 @@
+# Supported Models
+
+ServerlessLLM supports a plethora of language models from [Huggingface (HF) Transformers](https://huggingface.co/models). This page lists the models and model architectures currently supported by ServerlessLLM.
+
+To test a model, simply add it to the `supported_models.json` inside `/ServerlessLLM/tests/inference_tests` and the Github Actions will automatically test whether not it is supported.
+
+## Text-only Language Models
+
+Architecture      |Models        |Example HF Models   |vLLM |Transformers
+------------------|--------------|--------------------|-----|-------------
+`OPTForCausalLM`  |OPT, OPT-IML  |`facebook/opt-6.7b` |✅   |✅
+
+