Document Sync by Tina

ServerlessLLM · Jul 30, 2024 · bb0f188 · bb0f188
1 parent c1038b8
commit bb0f188
Show file tree

Hide file tree

Showing 7 changed files with 17 additions and 19 deletions.
diff --git a/docs/stable/cli/SLLM-CLI Documentation.md → docs/stable/cli/cli_api.md b/docs/stable/cli/SLLM-CLI Documentation.md → docs/stable/cli/cli_api.md
diff --git a/docs/stable/dev/_category_.json b/docs/stable/dev/_category_.json
diff --git a/docs/stable/dev/custom_backends.md b/docs/stable/dev/custom_backends.md
diff --git a/docs/stable/intro.md b/docs/stable/intro.md
@@ -4,7 +4,24 @@ sidebar_position: 1
 
 # Serverless LLM
 
+<!-- logo (../images/serverlessllm.jpg) -->
+![ServerlessLLM](../images/serverlessllm.jpg)
+
+ServerlessLLM is a fast, affordable, and easy-to-use library designed for multi-LLM serving, also known as [Serverless Inference](https://docs.aws.amazon.com/sagemaker/latest/dg/serverless-endpoints.html), [Inference Endpoint](https://huggingface.co/inference-endpoints/dedicated), or [Model Endpoints](https://learn.microsoft.com/en-us/azure/machine-learning/concept-endpoints?view=azureml-api-2). This library is ideal for environments with limited GPU resources, as it allows efficient dynamic loading of models onto GPUs. By supporting high levels of GPU multiplexing, it maximizes GPU utilization without the need to dedicate GPUs to individual models.
+
 ## Documentation
 
 ### Getting Started
 
+- [Install ServerlessLLM](./getting_started/installation.md)
+- [Deploy a ServerlessLLM cluster on your local machine](./getting_started/quickstart.md)
+- [Deploy ServerlessLLM using Docker (Recommended)](./getting_started/docker_quickstart.md)
+- [Deploy ServerlessLLM on a multi-machine cluster](./getting_started/multi_machine_setup.md)
+
+### ServerlessLLM Store
+
+- [Use ServerlessLLM Store in your own code](./store/quickstart.md)
+
+### ServerlessLLM CLI
+
+- [ServerlessLLM CLI Documentation](./cli/cli_api.md)
diff --git a/docs/stable/serve/_category_.json b/docs/stable/serve/_category_.json
diff --git a/docs/stable/serve/docker_deployment.md b/docs/stable/serve/docker_deployment.md
diff --git a/docs/stable/serve/openai_compatible_server.md b/docs/stable/serve/openai_compatible_server.md