Document Sync by Tina

ServerlessLLM · Sep 17, 2024 · 5ae73b8 · 5ae73b8
1 parent d475314
commit 5ae73b8
Show file tree

Hide file tree

Showing 2 changed files with 12 additions and 2 deletions.
diff --git a/docs/stable/getting_started/installation.md b/docs/stable/getting_started/installation.md
@@ -38,5 +38,5 @@ To use vLLM with ServerlessLLM, we need to apply our patch `serverless_llm/store
 
 You may do that by running our script:
 ```bash
-./serverless_llm/store/patch.sh
+./serverless_llm/store/vllm_patch/patch.sh
 ```
diff --git a/docs/stable/store/quickstart.md b/docs/stable/store/quickstart.md
@@ -111,8 +111,18 @@ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
 
 :::tip
 To use ServerlessLLM as the load format for vLLM, you need to apply our patch `serverless_llm/store/vllm_patch/sllm_load.patch` to the installed vLLM library. Therefore, please ensure you have applied our `vLLM Patch` as instructed in [installation guide](../getting_started/installation.md).
+
+You may check the patch status by running the following command:
+``` bash
+./serverless_llm/store/vllm_patch/check_patch.sh
+```
+If the patch is not applied, you can apply it by running the following command:
+```bash
+./serverless_llm/store/vllm_patch/patch.sh
+```
+To remove the applied patch, you can run the following command:
 ```bash
-./serverless_llm/store/patch.sh
+./serverless_llm/store/vllm_patch/remove_patch.sh
 ```
 :::