Skip to content

Commit

Permalink
Document Sync by Tina
Browse files Browse the repository at this point in the history
  • Loading branch information
Chivier committed Oct 10, 2024
1 parent 11339ad commit 3b54936
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/stable/store/quickstart.md
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ ln -s /mnt/nvme/models ./models

1. Convert a model to ServerlessLLM format and save it to a local path:
```python
from serverless_llm_store import save_model
from serverless_llm_store.transformers import save_model

# Load a model from HuggingFace model hub.
import torch
Expand Down Expand Up @@ -84,7 +84,7 @@ docker run -it --rm -v $PWD/models:/app/models checkpoint_store_server
```python
import time
import torch
from serverless_llm_store import load_model
from serverless_llm_store.transformers import load_model

# warm up the GPU
num_gpus = torch.cuda.device_count()
Expand Down

0 comments on commit 3b54936

Please sign in to comment.