Skip to content

Commit

Permalink
Update docs/source/how-to/cloud/aws.mdx
Browse files Browse the repository at this point in the history
  • Loading branch information
alvarobartt committed Oct 23, 2024
1 parent 179f15c commit 771f36c
Showing 1 changed file with 4 additions and 3 deletions.
7 changes: 4 additions & 3 deletions docs/source/how-to/cloud/aws.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -14,15 +14,15 @@ With HUGS, developers can easily find, subscribe to, and deploy Hugging Face mod

![HUGS on AWS Marketplace](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/hugs/aws/hugs-marketplace-listing.png)

2. Subscribe to the product in AWS Marketplace by following the instructions on the page. At the time of writing (September 2024), the steps are to:
2. Subscribe to the product in AWS Marketplace by following the instructions on the page. At the time of writing (October 2024), the steps are to:

1. Click `Continue to Subscribe`, then go to the next page.
2. Click `Continue to Configuration`, then go to the next page.
3. Select the fulfillment option & software version (HUGS Version and model you want to use) from the list.
3. Select the fulfillment option e.g. `open LLMs for NVIDIA GPUS`, and the software version e.g. `0.1.0`.

![HUGS Configuration on AWS Marketplace](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/hugs/aws/hugs-configuration.png)

3. Then click `Continue to Launch`. You successfully subscribe to HUGS. You can now follow the steps below to deploy your preferred HUGS container and model using AWS EKS.
3. Then click `Continue to Launch`. You successfully subscribe to HUGS. You can now follow the steps below to deploy your preferred HUGS container and model using AWS EKS, with the provided container URIs.

<Tip>

Expand Down Expand Up @@ -198,6 +198,7 @@ helm install $DEPLOYMENT_NAME hugs/hugs \
--set image.registry="XXXXXXXXXXXX.dkr.ecr.us-east-1.amazonaws.com" \
--set image.repository="hugging-face" \
--set image.name="nvidia-meta-llama-meta-llama-3.1-8b-instruct" \
--set image.tag="0.1.0" \
--set serviceAccountName=$SERVICE_ACCOUNT_NAME \
--set nodeSelector."eks\.amazonaws\.com/nodegroup"=$NODE_GROUP_NAME
```
Expand Down

0 comments on commit 771f36c

Please sign in to comment.