Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
Signed-off-by: Artem Astafev <[email protected]>
  • Loading branch information
artem-astafev authored Nov 18, 2024
1 parent 8d0e98d commit 53a53a7
Showing 1 changed file with 5 additions and 3 deletions.
8 changes: 5 additions & 3 deletions FaqGen/docker_compose/amd/gpu/rocm/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -87,9 +87,11 @@ docker compose up -d
3. MegaService

```bash
curl http://${host_ip}:8888/v1/faqgen -H "Content-Type: application/json" -d '{
"messages": "Text Embeddings Inference (TEI) is a toolkit for deploying and serving open source text embeddings and sequence classification models. TEI enables high-performance extraction for the most popular models, including FlagEmbedding, Ember, GTE and E5."
}'
curl http://${host_ip}:8888/v1/faqgen \
-H "Content-Type: multipart/form-data" \
-F "messages=Text Embeddings Inference (TEI) is a toolkit for deploying and serving open source text embeddings and sequence classification models. TEI enables high-performance extraction for the most popular models, including FlagEmbedding, Ember, GTE and E5." \
-F "max_tokens=32" \
-F "stream=false"
```

Following the validation of all aforementioned microservices, we are now prepared to construct a mega-service.
Expand Down

0 comments on commit 53a53a7

Please sign in to comment.