Skip to content

Commit

Permalink
Merge pull request #95 from opendatahub-io-contrib/fix/broken-link
Browse files Browse the repository at this point in the history
fixing links to other repo
  • Loading branch information
erwangranger authored Aug 7, 2024
2 parents 073348d + 52c21b3 commit f35b8c6
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion docs/generative-ai/llm-serving.md
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,9 @@ On top of the Caikit+TGIS or TGIS built-in runtimes, the following custom runtim

#### Standalone Inference Servers

- [vLLM](https://github.com/rh-aiservices-bu/llm-on-openshift/blob/main/llm-servers/vllm/README.md){:target="_blank"}: how to deploy vLLM, the "Easy, fast, and cheap LLM serving for everyone".
- vLLM: how to deploy vLLM, the "Easy, fast, and cheap LLM serving for everyone".
- on [GPU](https://github.com/rh-aiservices-bu/llm-on-openshift/blob/main/llm-servers/vllm/gpu/README.md){:target="_blank"}:
- on [CPU](https://github.com/rh-aiservices-bu/llm-on-openshift/blob/main/llm-servers/vllm/cpu/README.md){:target="_blank"}:
- [Hugging Face TGI](https://github.com/rh-aiservices-bu/llm-on-openshift/blob/main/llm-servers/hf_tgi/README.md){:target="_blank"}: how to deploy the Text Generation Inference server from Hugging Face.
- [Caikit-TGIS-Serving](https://github.com/opendatahub-io/caikit-tgis-serving){:target="_blank"}: how to deploy the Caikit-TGIS-Serving stack, from OpenDataHub.

Expand Down

0 comments on commit f35b8c6

Please sign in to comment.