enabling multi-node serving on Gaudi ray cluster#218

Closed

vishnumadhu365 wants to merge 2 commits intoHabanaAI:habana_mainfrom vishnumadhu365:habana_main

+21-1

Commits on Aug 29, 2024

enabling multi-node vllm on ray cluster, tested for meta-llama/Meta-Llama-3.1-405B-Instruct. Originally implemented in SW-195705
vishnumadhu365
committed

Commits on Sep 2, 2024

Merge pull request #1 from HabanaAI/habana_main
vishnumadhu365
authored