Skip to content
CI - sharktank perplexity short

Update user docs for running llm server + upgrade gguf to 0.11.0 #431

Sign in to view logs

Update user docs for running llm server + upgrade gguf to 0.11.0

Update user docs for running llm server + upgrade gguf to 0.11.0 #431

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Llama3.1 8B FP16 (3.11, llama-mi300x-3)
4m 4s
4m 4s