Skip to content
CI - sharktank perplexity short

Add input len 2048 test for bs4 tp1 8b f16 non-decomposed prefill #258

Sign in to view logs

Add input len 2048 test for bs4 tp1 8b f16 non-decomposed prefill

Add input len 2048 test for bs4 tp1 8b f16 non-decomposed prefill #258

Annotations

1 error

Llama3.1 8B FP16 (3.11, llama-mi300x-3)

Llama3.1 8B FP16 (3.11, llama-mi300x-3)
failed Dec 3, 2024 in 3m 20s