Skip to content
LLM Harness Evalution

LLM Harness Evaluation #253

Sign in to view logs

LLM Harness Evaluation

LLM Harness Evaluation #253

Run time

Learn about OS pricing on GitHub Actions
Job Run time
set-matrix
1s
llm-cpp-build / check-linux-avxvnni-artifact
2s
llm-cpp-build / check-linux-amx-artifact
3s
llm-cpp-build / check-linux-avx512-artifact
2s
llm-cpp-build / check-windows-avx2-artifact
2s
llm-cpp-build / check-windows-avx-artifact
2s
llm-cpp-build / check-windows-avx-vnni-artifact
2s
llm-cpp-build / windows-build-avx2
1m 4s
llm-cpp-build / windows-build-avx-vnni
3m 38s
llm-cpp-build / windows-build-avx
56s
llm-cpp-build / linux-build-avx512
2m 9s
llm-cpp-build / linux-build-avxvnni
1m 59s
llm-cpp-build / linux-build-amx
52s
llm-harness-evalution (3.9, Llama2-7b-guanaco-dolphin-500, arc, sym_int4, xpu)
56m 28s
llm-harness-evalution (3.9, Llama2-7b-guanaco-dolphin-500, arc, fp8, xpu)
7m 35s
llm-harness-evalution (3.9, Llama2-7b-guanaco-dolphin-500, truthfulqa, sym_int4, xpu)
6m 25s
llm-harness-evalution (3.9, Llama2-7b-guanaco-dolphin-500, truthfulqa, fp8, xpu)
6m 26s
llm-harness-evalution (3.9, Llama2-7b-guanaco-dolphin-500, winogrande, sym_int4, xpu)
1h 33m 1s
llm-harness-evalution (3.9, Llama2-7b-guanaco-dolphin-500, winogrande, fp8, xpu)
19m 58s
llm-harness-evalution (3.9, falcon-7b-instruct-with-patch, arc, sym_int4, xpu)
47m 14s
llm-harness-evalution (3.9, falcon-7b-instruct-with-patch, arc, fp8, xpu)
47m 34s
llm-harness-evalution (3.9, falcon-7b-instruct-with-patch, truthfulqa, sym_int4, xpu)
26m 1s
llm-harness-evalution (3.9, falcon-7b-instruct-with-patch, truthfulqa, fp8, xpu)
24m 50s
llm-harness-evalution (3.9, falcon-7b-instruct-with-patch, winogrande, sym_int4, xpu)
14m 24s
llm-harness-evalution (3.9, falcon-7b-instruct-with-patch, winogrande, fp8, xpu)
13m 47s
llm-harness-evalution (3.9, Mistral-7B-v0.1, arc, sym_int4, xpu)
51m 11s
llm-harness-evalution (3.9, Mistral-7B-v0.1, arc, fp8, xpu)
51m 1s
llm-harness-evalution (3.9, Mistral-7B-v0.1, truthfulqa, sym_int4, xpu)
24m 50s
llm-harness-evalution (3.9, Mistral-7B-v0.1, truthfulqa, fp8, xpu)
27m 13s
llm-harness-evalution (3.9, Mistral-7B-v0.1, winogrande, sym_int4, xpu)
16m 2s
llm-harness-evalution (3.9, Mistral-7B-v0.1, winogrande, fp8, xpu)
15m 28s
llm-harness-evalution (3.9, mpt-7b-chat, arc, sym_int4, xpu)
54m 53s
llm-harness-evalution (3.9, mpt-7b-chat, arc, fp8, xpu)
54m 7s
llm-harness-evalution (3.9, mpt-7b-chat, truthfulqa, sym_int4, xpu)
23m 22s
llm-harness-evalution (3.9, mpt-7b-chat, truthfulqa, fp8, xpu)
26m 44s
llm-harness-evalution (3.9, mpt-7b-chat, winogrande, sym_int4, xpu)
15m 22s
llm-harness-evalution (3.9, mpt-7b-chat, winogrande, fp8, xpu)
15m 34s
llm-harness-evalution (3.9, Baichuan2-7B-Chat-LLaMAfied, arc, sym_int4, xpu)
50m 31s
llm-harness-evalution (3.9, Baichuan2-7B-Chat-LLaMAfied, arc, fp8, xpu)
56m 29s
llm-harness-evalution (3.9, Baichuan2-7B-Chat-LLaMAfied, truthfulqa, sym_int4, xpu)
25m 3s
llm-harness-evalution (3.9, Baichuan2-7B-Chat-LLaMAfied, truthfulqa, fp8, xpu)
29m 31s
llm-harness-evalution (3.9, Baichuan2-7B-Chat-LLaMAfied, winogrande, sym_int4, xpu)
14m 41s
llm-harness-evalution (3.9, Baichuan2-7B-Chat-LLaMAfied, winogrande, fp8, xpu)
14m 35s
llm-harness-evalution (3.9, stablelm-3b, arc, sym_int4, xpu)
7m 9s
llm-harness-evalution (3.9, stablelm-3b, arc, fp8, xpu)
6m 38s
llm-harness-evalution (3.9, stablelm-3b, truthfulqa, sym_int4, xpu)
6m 43s
llm-harness-evalution (3.9, stablelm-3b, truthfulqa, fp8, xpu)
5m 5s
llm-harness-evalution (3.9, stablelm-3b, winogrande, sym_int4, xpu)
5m 31s
llm-harness-evalution (3.9, stablelm-3b, winogrande, fp8, xpu)
7m 36s
llm-harness-summary
19s
16h 20m 13s