Back to pull request #3562

bench: Add a benchmark for vLM: MMMU #6320

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
filter	5s
filter	5s
filter	5s
unit-test-backend-2-gpu	10m 28s
unit-test-backend-2-gpu	10m 28s
unit-test-backend-2-gpu	10m 28s
unit-test-backend-1-gpu (0-6)	16m 30s
unit-test-backend-1-gpu (0-6)	16m 30s
unit-test-backend-1-gpu (0-6)	16m 30s
performance-test-1-gpu-part-1	12m 13s
performance-test-1-gpu-part-1	12m 13s
performance-test-1-gpu-part-1	12m 13s
unit-test-backend-1-gpu (6-15)	32m 5s
unit-test-backend-1-gpu (6-15)	1s
unit-test-backend-1-gpu (6-15)	18m 10s
unit-test-frontend	2m 44s
unit-test-frontend	2m 44s
unit-test-frontend	2m 44s
unit-test-backend-1-gpu (15-22)	2m 27s
unit-test-backend-1-gpu (15-22)	2m 27s
unit-test-backend-1-gpu (15-22)	13m 9s
accuracy-test-1-gpu	5m 54s
accuracy-test-1-gpu	5m 54s
accuracy-test-1-gpu	5m 54s
unit-test-backend-1-gpu (22-32)	17m 17s
unit-test-backend-1-gpu (22-32)	17m 17s
unit-test-backend-1-gpu (22-32)	17m 17s
accuracy-test-2-gpu	7m 18s
accuracy-test-2-gpu	7m 18s
accuracy-test-2-gpu	7m 18s
unit-test-backend-1-gpu (32-40)	14m 13s
unit-test-backend-1-gpu (32-40)	14m 13s
unit-test-backend-1-gpu (32-40)	14m 13s
performance-test-1-gpu-part-2	11m 47s
performance-test-1-gpu-part-2	11m 47s
performance-test-1-gpu-part-2	11m 47s
unit-test-backend-1-gpu (40-100)	18m 19s
unit-test-backend-1-gpu (40-100)	18m 19s
unit-test-backend-1-gpu (40-100)	18m 19s
performance-test-2-gpu	11m 1s
performance-test-2-gpu	11m 1s
performance-test-2-gpu	11m 1s
finish	1s
finish	1s
finish	1s
	7h 31m 49s