This repository has been archived by the owner on Oct 25, 2024. It is now read-only.
h2o for kv cache compression #5076
pre-commit-ci[bot]chatbot-test.yml
on: pull_request
call-inference-llama-2-7b-chat-hf
/
inference test
3m 28s
call-inference-mpt-7b-chat
/
inference test
3m 11s