This repository has been archived by the owner on Oct 25, 2024. It is now read-only.
h2o for kv cache compression #5080
n1ck-guochatbot-test.yml
on: pull_request
call-inference-llama-2-7b-chat-hf
/
inference test
3m 14s
call-inference-mpt-7b-chat
/
inference test
2m 56s