You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Use FP8 KV cache when specified by compressed-tensors#2761
Merged
danieldk merged 1 commit intomainhuggingface/text-generation-inference:mainfrom feature/compressed-tensors-kv-cache-fp8huggingface/text-generation-inference:feature/compressed-tensors-kv-cache-fp8Copy head branch name to clipboardNov 26, 2024
