Skip to content

v1.9
Compare
Choose a tag to compare
@DefTruth DefTruth released this 12 Aug 01:27
· 103 commits to main since this release
v1.9
e6b8cf4
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • 🔥[DynamoLLM] DynamoLLM: Designing LLM Inference Clusters for Performa… by @DefTruth in #28
  • 🔥[Zero-Delay QKV Compression] Zero-Delay QKV Compression for Mitigati… by @DefTruth in #29
  • 🔥[Automatic Inference Engine Tuning] Towards SLO-Optimized LLM Servin… by @DefTruth in #30
  • 🔥🔥[500xCompressor] 500xCompressor: Generalized Prompt Compression for… by @DefTruth in #31
  • Bump up to v1.9 by @DefTruth in #32

Full Changelog: v1.8...v1.9

Contributors

DefTruth
Assets 2
Loading