v0.4.11

What's Changed

• Add distribute=None to python-api.md by @rasbt in #1676
• Make LitGPT LLM API compatible with PyTorch Lightning Trainer 1/2 by @rasbt in #1667
• Auto device handling in LLM API by @rasbt in #1677
• Fix KV cache issue in LLM API by @rasbt in #1678
• Improved benchmark utils by @rasbt in #1679
• Add PR benchmark util for internal use by @rasbt in #1680
• Added git hash to benchmark utility. by @apaz-cli in #1681
• Spelling fix by @rasbt in #1685
• Add Microsoft Phi 3.5 checkpoint by @rasbt in #1687
• Update check_nvlink_connectivity by @sanderland in #1684
• Make number of generated tokens consistent with CLI by @rasbt in #1690
• Avoid error when executing benchmark util outside a git folder by @rasbt in #1691
• Combine generate() functions by @apaz-cli in #1675
• Bumb version to 0.4.11 by @rasbt in #1695
• Fix falcon prompt template by @rasbt in #1696

New Contributors

• @sanderland made their first contribution in #1684

Full Changelog: v0.4.10...v0.4.11