Skip to content

v0.0.4
Compare
Choose a tag to compare
@blefaudeux blefaudeux released this 17 Nov 04:53
· 939 commits to main since this release
v0.0.4
1328ba7
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
  • Fixing causality not being respected by the scaled dot product attention
  • Fixing Favor causal trainability
  • Enabling FusedLayerNorm by default if Triton is available
  • Fixing Favor with fp16
Assets 2
Loading