Skip to content

v0.0.10

Compare
Choose a tag to compare
@dianaml0 dianaml0 released this 15 Mar 15:52
· 852 commits to main since this release
fd5e5c0

Fixed

  • Expose bias flag for feedforwards, same default as Timm [#220]
  • Update eps value for layernormm, same default as torch [#221]
  • PreNorm bugfix, only one input was normalized [#233]

Added

  • Add DeepNet (DeepNorm) residual path and init [#227]