Release 0.3.6

Latest

Latest

jhen0409 released this 12 Jan 04:49

· 1 commit to main since this release

407b2db

feat: use string enum for pooling_type (7321702)
feat: expose flash_attn / cache_type_k / cache_type_v (ff47142)
feat: expose ubatch param (c571221)

Assets 2