Release 0.4.2

0.4.2 (2024-11-21)

Bug Fixes

• ts, docs: missing docs of classes / types (1bfc8d8)

Features

• expose DRY sampler params (#91) (0c04b5e)
• support multiple lora files & dynamic apply / remove lora (#92) (9b6ea9f)
• sync llama.cpp (#95) (276a90a)

Release 0.4.1

0.4.1 (2024-11-17)

Bug Fixes

• cpp, ios: add prefix for iq2/iq3 func for avoid redef from another libs used ggml (8ce5216)
• cpp: validateModelChatTemplate missing messages check (c1d15a3)
• ts: remove file:// prefix for lora param (da3e9a7)

Features

• add static method for read model info from gguf (#87) (8bf9dd8)
• cpp: remove unused json and json-schema-to-grammar in common (#90) (0a37cda)
• expose flash_attn / cache_type_k / cache_type_v (4ce8ff8)
• no longer need disable mmap for lora (38fa660)
• sync llama.cpp (#89) (5e1b30a)
• ts: expose template for getFormattedChat (c473995), closes #84
• update embedding method (#88) (6190f57)

Release 0.4.0

0.4.0 (2024-11-04)

Features

• add progress callback in initLlama (#82) (41b779f)
• sync llama.cpp (#79) (1ca3044)

Release 0.3.7

0.3.7 (2024-07-29)

Bug Fixes

• cpp: correct validateModelChatTemplate fn (f9ed84a)

Features

• example: add Chat Template in initial message (124cb6a)

Release 0.3.6

0.3.6 (2024-07-28)

Features

• example: update json schema example (2f70192)
• support chat format (#72) (030ebaf)

Release 0.3.5

0.3.5 (2024-07-27)

Bug Fixes

• android: revert Debug comment (7972f83)
• cpp: incomplete utf-8 character (3799cf8)
• not init sampling before get embedding (#69) (1088300)

Features

• sync llama.cpp (#71) (a579ce3)

Release 0.3.3

0.3.3 (2024-07-22)

Bug Fixes

• add build for armv82 and v84 and sync llama.cpp (#67) (1942159)
• android: loadSession not taking paths with file:// (#66) (39d1e05)

Release 0.3.2

0.3.2 (2024-05-29)

Features

• sync llama.cpp (#58) (dc6a47a)

Release 0.3.0

0.3.0 (2024-04-26)

Features

• add model details in context (#52) (f2a4c53)
• android, example: disable repeat penalties by default (cf685ad)
• example: add missing commands help (4a53e68)
• migrate to new session API (725117c)

Release 0.3.0-rc.18

0.3.0-rc.18 (2024-04-25)

Features

• sync llama.cpp (#51) (0b8f9bb)
• ts: sync grammar converter (#48) (7834a73)