Skip to content

now with llama.cpp support for running LLMs locally

Latest
Compare
Choose a tag to compare
@tarasglek tarasglek released this 08 Jul 15:40
· 41 commits to main since this release
3a42a45

This release has better non-openai provider support. Most notably llama.cpp and deepseek work now.

See blog post for details on using chatcraft with llama.cpp.

Changes

  • simplify message format, improve unofficial-openai provider compatibility by @tarasglek in #661
  • make model listing llama.cpp friendly by @tarasglek in #662

Full Changelog: v2.2.0...v2.2.1