Skip to content

Commit

Permalink
Update planned features
Browse files Browse the repository at this point in the history
  • Loading branch information
pkelaita committed Feb 17, 2025
1 parent 64d5e50 commit 5b40cd9
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -71,12 +71,14 @@ For the full usage guide, including memory, asynchronous usage, local models, JS
## Planned Features

- Streaming responses
- Embeddings
- Other self-hosted providers (GPT4all, LMStudio, etc.)
- Support Other self-hosted providers (vLLM, GPT4all, LMStudio, etc.)
- Basic tools for common application workflows: RAG, prompt management, search, etc.
- More customization with response formats
- Basic agent & multi-agent system features (a lightweight version of something like [LangGraph](https://www.langchain.com/langgraph) but with stuff I want)
- Support for batch APIs where available (OpenAI, Anthropic, etc.)
- Support for embeddings as well as inference
- Support for structured outputs where available (Just OpenAI as far as I know)
- Port this project over to other languages (TypeScript and Go, maybe Rust)
- ...etc.

## Contributing
Expand Down

0 comments on commit 5b40cd9

Please sign in to comment.