Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] need remote/cloud models support #212

Open
mfjiang opened this issue Feb 17, 2025 · 4 comments
Open

[FEATURE] need remote/cloud models support #212

mfjiang opened this issue Feb 17, 2025 · 4 comments

Comments

@mfjiang
Copy link

mfjiang commented Feb 17, 2025

Is your feature request related to a problem? Please describe.
Currently, it is not possible to add models hosted by Ollama that I have deployed on another server.
It is also not possible to add cloud-based models provided by api.DeepSeek.com.

Describe the solution you'd like
To add models via the API and keys of remote models, similar to how AnythingLLM or Dify does it.

Describe alternatives you've considered
The development environment does not always have models available locally.

Additional context

@mfjiang
Copy link
Author

mfjiang commented Feb 17, 2025

By the way, this program has been quite unstable and frequently crashes during use.

@niels9001
Copy link
Contributor

By the way, this program has been quite unstable and frequently crashes during use.

Any particular errors / issues that came up? Would you mind filing issues for those so we can fix 'em?

@mfjiang
Copy link
Author

mfjiang commented Feb 18, 2025

By the way, this program has been quite unstable and frequently crashes during use.

Any particular errors / issues that came up? Would you mind filing issues for those so we can fix 'em?

ok, i'll create issues if need next time.

@nmetulev
Copy link
Member

This is a good suggestion, thank you @mfjiang. We hope to add this feature in the upcoming few months.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants