-
Notifications
You must be signed in to change notification settings - Fork 126
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Ollama: support streaming #167
Comments
@anakin87 I can give this a go |
Also seems like the official python client for ollama was published few days back ollama-python, I would suggest to check that out and use it in OllamaXXX components. |
Hey @sachinsachdeva , what do you think? I usually advise caution with developing against something that's tagged as experimental |
In my opinion, in the future, the most appropriate choice might be to adopt the official python client. |
I think its match made in heaven, experimental library for Beta software 😈 |
Created #280 |
Please add this support to Chat generator as well. |
Ollama Generator should support streaming, as done in other Generators with
streaming_callback
: see for exampleOpenAIGenerator
.The text was updated successfully, but these errors were encountered: