Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add streaming of prompt flow responses #1182

Open
teebu opened this issue Nov 19, 2024 · 0 comments
Open

Add streaming of prompt flow responses #1182

teebu opened this issue Nov 19, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@teebu
Copy link

teebu commented Nov 19, 2024

Is your feature request related to this sample app, or to an Azure service, such as Azure OpenAI or Azure AI Search?
Enable streaming responses from prompt flow.

Is your feature request related to a problem? Please describe.
Streaming of regular requests is working, but it would be great if prompt flow response were also streamed to improve responsiveness of chat.

Describe the solution you'd like
Implement https://learn.microsoft.com/en-us/azure/machine-learning/prompt-flow/how-to-enable-streaming-mode?view=azureml-api-2

Is this feature specific to your use case or your organization, or would it apply broadly across other uses of this app?
Streaming makes things feel snappier.

@teebu teebu added the enhancement New feature or request label Nov 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant