You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When in streaming mode and the provider is set to "azure-openai", the last chunk containing the usage is not returned, where as it is returned from the original API.
I tested the original API and via Portkey using same configuration
What Happened?
When in streaming mode and the provider is set to "azure-openai", the last chunk containing the usage is not returned, where as it is returned from the original API.
I tested the original API and via Portkey using same configuration
What Should Have Happened?
The stream should include the last message containing the usage details.
Relevant Code Snippet
No response
Your Twitter/LinkedIn
lthakkar22
The text was updated successfully, but these errors were encountered: