We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
All the three callback events on_llm_start, on_llm_end and on_llm_new_token fires for BedrockLLMAgent while streaming response.
on_llm_start
on_llm_end
on_llm_new_token
Only on_llm_new_token fires for BedrockLLMAgent while streaming response.
Refer to https://github.com/awslabs/multi-agent-orchestrator/blob/main/examples/fast-api-streaming/main.py#L41
No response
https://github.com/awslabs/multi-agent-orchestrator/blob/main/examples/fast-api-streaming/main.py#L41
The text was updated successfully, but these errors were encountered:
Hi @rjesh-git Thanks for reaching out. This example is wrong. We actually don't have any definition apart from on_llm_new_token
Here is where the callbacks are defined:
multi-agent-orchestrator/python/src/multi_agent_orchestrator/agents/agent.py
Line 25 in 58e37b5
We had plan to add more callbacks.
Sorry, something went wrong.
No branches or pull requests
Expected Behaviour
All the three callback events
on_llm_start
,on_llm_end
andon_llm_new_token
fires for BedrockLLMAgent while streaming response.Current Behaviour
Only
on_llm_new_token
fires for BedrockLLMAgent while streaming response.Code snippet
Possible Solution
No response
Steps to Reproduce
https://github.com/awslabs/multi-agent-orchestrator/blob/main/examples/fast-api-streaming/main.py#L41
The text was updated successfully, but these errors were encountered: