Enable human interaction in AutoGenStudio #3432
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…ntities in UI are sanitized
…costs where available)
Related with issue of microsoft#2372
Fix bug for finding key in nested dictionary
Fix for bug microsoft#3106 dict skills and test
Fixed example workflows for autogenstudio tutorial notebook
Bug microsoft#3122 GroupChat Skills being overwritten.
* remove workflow class * bump version to 0.0.14
…microsoft#2676) * update * fix 2660 * remove unnecessary feed
* Added 'role' as a summary_args and to the reflection_with_llm flow to be able to pass the role for the summarizing prompt * Added 'role' as a summary_args and to the reflection_with_llm flow to be able to pass the role for the summarizing prompt, minor docstring adjustments * Added test for summary prompt role assignment * Fixed docstrings and mocked llm-config in the test * Update autogen/agentchat/conversable_agent.py Co-authored-by: Chi Wang <[email protected]> * ran pre-commit * ran pre-commit2 * fixed old arg name * Delete dasdaasd No idea what this file was about * Fixed incorrect merge update on test_groupchat --------- Co-authored-by: Chi Wang <[email protected]> Co-authored-by: Eric Zhu <[email protected]>
* first pass at offline agent eval integration * Integrating AgentEval for offline scenarios * removing old changes * fixing notebook, updating docs * fixing subcriteria bug * updating class comment * cleaning up agent constructors * moving AgentEval agents to separate folder and adding a brief README * fixing build breaks * fixing formatting break * fixing comments * consolidating files in the agenteval folder under contrib and cleaning up imports * fixing import ordering * adding basic agenteval tests and fixing criteria parsing bug * first try at adding openai agenteval tests to build process * adding non-openai agenteval tests to build process * updating test settings * updating openai test * Update test/agentchat/contrib/agent_eval/test_agent_eval.py Co-authored-by: Wael Karkoub <[email protected]> * Update .github/workflows/contrib-openai.yml Co-authored-by: Wael Karkoub <[email protected]> * test commit * updating typing and converting to pydantic objects * fixing test file --------- Co-authored-by: Beibin Li <[email protected]> Co-authored-by: Chi Wang <[email protected]> Co-authored-by: Wael Karkoub <[email protected]>
* Update gallery.json * Update gallery.json * Update gallery.json * Update gallery.json --------- Co-authored-by: Shaokun Zhang <[email protected]>
Co-authored-by: Chi Wang <[email protected]>
Co-authored-by: gongwn1 <[email protected]>
* update markdown hyperlinks to stable urls * update notebook images and text * re-write observability section * Updated section * update wording * added newline * update styling in image tags to be jsx compatible * added text * update link * simplified text * created blog * replace flow images with fewer shadows * reformat line * add authors * updated discord link and direct paths to image URLS * removed images since they are not stored in the AgentOps github * remove trailing whitespaces * removed newline * removed whitespace * Update website/blog/2024-07-25-AgentOps/index.mdx Co-authored-by: Mark Sze <[email protected]> * single quotes with double quotes --------- Co-authored-by: Braelyn Boynton <[email protected]> Co-authored-by: Mark Sze <[email protected]>
….md extension in the link for ConversableAgent (microsoft#3221) ConversableAgent has a break link in website/docs/Use-Cases/agent_chat.md file
Co-authored-by: Chi Wang <[email protected]> Co-authored-by: Qingyun Wu <[email protected]>
* Add gpt-4o-mini to model list * Fix formatting issue and verify with pre-commit * Remove extra space * Minor change to make pre-commit (formatting checks) pass --------- Co-authored-by: Qingyun Wu <[email protected]> Co-authored-by: Chi Wang <[email protected]> Co-authored-by: HRUSHIKESH DOKALA <[email protected]> Co-authored-by: Ian <[email protected]>
* update markdown hyperlinks to stable urls * update notebook images and text * re-write observability section * Updated section * update wording * added newline * update styling in image tags to be jsx compatible * added text * update link * simplified text * created blog * replace flow images with fewer shadows * reformat line * add authors * updated discord link and direct paths to image URLS * removed images since they are not stored in the AgentOps github * remove trailing whitespaces * removed newline * removed whitespace * Update website/blog/2024-07-25-AgentOps/index.mdx Co-authored-by: Mark Sze <[email protected]> * single quotes with double quotes * fix widths --------- Co-authored-by: Braelyn Boynton <[email protected]> Co-authored-by: Mark Sze <[email protected]>
* bump version * update * format --------- Co-authored-by: kevin666aa <[email protected]> Co-authored-by: Yiran Wu <[email protected]> Co-authored-by: Chi Wang <[email protected]>
…t#3220) * [Typo] Update MongoDB Notebook to acknlowedge >=M10 support The notebook instructions state we support only >=M30 clusters for AutoGen. This is slightly misleading. We support >=M10 clusters or any cluster that allows for index creation from client code. This support is continually updating so this PR updates the language to reflect that. * Add link! --------- Co-authored-by: Li Jiang <[email protected]>
Co-authored-by: HRUSHIKESH DOKALA <[email protected]>
* fix broken reference links that's pointing to a page that doesn't exists * Fix 2 broken links and use the correct format --------- Co-authored-by: Chi Wang <[email protected]>
* Update error language and corresponding tests * Updated another test to use the new error message
…alling in Ollama (microsoft#3197) * Recreated documentation for Local LLMs - LiteLLM and Ollama * Added Docker = False for code execution example --------- Co-authored-by: Chi Wang <[email protected]>
…t#3214) * add SendAsync api and tests * update example to use new sendAsync API
- Updated the code to call the synchronous `runWorkflow` code in a separate thread, thus eliminating the blockage on the asyncio event loop - Completely removed the message_handler_thread as it's no longer needed, since the event loop is no longer blocked - Split out AutoGenChatManager into it's own file, and enhanced it for user feedback - Enhanced WebSocketConnectionManager as well for user feedback - Updates to chatbox.tsx, agentconfig.tsx and atoms.tsx (though atoms changes just for troubleshooting) - updates to app.py to handle getting human input
|
@microsoft-github-policy-service agree |
|
| GitGuardian id | GitGuardian status | Secret | Commit | Filename | |
|---|---|---|---|---|---|
| 10404693 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
| 10404695 | Triggered | Generic High Entropy Secret | d5911f0 | test/oai/test_utils.py | View secret |
| 10404695 | Triggered | Generic High Entropy Secret | 42b4cb4 | test/oai/test_utils.py | View secret |
| 10404696 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
| 10422482 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
| 10493810 | Triggered | Generic Password | 45faf8f | notebook/agentchat_pgvector_RetrieveChat.ipynb | View secret |
| 10493810 | Triggered | Generic Password | 153bac5 | notebook/agentchat_pgvector_RetrieveChat.ipynb | View secret |
| 10493810 | Triggered | Generic Password | 45faf8f | notebook/agentchat_pgvector_RetrieveChat.ipynb | View secret |
| 10493810 | Triggered | Generic Password | 153bac5 | notebook/agentchat_pgvector_RetrieveChat.ipynb | View secret |
| 10493810 | Triggered | Generic Password | 45faf8f | notebook/agentchat_pgvector_RetrieveChat.ipynb | View secret |
| 11616921 | Triggered | Generic High Entropy Secret | 83a7162 | notebook/agentchat_agentops.ipynb | View secret |
| 11616921 | Triggered | Generic High Entropy Secret | 9671680 | notebook/agentchat_agentops.ipynb | View secret |
| 12853598 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
| 12853599 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
| 12853600 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
| 12853601 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
| 12853602 | Triggered | Generic High Entropy Secret | d344481 | test/oai/test_utils.py | View secret |
🛠 Guidelines to remediate hardcoded secrets
- Understand the implications of revoking this secret by investigating where it is used in your code.
- Replace and store your secrets safely. Learn here the best practices.
- Revoke and rotate these secrets.
- If possible, rewrite git history. Rewriting git history is not a trivial act. You might completely break other contributing developers' workflow and you risk accidentally deleting legitimate data.
To avoid such incidents in the future consider
- following these best practices for managing and storing secrets including API keys and other credentials
- install secret detection on pre-commit to catch secret before it leaves your machine and ease remediation.
🦉 GitGuardian detects secrets in your source code to help developers and security teams secure the modern development process. You are seeing this because you or someone else with access to this repository has authorized GitGuardian to scan your pull request.
|
hi @SailorJoe6 , Thanks for this PR. I tested it and it works mostly - really well done! I am eager to merge this in!
There are a few ux and other small matters that we can discuss and fix later (e.g., making the wait status more clear, ensuring feedback messages are are not written directly to the db etc). |
|
Hey @victordibia Thanks for the review. I'm happy to re-submit based off the most recent main. Should I submit a PR to merge this to main then? |
|
Almost forgot. I'm sure I can re-write the Asyncio timeout logic to work in 3.10 |
|
Ask and you shall receive ;-) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Why are these changes needed?
The AutoGenStudio UI doesn't currently support user input modes 'ALWAYS', or 'TERMINATE' which are vital when allowing agents to generate and run code, so that the user can verify the code before it gets execute in their environment. This is likely due to difficulties encountered with Python's asyncio event loop getting blocked by synchronous calls to the AutoGen chat functions. This PR fixes those issues and adds support for all human input modes
Related issue number
Resolves #1358
Resolves #1664
Part of roadmap #737
Checks