Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEAT] Queue inputs on gradio interface #26

Open
mikejgray opened this issue Nov 7, 2023 · 1 comment
Open

[FEAT] Queue inputs on gradio interface #26

mikejgray opened this issue Nov 7, 2023 · 1 comment
Assignees
@NeonDaniel
Labels
enhancement New feature or request

Comments

@mikejgray
Copy link
Contributor

Objective

This implementation does not queue inputs and may encounter race conditions with multiple users

Initial Implementation Requirements

  • Create an input queue
  • Verify that multiple users of the interface do not encounter race conditions

Other Considerations

No response
@mikejgray mikejgray added the enhancement New feature or request label Nov 7, 2023
@NeonDaniel NeonDaniel self-assigned this Nov 7, 2023
NeonDaniel added a commit that referenced this issue Nov 7, 2023
@NeonDaniel
Prevent sending an input until the previous response has been handled
4144a8b 
This would ideally use a queue but that will require using a different UI since the gradio ChatBot expects each input to return a value synchronously
Relates to #26
@NeonDaniel NeonDaniel mentioned this issue Nov 8, 2023
Merged
@NeonDaniel
Copy link
Member

Proper queuing will require either a different Gradio interface or finding some way to get the Chatbot UI to allow async responses

NeonDaniel added a commit that referenced this issue Nov 8, 2023
@NeonDaniel
Threaded input handling and multi-session support (#31)
37bf01f 
* Prevent sending an input until the previous response has been handled
This would ideally use a queue but that will require using a different UI since the gradio ChatBot expects each input to return a value synchronously
Relates to #26

* Implement gradio State to track a session ID
Update handling so TTS responses are attached to a specific browser session

* Implement session-specific profile settings

* Add remaining user profile params to UI

---------

Co-authored-by: Daniel McKnight <[email protected]>
@NeonDaniel NeonDaniel moved this to Other Helpful Tasks in Community Projects May 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@NeonDaniel NeonDaniel

Labels
enhancement New feature or request
Projects
Community Projects
Status: Other Helpful Tasks
Milestone
No milestone
Development

No branches or pull requests
2 participants
@mikejgray @NeonDaniel