Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[spec] Multimedia source material #1133

Open
snopoke opened this issue Feb 4, 2025 · 1 comment
Open

[spec] Multimedia source material #1133

snopoke opened this issue Feb 4, 2025 · 1 comment
Assignees
Labels
enhancement New feature or request pipelines Issue is related to pipelines

Comments

@snopoke
Copy link
Collaborator

snopoke commented Feb 4, 2025

Several projects want to allow the bot to send images (potentially video, audio etc) from a curated set of media. I.e., not generated images, but probably a tool for an LLM to decide to send a photo.

One use case is the FP chatbots sending a picture of an IUD for example.

@snopoke snopoke converted this from a draft issue Feb 4, 2025
@snopoke snopoke added enhancement New feature or request pipelines Issue is related to pipelines labels Feb 4, 2025
@snopoke
Copy link
Collaborator Author

snopoke commented Feb 4, 2025

  • allow user to curate a set a multimedia
  • allow user to 'attach' the collection to a node in a pipeline
  • when collection is attached, expose a tool to the llm to select a MM to send (optionally)

Feels like some overlap with #1160

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request pipelines Issue is related to pipelines
Projects
Status: Prioritized
Development

No branches or pull requests

2 participants