Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

.Net: Feature: Support Vector Embedding generation in AWS Bedrock #10644

Open
arielcostas opened this issue Feb 23, 2025 · 3 comments
Open

.Net: Feature: Support Vector Embedding generation in AWS Bedrock #10644

arielcostas opened this issue Feb 23, 2025 · 3 comments
Labels
ai connector Anything related to AI connectors .NET Issue or Pull requests regarding .NET code

Comments

@arielcostas
Copy link

Support models such as amazon.titan-embed-text-v2:0 and cohere.embed-multilingual-v3 to generate text embeddings via AWS Bedrock.

@arielcostas
Copy link
Author

To add some info, since I've been trying to implement it myself (see my fork), and find that the two providers (Amazon and Cohere) have different requests/responses, in that Amazon's models support only embedding a single text string at a time, while cohere supports "batch" requests of multiple texts in one call. Would there be a problem in supporting Amazon's models by sending one request at a time and then returning the responses joined?

@markwallace-microsoft markwallace-microsoft added .NET Issue or Pull requests regarding .NET code ai connector Anything related to AI connectors labels Feb 25, 2025
@markwallace-microsoft markwallace-microsoft moved this to Community PRs in Semantic Kernel Feb 25, 2025
@github-actions github-actions bot changed the title .NET: Feature: Support Vector Embedding generation in AWS Bedrock .Net: Feature: Support Vector Embedding generation in AWS Bedrock Feb 25, 2025
@markwallace-microsoft
Copy link
Member

@RogerBarreto Have we run into this issue in any other connectors?

@RogerBarreto
Copy link
Member

@arielcostas @markwallace-microsoft I have seeing this sometime ago when I was implementing HuggingFace embeddings and the multiple was not supported.

Multiple requests might be a valid approach in the lack of the multiple text support, I would add a XmlDox <remark> clarifying this behavior and attemptiveness to the rate limiting, as a big number of simultaneous embedding requests can be throttled down.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ai connector Anything related to AI connectors .NET Issue or Pull requests regarding .NET code
Projects
Status: Community PRs
Development

No branches or pull requests

3 participants