Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🪨 feat: AWS Bedrock embeddings support #75

Merged
merged 6 commits into from
Sep 27, 2024
Merged

🪨 feat: AWS Bedrock embeddings support #75

merged 6 commits into from
Sep 27, 2024

Conversation

FinnConnor
Copy link
Contributor

Added bedrock embeddings support. Need to set env variables 1) AWS_ACCESS_KEY 2) AWS_SECRET_ACCESS_KEY 3) EMBEDDINGS_PROVIDER=bedrock and optionally 3) AWS_DEFAULT_REGION 4)EMBEDDINGS_MODEL (default: amazon.titan-embed-text-v1)

Tested using pgvector vector storage with bedrock embedding provider with model amazon.titan-embed-text-v1 through rag docker image.

  1. Successfully uploaded and embedded a small text file
  2. Successfully performed query search returning relevant documents.

@FinnConnor FinnConnor self-assigned this Sep 24, 2024
@FinnConnor FinnConnor linked an issue Sep 25, 2024 that may be closed by this pull request
@FinnConnor
Copy link
Contributor Author

Tested amazon.titan-embed-text-v2:0 text embedding model through bedrock using pgvector as vector store. Used docker

  1. Upload text document and embed into vector storage.
  2. Verify able to query relevant documents.

@FinnConnor
Copy link
Contributor Author

FinnConnor commented Sep 27, 2024

For AWS credentials named env variables:

AWS_DEFAULT_REGION
AWS_ACCESS_KEY_ID
AWS_SECRET_ACCESS_KEY

Two possible changes to consider , adding AWS_SESSION_TOKEN as needed (optional), also prefixing 'BEDROCK' to all env variables.

@danny-avila danny-avila changed the title AWS Bedrock embeddings support 🪨 feat: AWS Bedrock embeddings support Sep 27, 2024
@danny-avila danny-avila merged commit f21b6e7 into main Sep 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Adding bedrock embedding model support
2 participants