New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: add Converse API, add LLama 3.2 #177

Merged

roman-romanov-o merged 16 commits into development from feat/add-converse-api-for-llama

Nov 19, 2024

Collaborator

roman-romanov-o commented Nov 8, 2024 •

edited

Loading

Added Converse API
Removed Llama 2 (end of life in Bedrock)
Add Llama 3.2 (1B, 3B, 11B, 90B)
Tool support for Llama 3.1 70B, Llama 3.1 405B, Llama 3.2 90B
Move all Llama models to Converse API

roman-romanov-o added 2 commits

November 8, 2024 12:16


          add llama models, integration tests are passed

d7a2861


          Cover by tests, update README, update poetry

791c33a

roman-romanov-o requested a review from adubovik as a code owner

November 8, 2024 11:51


          Merge branch 'development' into feat/add-converse-api-for-llama

0151bf0

roman-romanov-o commented

View reviewed changes

tests/utils/openai.py Outdated Show resolved Hide resolved

roman-romanov-o commented

View reviewed changes

tests/integration_tests/test_chat_completion.py Show resolved Hide resolved

Collaborator Author

roman-romanov-o commented Nov 8, 2024 •

edited by ai-dial-actions

Loading

/deploy-review

Environment URL: https://chat-ai-dial-adapter-bedrock-pr-177.nightly-test.deltixhub.io
E2E tests status: success

adubovik reviewed

View reviewed changes

README.md Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/bedrock.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/bedrock.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/adapter.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/adapter.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/input.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/input.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/input.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/adapter.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/input.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/input.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/types.py Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/types.py Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/types.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/model/adapter.py Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/model/llama/v3.py Show resolved Hide resolved

adubovik reviewed

View reviewed changes

tests/integration_tests/test_chat_completion.py Show resolved Hide resolved

adubovik reviewed

View reviewed changes

tests/unit_tests/converse/test_converse_adapter.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

tests/unit_tests/converse/test_converse_adapter.py Show resolved Hide resolved

adubovik reviewed

View reviewed changes

tests/unit_tests/converse/test_converse_adapter.py Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/input.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/model/adapter.py Show resolved Hide resolved


          Merge branch 'development' into feat/add-converse-api-for-llama

8fa9f0a

roman-romanov-o added 4 commits

November 13, 2024 11:18


          Fix due to PR comments


          Fix README model order

f25a85e


          minor refactor

2b7fe67


          Minor comment fix

752353c

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/types.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/input.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/input.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/adapter.py Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/model/llama/v3.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/input.py Outdated Show resolved Hide resolved

roman-romanov-o and others added 4 commits

November 14, 2024 12:36


          Merge branch 'development' into feat/add-converse-api-for-llama

cf80b4a


          Fixes due to PR comments

f051a5a


          Fix converse params, add one more integration tests

74723a7


          Merge branch 'development' into feat/add-converse-api-for-llama

aba15b9

Collaborator Author

roman-romanov-o commented Nov 15, 2024 •

edited by ai-dial-actions

Loading

/deploy-review

Environment URL: https://chat-ai-dial-adapter-bedrock-pr-177.nightly-test.deltixhub.io
E2E tests status: success

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/adapter.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/input.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/input.py Outdated Show resolved Hide resolved

adubovik reviewed

View reviewed changes

aidial_adapter_bedrock/llm/converse/input.py Outdated Show resolved Hide resolved

roman-romanov-o added 2 commits

November 18, 2024 22:56


          Update integration test, include Llama 3.2 11B and 90B into vision mo…

7e66b66

…dels tests


          Refactoring due to PR comments

b2d0172

Collaborator Author

roman-romanov-o commented Nov 19, 2024 •

edited by ai-dial-actions

Loading

/deploy-review

Environment URL: https://chat-ai-dial-adapter-bedrock-pr-177.nightly-test.deltixhub.io
E2E tests status: failed

Collaborator Author

roman-romanov-o commented Nov 19, 2024 •

edited by ai-dial-actions

Loading

/deploy-review

Environment URL: https://chat-ai-dial-adapter-bedrock-pr-177.nightly-test.deltixhub.io
E2E tests status: success

roman-romanov-o and others added 2 commits

November 19, 2024 14:34


          Merge branch 'development' into feat/add-converse-api-for-llama

b47e309


          minor refactor, update README modalities

bcaee0a

adubovik approved these changes

View reviewed changes

roman-romanov-o merged commit 67d3d6d into development

6 checks passed

adubovik deleted the feat/add-converse-api-for-llama branch

November 19, 2024 18:16

This was referenced Dec 2, 2024

Support multimodal Llama 3.2 #153

Closed

Migrate to the unified Amazon Bedrock Converse API #152

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet