docs/integrations/llms/bedrock/

[giscus[bot]]

docs/integrations/llms/bedrock/

You are currently on a page documenting the use of Amazon Bedrock models as text completion models. Many popular models available on Bedrock are chat completion models.

https://python.langchain.com/docs/integrations/llms/bedrock/

[shrijayan]

Error while trying to use custom imported models in bedrock

Traceback (most recent call last):
  File "src/llm-bedrock.py", line 18, in <module>
    llm.invoke(messages)
  File ".venv/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 286, in invoke
    self.generate_prompt(
  File ".venv/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 786, in generate_prompt
    return self.generate(prompt_messages, stop=stop, callbacks=callbacks, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File ".venv/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 643, in generate
    raise e
  File ".venv/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 633, in generate
    self._generate_with_cache(
  File ".venv/lib/python3.11/site-packages/langchain_core/language_models/chat_models.py", line 851, in _generate_with_cache
    result = self._generate(
             ^^^^^^^^^^^^^^^
  File ".venv/lib/python3.11/site-packages/langchain_aws/chat_models/bedrock.py", line 563, in _generate
    prompt = ChatPromptAdapter.convert_messages_to_prompt(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File ".venv/lib/python3.11/site-packages/langchain_aws/chat_models/bedrock.py", line 362, in convert_messages_to_prompt
    raise NotImplementedError(
NotImplementedError: Provider imported-model model does not support chat.