Stop propagating 'id' field from Message object to request payload #10
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Resolving #6
The new
ChatDatabricks
implementation propagates theid
fields from the inputMessage
objects to the underlying model endpoint. It causes an error because not all endpoints supportid
field in the input payload e.g. our FMAPIs.Indeed, the input messages often do not have
id
fields if it is specified by users. However, when we pass the chat history to theChatDatabricks
class, it containsAIMessage
objects from the previous response, which often containid
field.Indeed, this is regressoin fromthe old community ChatDatabricks, which does not propagate
id
field. Therefore, this PR simply revert the new class to original behavior.Testing