Adding Callbacks in Text Splitters for instrumentation #28317
punitmahes
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Checked
Feature request
Currently, LangChain’s text splitters operate in isolation and lack support for callback handlers. Introducing callback handlers to text splitters can provide significant benefits, such as real-time monitoring, debugging, and custom instrumentation of the text-splitting process.
Motivation
Currently, LangChain’s text splitters don’t provide a way to track or debug the splitting process. Adding callback handlers would let users monitor key details like chunk size, chunk overlap, and the total number of chunks. This would help in debugging, performance analysis, and adding custom logic during the splitting process, while keeping the behavior consistent with other parts of LangChain that support callbacks.
Proposal (If applicable)
No response
Beta Was this translation helpful? Give feedback.
All reactions