Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does Haystack support Weights & Biases Weave for tracing pipelines? #8612

Open
vrunm opened this issue Dec 9, 2024 · 1 comment
Open

Does Haystack support Weights & Biases Weave for tracing pipelines? #8612

vrunm opened this issue Dec 9, 2024 · 1 comment
Assignees
Labels
P3 Low priority, leave it in the backlog

Comments

@vrunm
Copy link
Contributor

vrunm commented Dec 9, 2024

W&B Weave is a very popular open-source tool for LLM apps tracing. It will useful to have for tracing Haystack pipelines.
I found a similar issue here: wandb/weave#1911

Is it possible to use the Custom Tracing Backend with Weave?

@julian-risch
Copy link
Member

Hello @vrunm I'd expect that it's relatively easy to trace the calls made to OpenAI, Anthropic, Gemini, Cohere, etc. based on the description here but a proper Haystack integration with Weave would be great! We'd be more than happy to list it on our integrations overview page.
If you or someone else would be interested in creating such an integration, it does not need to be in the haystack-core-integrations repo but can also be your separate GitHub repo so you have full control of the code. Of course, we'd still list it on our overview page. For that, all you need to do is open a PR with a description page in https://github.com/deepset-ai/haystack-integrations

@julian-risch julian-risch added the P3 Low priority, leave it in the backlog label Dec 10, 2024
@julian-risch julian-risch self-assigned this Dec 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
P3 Low priority, leave it in the backlog
Projects
None yet
Development

No branches or pull requests

2 participants