Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add a guide for MLflow observability integration with Gemini #432

Open
TomeHirata opened this issue Feb 4, 2025 · 3 comments · May be fixed by #543
Open

Add a guide for MLflow observability integration with Gemini #432

TomeHirata opened this issue Feb 4, 2025 · 3 comments · May be fixed by #543
Assignees
@markmcd

Comments

@TomeHirata
Copy link

Description of the feature request:

Hi, team. I'm a core maintainer of MLFlow, one of the most popular tools for ML workflow management.
We have recently introduced a new tracing integration with the google-generativeai Python ADK and we would be grateful if we could add a guide for the integration to the Cookbook. The guide will include example codes for using the MLflow tracing integration and links to the relevant documentation.
Please refer to https://mlflow.org/docs/latest/llms/tracing/index.html for the tracing integration.

What problem are you trying to solve with this feature?

With the guide, users can easily get started with MLflow integration for Gemini and gain observability of their agents or applications using Gemini API.

Any other information you'd like to share?

No response
@TomeHirata TomeHirata changed the title Add a guide for MLflow tracing integration with Gemini Add a guide for MLflow observability integration with Gemini Feb 4, 2025
@markmcd
Copy link
Member

markmcd commented Feb 5, 2025

Sounds great. I think MLFlow meets the contribution guidelines, so I'd be happy to have something added in here.

If you have any early drafts or an outline, feel free to share. Generally we like guides to be pretty specific, but you can create multiple if you need (e.g. examples/mlflow/basic_observability.ipynb, examples/mlflow/complex_something_something.ipynb). Let me know if you need a less public channel to share.

We're also in the progress of migrating our examples and content to use the new SDK (google-genai) - can you use that too?

@markmcd markmcd self-assigned this Feb 5, 2025
@TomeHirata
Copy link
Author

Hi, @markmcd. Thank you so much for your reply. It sounds like we should integrate with the new SDK and then add the examples and guides. For our reference, do you plan to maintain google-generativeai or do you think it's ok to stop supporting this package and fully migrate our integration to the new SDK google-genai?

@markmcd
Copy link
Member

markmcd commented Feb 10, 2025

Long-term, we don't intend to have 2 SDKs for the same API. Short-term though, google-generative still gets almost 1M downloads/week so there may be a user base you want to cover there, but that's your call.

This was referenced Mar 1, 2025
Open
Open
@TomeHirata TomeHirata linked a pull request Mar 10, 2025 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@markmcd markmcd

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add notebook for MLflow Tracing TomeHirata/gemini-cookbook
2 participants
@markmcd @TomeHirata