Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate kepler with observability and data mesh #86

Open
caldeirav opened this issue Sep 10, 2023 · 0 comments
Open

Integrate kepler with observability and data mesh #86

caldeirav opened this issue Sep 10, 2023 · 0 comments

Comments

@caldeirav
Copy link
Collaborator

caldeirav commented Sep 10, 2023

Integrate kepler (https://sustainable-computing.io/) with the data mesh pattern to generate power consumption data at pod level and leverage as optimization data for AIOps use-cases.

This will include:

  • Kepler deployment as part of the pattern (likely leveraging helm charts)
  • Integration with cluster prometheus metrics
  • Integration with observability layer via distributed tracing
  • Persist kepler data long-term in lakehouse (on container storage) with a real-time pipeline

Note: ideally we filter workload data (no persistence of control plane) given how much storage this will create, and there is a way to start / stop the collection.

@caldeirav caldeirav converted this from a draft issue Sep 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Status: 🆕 New
Development

No branches or pull requests

1 participant