Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] metrics are very slow due to number of subdomains #227

Open
feld opened this issue Jan 10, 2024 · 0 comments
Open

[BUG] metrics are very slow due to number of subdomains #227

feld opened this issue Jan 10, 2024 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@feld
Copy link
Contributor

feld commented Jan 10, 2024

This bug is related to #183

As it turns out I have an application that has a wildcard subdomain. Our application is rather unique and we have a nearly infinite number of possible subdomains which could all produce unique content. Once the application has been running for a couple hours the metrics endpoint starts to time out for our Prometheus scraper.

I'm currently measuring on one of our nodes ~2900 unique domains known to PromEx which causes the metrics endpoint to take between 5-10 seconds to serve. The resulting output is 218873 lines long. That's a lot of metrics!

Would it be possible to disable the unique host tag being added to all the metrics? We don't need them per-host like this.

@feld feld added the bug Something isn't working label Jan 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants