Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Auto-restart after 5 minutes of no incoming reports written #23

Open
preaction opened this issue Dec 14, 2017 · 0 comments
Open

Auto-restart after 5 minutes of no incoming reports written #23

preaction opened this issue Dec 14, 2017 · 0 comments

Comments

@preaction
Copy link
Member

There is no scenario in which the servers are up and we are not receiving at least 1 report in 5 minutes. In fact, our submission rate is more like 1 per second. If the server has not received a single report in 5 minutes, it should be restarted. This can be handled by anything, but it is likely easier to handle it via the Grafana monitors, or we may have to deploy Kapacitor for it. If those two solutions are still not appropriate, we can make a Yertl pipeline that reads from the InfluxDB, restarts the server, waits a few minutes and sees if there are reports incoming before sending an e-mail to [email protected].

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant