Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dynamic Report Generation #10

Open
mrowebot opened this issue Jul 22, 2014 · 3 comments
Open

Dynamic Report Generation #10

mrowebot opened this issue Jul 22, 2014 · 3 comments

Comments

@mrowebot
Copy link

Once we have the statistics computed, we need to produce reports of these stats to show what has changed, where, and by how much.

@dantheta
Copy link
Contributor

We've already got a version of change-tracking inside the database (which is done pretty cheaply). It needs a little bit of refinement, but we could do a nightly export of changes logged during the day.

The system maintains a current URL/ISP status table, which is simply the latest chronological result for a given URL/ISP. When we're updating that table, the system knows what the old and new statuses are without having to go looking for them (which would be quite expensive for the DB). It logs detected changes to another logging table for inspection. This probably needs a bit of refinement, as it is currently recording change events for errors and timeouts (which we're not really interested in). Restricted to just changes from "ok" to "blocked" and vice-versa should give a pretty useful dataset.

@mrowebot
Copy link
Author

Exporting that data would be ideal tbh. Would you be ok with me creating an issue for that and assigning it to you?

@dantheta
Copy link
Contributor

Sure, that's no problem.

On Fri, Jul 25, 2014 at 01:25:24AM -0700, Matthew Rowe wrote:

Exporting that data would be ideal tbh. Would you be ok with me creating
an issue for that and assigning it to you?


Reply to this email directly or view it on GitHub:
#10 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants