Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce wptreport storage requirements #2049

Open
jgraham opened this issue Oct 30, 2023 · 0 comments
Open

Reduce wptreport storage requirements #2049

jgraham opened this issue Oct 30, 2023 · 0 comments

Comments

@jgraham
Copy link
Member

jgraham commented Oct 30, 2023

We cache downloaded wptreport.json files for some time after initially downloading them, since in some cases we use them multiple times e.g. both for doing a metadata update and also for doing results comparions for notification pushes.

We now seem to bet 8Gb of uncompressed wptreport files from a full wpt run. That makes it easy to run out of disk space. We also don't have any insight into how useful the cache is.

We should:

  • Reduce the number of pushes for which we retain logs
  • Consider storing the logs in a compressed format
  • Ensure that these logs are removed by a cleanup script and consider running the cleanup script automatically if we detect low disk space.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant