Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Analyzer: Speed up scans #1179

Merged
merged 2 commits into from
Jun 7, 2024
Merged

Analyzer: Speed up scans #1179

merged 2 commits into from
Jun 7, 2024

Conversation

d4rken
Copy link
Member

@d4rken d4rken commented May 24, 2024

Defer scanning apps in details until the user actually needs it. During the first pass of all apps, we only do a "shallow" scan, and then only if the enters the app details, then we do a deep scan.

The "shallow" scan uses the systems app storage stats as base information, actually scanning the files of each then only happens on demand.

This is a little less accurate, but a lot faster, and worth the trade off imho.

@d4rken d4rken added enhancement New feature, request, improvement or optimization c: StorageAnalyzer labels May 24, 2024
@d4rken
Copy link
Member Author

d4rken commented May 24, 2024

Closes #1098 as it will reduce memory overhead during the initial scan.
Closes #1122 as it will speed up the scan.

@d4rken d4rken marked this pull request as ready for review May 26, 2024 17:30
d4rken added 2 commits June 7, 2024 13:51
Defer scanning apps in details until the user actually needs it.
During the first pass of all apps, we only do a "shallow" scan, and then only if the enters the app details, then we do a deep scan.
Introduce new gateway method to just look op sizes like `du`.
More efficient than doing complete lookups that are then summed.
@d4rken d4rken force-pushed the analyzer-delayed-app-loading branch from e4e5704 to ded21c8 Compare June 7, 2024 12:46
@d4rken d4rken merged commit 948b8da into main Jun 7, 2024
16 checks passed
@d4rken d4rken deleted the analyzer-delayed-app-loading branch June 7, 2024 13:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
c: StorageAnalyzer enhancement New feature, request, improvement or optimization
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant