Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add some kind of progress bar for PNG download #35

Open
fregu856 opened this issue Feb 20, 2023 · 1 comment
Open

Add some kind of progress bar for PNG download #35

fregu856 opened this issue Feb 20, 2023 · 1 comment
Labels
enhancement New feature or request webrunners Related to the web job runners

Comments

@fregu856
Copy link
Collaborator

No description provided.

@fregu856 fregu856 changed the title Add some kind of progress bar for PNG download? Add some kind of progress bar for PNG download Feb 20, 2023
@j6k4m8
Copy link
Owner

j6k4m8 commented Feb 21, 2023

I think this will need to be converted to its own thread — our experiment yesterday shows that even on a beefy machine, this is a showstopper when it runs on the API threads!

My proposal is something like this:

  • Add an Export runner
  • Add progress the same way we currently handle it for the other runners
  • Chunk the downloads so that we can zip and send the first few slices while we process the rest
  • Throttle CPU usage so we can run other things in the meantime (i.e., downloading results isn't as high priority for our available cores as segmentation)

@j6k4m8 j6k4m8 added enhancement New feature or request webrunners Related to the web job runners labels Feb 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request webrunners Related to the web job runners
Projects
None yet
Development

No branches or pull requests

2 participants