Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unify adaptive solutions between distributed and dask-gateway #216

Open
mrocklin opened this issue Mar 16, 2020 · 0 comments
Open

Unify adaptive solutions between distributed and dask-gateway #216

mrocklin opened this issue Mar 16, 2020 · 0 comments

Comments

@mrocklin
Copy link
Member

This is more of a question than an issue (my apologies). I would like to better understand the motivations behind the adaptive logic in dask_cli.py . Some of this seems to be redundant with the code in distributed/deploy/adaptive*.py. I suspect that there was a good reason why things in dask-gateway were designed differently, but I'm not seeing them yet.

@jcrist if you have time to add history here I would appreciate it.

The one difference/improvement I see is that with the system in dask-gateway all of closing/active/target are known at one time, rather than collected over time at different points. Is this why the split? Is this approach better? If so, are there reasons why it couldn't be done upstream?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant