Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use dedicated panel for task and workflow status #44

Open
BoPeng opened this issue Oct 4, 2019 · 1 comment
Open

Use dedicated panel for task and workflow status #44

BoPeng opened this issue Oct 4, 2019 · 1 comment
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@BoPeng
Copy link
Contributor

BoPeng commented Oct 4, 2019

This is very complicated and could only be implemented for jupyterlab.

Right now, when we submit tasks, we create task status tables in the cell output. This has a number of problems:

  1. The status table is "transient" in nature, and should perhaps not be displayed in the notebook.
  2. When we rerun the cell, perhaps with a different set of tasks, the running tasks becomes missing from the notebook, but are still running. In the worst case, the new tasks appears to be pending forever because the task engine is saturated with old tasks, that are not supposed to be running.

I believe that the tasks stuff should go to a dedicated panel, as in the case of dask. When tasks are submitted, they are displayed in the panel, and be controlled there. Re-running the current cell could submit new batches of tasks, but will not overwrite existing ones, which could be terminated from the panel.

@BoPeng BoPeng added enhancement New feature or request help wanted Extra attention is needed labels Oct 4, 2019
@BoPeng
Copy link
Contributor Author

BoPeng commented Oct 4, 2019

What makes more sense might be celery/flower rq/rq-dashboard like page, that is dedicated to status update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant