Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test implementation to handle multiple processes (processings + inversions) [24hr] #5

Open
eddjharrison opened this issue Feb 26, 2024 · 4 comments
Assignees
Labels
bug Something isn't working

Comments

@eddjharrison
Copy link

No description provided.

@eddjharrison
Copy link
Author

Processes are getting queued up - ali will look at the poltergust parallelisation code

@eddjharrison eddjharrison added the bug Something isn't working label Feb 26, 2024
@eddjharrison eddjharrison changed the title Handle multiple processes (processings + inversions) Handle multiple processes (processings + inversions) [24hr] Feb 26, 2024
@eddjharrison
Copy link
Author

Ali tried implementing from reading the docs on the poltergust repo, but it didn't work.

He is working here: https://github.com/emerald-geomodelling/poltergust/tree/parallelisation

But needs a deeper dive to try and figure out why its not working

@redhog
Copy link
Member

redhog commented Mar 19, 2024

Call luigi.build([RunTask(...)]) inside requirements() of RunTasks instead of yielding them should do the trick.

@eddjharrison
Copy link
Author

eddjharrison commented Apr 2, 2024

  •  People (@burningsage ) will test on the latest deployed version

@eddjharrison eddjharrison changed the title Handle multiple processes (processings + inversions) [24hr] Test implementation to handle multiple processes (processings + inversions) [24hr] Apr 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants