You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
triggered by something like job_options={"tile_grid": "utm-20km"}
for testing purposes, the "flimsy" mode of partitioned jobs (a job is just "split" in a single subjob) can be triggered too with
job_options={"split_strategy": "flimsy"}
simple cross-backend splitting based on splitting off load_collection nodes:
job_options={"split_strategy": "crossbackend"}
With #150 we'll add a new cross-backend split approach that splits deeper in the graph.
It will get messy to handle this with a simple split_strategy job option. Also note that we even might want to combine splitting methods: e.g. split spatially and cross-backend. As a matter of fact, one can think of several "dimensions" to split a job or graph:
spatially (like the current "large area" tile_grid based splitting),
cross-backend (due to collection availability or other backend capabilities),
temporal (e.g. split longer time series in smaller jobs to optimize resource/credit usage),
result asset (if a backend does not support multiple save_result nodes, or not all requested output formats).
Current mockup of the job option to control job splitting, based on what we already have, is something like this (with some fictional tuning parameters):
(spin-off from #150)
The aggregator currently has a couple of job splitting features, triggered from a job option:
job_options={"tile_grid": "utm-20km"}
job_options={"split_strategy": "flimsy"}
job_options={"split_strategy": "crossbackend"}
With #150 we'll add a new cross-backend split approach that splits deeper in the graph.
It will get messy to handle this with a simple
split_strategy
job option. Also note that we even might want to combine splitting methods: e.g. split spatially and cross-backend. As a matter of fact, one can think of several "dimensions" to split a job or graph:Current mockup of the job option to control job splitting, based on what we already have, is something like this (with some fictional tuning parameters):
The text was updated successfully, but these errors were encountered: