-
Help
DescriptionHi! Is there a way to conclude a pipeline if a condition is met? I decided to use the files as ground truth since I needed something easy to inspect; also, the mere existence of the file is not enough to skip the reprocessing since its content is also relevant to this decision. But if all combinations have already been processed, the pipeline does error: map() cannot be run on an empty set. I'd like to have a more graceful stopping if this condition is met, but I could not find a graceful way of stopping the pipelines without marking all downstream targets as errored.
It's better than a full-fledged error or a bunch of errored branches, but still, it's reported as an errored pipeline, which is not truthful. Is there any more elegant solution that marks the pipeline as successfully completed? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
Beta Was this translation helpful? Give feedback.
targets
isn't designed for this, so there isn't a perfect solution. The error sounds like it gets the job done. Another thing you could try is to have each target check the condition and then runtar_cancel()
if it is already met.