Devel luca 1

[LucaCinquini]

Purpose

The purpose of this PR is to enable concurrent execution of multiple SBG end-to-end workflows onto the SPS cluster.
Specifically, the following constraints are imposed:

• No more than 2 concurrent DAGs
• No more than 4 concurrent Tasks
• No more then 1 SBG task on any node of the Kubernetes cluster

Proposed Changes

• [ADD] Constraint on number of concurrent SBG DAGs and Tasks
• [ADD] PosAntiAffinity constraint that prevents any two SBG tasks to execute concurrently on the same node

Issues

• [New Feature]: Execution of additional SBG workflows #40

Testing

Tested on an SPS cluster of 4 nodes, submitting 6 DAGs simultaneously. Verified that no more than 2 DAGs execute simultaneously, no more than 4 Tasks, and all tasks are spread across different nodes:

[drewm-jpl]

Looks good!