Skip to content

[Please Don't Merge] implement a new ModeBasedAssigner for FedEval #2402

[Please Don't Merge] implement a new ModeBasedAssigner for FedEval

[Please Don't Merge] implement a new ModeBasedAssigner for FedEval #2402

name: Workflow Interface Tests
on:
push:
branches: [ develop ]
pull_request:
branches: [ develop ]
types: [opened, synchronize, reopened, ready_for_review]
permissions:
contents: read
env:
# A workaround for long FQDN names provided by GitHub actions.
FQDN: "localhost"
jobs:
build:
if: (github.event.pull_request.draft == false && contains(github.event.pull_request.labels.*.name, 'workflow_interface'))
runs-on: ubuntu-latest
timeout-minutes: 15
steps:
- uses: actions/checkout@v3
- name: Set up Python 3
uses: actions/setup-python@v3
with:
python-version: "3.9"
- name: Install dependencies
run: |
python -m pip install --upgrade pip
pip install -r tests/github/experimental/workflow/LocalRuntime/requirements_experimental_localruntime_tests.txt
pip install .
- name: Workflow - Exclude Test (Single Process Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_exclude.py
- name: Workflow - Exclude Test (Ray Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_exclude.py ray
- name: Workflow - Include Test (Single Process Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_include.py
- name: Workflow - Include Test (Ray Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_include.py ray
- name: Workflow - Include / Exclude Test (Single Process Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_include_exclude.py
- name: Workflow - Include / Exclude Test (Ray Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_include_exclude.py ray
- name: Workflow - Internal Loop Test (Single Process Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_internalloop.py
- name: Workflow - Internal Loop Test (Ray Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_internalloop.py ray
- name: Workflow - Private Attributes (Single Process Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_privateattributes.py
- name: Workflow - Private Attributes (Ray Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_privateattributes.py ray
- name: Workflow - References (Single Process Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_reference.py
- name: Workflow - References (Ray Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_reference.py ray
- name: Workflow - References with Exclude (Single Process Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_reference_with_exclude.py
- name: Workflow - References with Exclude (Ray Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_reference_with_exclude.py ray
- name: Workflow - References with Include (Single Process Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_reference_with_include.py
- name: Workflow - References with Include (Ray Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_reference_with_include.py ray
- name: Workflow - Collaborator Subset (Single Process Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_subset_of_collaborators.py
- name: Workflow - Collaborator Subset (Ray Backend)
run: |
python tests/github/experimental/workflow/LocalRuntime/testflow_subset_of_collaborators.py ray
- name: Test Experimental Aggregator Based Workflow API
run: |
python -m tests.github.experimental.workflow.AggregatorBasedWorkflow.test_experimental_agg_based_workflow --custom_template tests/github/experimental/workflow/AggregatorBasedWorkflow/testcase_datastore_cli --fed_workspace aggregator --col col1 --col col2 --rounds-to-train 1