Set up a procedure for automated deployment tests

[ssjunnebo]

Automated deployment tests should help detect issues due to for instance dependency updates.

• Look into different testing strategies
• https://docs.ansible.com/ansible/latest/reference_appendices/test_strategies.html

[matrulda]

Decision from irma deployment team meeting: Implement integrations tests that are run on Irma1 after deployment is complete (i.e playbook is run, files synced and manual steps performed on Irma1). For a start, tests should include the following commands:

• ngi_pipeline_start.py organize
• ngi_pipeline_start.py qc
• ngi_pipeline_start.py analyze
• taca deliver --stage_only

[ssjunnebo]

👍 and maybe include ngi_pipeline_start.py qc as well?

[matrulda]

Yes! I updated the list. 👍