Prepare Backend and Airflow for Production Deployment

[drjova]

Ensure the backend and Airflow services are fully prepared for production. This includes setting up k8s applications and verifying that all required environment variables are properly configured for the UI and other related packages.

Backend & Airflow Readiness:

Validate that the backend and Airflow services are stable for production use.

Kubernetes Setup:

• Deploy the necessary Kubernetes applications for backend and Airflow.
• Confirm that all services are working and communicating to each other.

Environment Variables:

Ensure all necessary environment variables are correctly set for:

• UI
• Backend
• Airflow
• Any other relevant packages

Acceptance
A fully deployed and stable production environment with proper configurations for all services and applications.

[DonHaul]

Environment Variables:
UI

• ?

Backoffice

• https://github.com/cern-sis/kubernetes-inspire/blob/main/backoffice/environments/backoffice/kustomization.yml#L56-L64
• https://github.com/cern-sis/kubernetes-inspire/blob/main/backoffice/environments/backoffice/sealedsecrets/inspire-backoffice-creds.yml#L9-L25

Airflow

• https://workflows.inspire.dev.siscern.org/variable/list/
• https://workflows.inspire.dev.siscern.org/connection/list

[DonHaul]

Prepping to Prod:

• Requested jimil to open a new instance for airlfow prod - https://github.com/cern-sis/kubernetes-airflow/issues/52
• @jimil749 will provision for us everything we need

[DonHaul]

requires smoke tests