CloudHarness v1.0.0

Version 1.0.0 includes general stability improvements and upgrades over the previous version.

Main changes

• Upgrade Kubernetes specifications to v1 #342
• Argo, JupyterHub (#342), Keycloak (#362), upgrade
• Gatekeeper upgraded #130
• Fix Keycloak user for backend api calls #361 #395
• Build dependencies resolution improved (images that are not declared as build dependencies are not included) #346
• Node affinity selectors per for JupyterHub applications #327
• Efficiency improvements #422
• Bug fixes #265 #216 #423 #222 #347 #380 #394

See also https://github.com/MetaCell/cloud-harness/milestone/5

Upgrading from previous version

No major api update is implemented from 0.4.0.

The upgrade can break the deployments for the following reasons:

• Kubernetes definitions upgrade to v1. Kubernetes versions < 1.19 are not supported anymore.
• Keycloak version upgraded to 15.1.1. Deployments with old Keycloak versions may break in a hot upgrade. See also https://www.keycloak.org/docs/latest/upgrading/
• Applications using the user accounts client api is now required to add accounts as a hard dependency
• JupyterHub helm chart upgraded. Some overridden configurations may need changes
• Argo helm chart changed. Some overridden configurations may need changes
• Default databases version changes from latest to a specific version. May need to set the desired version globally or specifically per application
• Directory utilities renamed to tools. Codefresh pipelines may need to change the install command. Change the deployment-configuration/codefresh-ENV.yaml to replace utilities with tools and regenerate the deployment with harness-deployment ... -e ENV

What's Changed

• #251 chore: add CH_CURRENT_USER_ID as an env var to set the current user during development by @zsinnema in #252
• #257 add simple command to tasks and specific task by @filippomc in #258
• #261 chore: add flask 404 handler by @zsinnema in #262
• #271 chore: refactored extract-download task by @zsinnema in #272
• New image names #264 #267 by @filippomc in #270
• Fix build when no registry is set by @filippomc in #273
• #274 fix: added -L to curl to follow redirects by @zsinnema in #275
• #279 add proxy services for main app by @filippomc in #280
• #282 chore: added startupProbe to deployment template by @zsinnema in #283
• #240 chore: implemented secrets through mounting instead of env vars and make sure secret values aren't in the allvalues.yaml by @zsinnema in #284
• Feature/287: Fix image dependencies using Skaffold by @filippomc in #289
• chore: add performance trace sample rate to sentry init by @zsinnema in #292
• Feature/293 cache current user by @zsinnema in #294
• #293 chore: use cachetools for caching by @zsinnema in #295
• #292 hotfix: added missing admin client to user_realm_roles by @zsinnema in #296
• #297 chore: add create topic to produce when kafkatimeout error occurs & refrased some error messages by @zsinnema in #298
• Feature/skaffold fixes by @filippomc in #308
• #305 #306 add test coverage by @filippomc in #309
• #304 chore: enable docker buildkit in skaffold yaml by @zsinnema in #307
• #310 expandable deployment pipelines implemented by @filippomc in #311
• #313 chore: enable kafka topic auto creation by @zsinnema in #314
• #315 chore: removed one stacktrace dump from async consume by @zsinnema in #316
• #317 chore: remove subpart from the configmap mount by @zsinnema in #318
• #300 #301 chore: added notifications server and send_event decorator by @zsinnema in #302
• #322 Generic backend api error handling improved by @filippomc in #323
• #322 Parameter name corrected by @filippomc in #324
• Hotfix/325 by @zsinnema in #326
• Feature/328: Jupyterhub enable cpu/mem resources per application by @zsinnema in #329
• #330 chore: removed all refs to mnp from jupyterhub keycloak authentication and made it generic by @zsinnema in #331
• #333 support for multi-level domains and aliases by @filippomc in #334
• #335 #336 Volume affinity and no cache parameter by @filippomc in #337
• fix: update collection related imports by @sanjayankur31 in #341
• Feature/338: enable buildkit for codefresh by @zsinnema in #340
• #356 ssh:default support for docker buildkit builds to support cloning of private git repos by @zsinnema in #357
• Release/0.4.0 by @filippomc in #367
• Fix databases versions by @filippomc in #351
• Feature/361: stop using the admin account for api calls to KC by @zsinnema in #364
• Feature/342: Update deprecated Kubernetes chart templates by @filippomc in #345
• #347 add test coverage for values.yaml precedence by @filippomc in #377
• #263 chore fix -e parameter description by @filippomc in #376
• #380 chore: fixed issue with wrong replace of accounts subdomain in CH_ACCOUNTS_AUTH_DOMAIN by @zsinnema in #381
• #361 chore: use CH secrets for api acocunt secret, use a random string for nullable secrets default value by @zsinnema in #389
• #387 chore: add auto secrets to codefresh.yaml only if the secret has a value defined in the values.yaml by @zsinnema in #393
• #390 chore: reset the k8s resource values by @zsinnema in #391
• #395 chore: set accounts admin api username to admin_api by @zsinnema in #396
• #394 fix common images dependencies by @filippomc in #399
• #397 chore: accounts secrets not created by @zsinnema in #398
• Feature/216-384 by @filippomc in #385
• Add documentation by @filippomc in #409
• Feature/346 Improve build dependencies: remove unused base images by @filippomc in #400
• Feature/327: implement jupyter node selectors by @zsinnema in #332
• #404 Pull request template by @filippomc in #405
• #365 Add validation checks for dependencies by @filippomc in #378
• #415 rename utilities->tools by @filippomc in #416
• Feature/344: gatekeeper improvements by @filippomc in #379
• #401 implement ch middleware for Flask and Django to set/get the ch application state. Refactored ch kc authentication to disconnect it from Flask by @zsinnema in #417
• #425 #422 Clean, Improve and document operations api by @filippomc in #426
• #423 change the argo executor by @filippomc in #424
• #384 fix: mount secret also on accounts pod by @filippomc in #428
• #423 change argo executor to pns by @filippomc in #429
• Fix/384: load accounts secret only at need by @filippomc in #430

New Contributors

• @sanjayankur31 made their first contribution in #341

Full Changelog: v0.4.0...v1.0.0-RC