Skip to content

Commit b0870f5

Browse files
chore: release 8.6.0 (#559)
Signed-off-by: Mathew Wicks <[email protected]>
1 parent 57a3bce commit b0870f5

File tree

7 files changed

+121
-41
lines changed

7 files changed

+121
-41
lines changed

README.md

+4-9
Original file line numberDiff line numberDiff line change
@@ -1,20 +1,15 @@
11
# Airflow Helm Chart (User Community)
22

3+
> This repository contains the following projects.
4+
35
## Helm Charts
46

57
| Name | Description |
68
| --- | --- |
7-
| [charts/airflow](https://github.com/airflow-helm/charts/tree/main/charts/airflow) | Airflow Helm Chart (User Community) - used to deploy Apache Airflow on Kubernetes
9+
| [airflow](https://github.com/airflow-helm/charts/tree/main/charts/airflow) | Airflow Helm Chart (User Community) - the standard way to deploy Apache Airflow on Kubernetes with Helm |
810

911
## Docker Images
1012

1113
| Name | Description |
1214
| --- | --- |
13-
| [images/pgbouncer](https://github.com/airflow-helm/charts/tree/main/images/pgbouncer) | a lightweight image used to run [PgBouncer](https://www.pgbouncer.org/)
14-
15-
## Helm Repo Usage
16-
17-
```sh
18-
helm repo add airflow-stable https://airflow-helm.github.io/charts
19-
helm repo update
20-
```
15+
| [pgbouncer](https://github.com/airflow-helm/charts/tree/main/images/pgbouncer) | a lightweight image used to run [PgBouncer](https://www.pgbouncer.org/) |

charts/airflow/.helmignore

+40-19
Original file line numberDiff line numberDiff line change
@@ -1,21 +1,42 @@
1-
# Patterns to ignore when building packages.
2-
# This supports shell glob matching, relative path matching, and
3-
# negation (prefixed with !). Only one pattern per line.
4-
.DS_Store
5-
# Common VCS dirs
6-
.git/
1+
# Patterns to ignore when building the helm package
2+
3+
## Git
4+
.git
75
.gitignore
8-
.bzr/
9-
.bzrignore
10-
.hg/
11-
.hgignore
12-
.svn/
13-
# Common backup files
14-
*.swp
15-
*.bak
16-
*.tmp
17-
*~
18-
# Various IDEs
19-
.project
6+
7+
## JetBrains
208
.idea/
21-
*.tmproj
9+
*.iml
10+
*.ipr
11+
*.iws
12+
13+
## VSCode
14+
.vscode/*
15+
*.code-workspace
16+
.history/
17+
18+
## Vim
19+
[._]*.s[a-v][a-z]
20+
[._]*.sw[a-p]
21+
[._]s[a-rt-v][a-z]
22+
[._]ss[a-gi-z]
23+
[._]sw[a-p]
24+
Session.vim
25+
Sessionx.vim
26+
.netrwhist
27+
*~
28+
[._]*.un~
29+
30+
## Emacs
31+
*~
32+
\#*\#
33+
/.emacs.desktop
34+
/.emacs.desktop.lock
35+
*.elc
36+
.\#*
37+
38+
## macOS
39+
.DS_Store
40+
.AppleDouble
41+
.LSOverride
42+
._*

charts/airflow/CHANGELOG.md

+61-1
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,65 @@ This project follows [Semantic Versioning](https://semver.org/spec/v2.0.0.html)
88

99
TBD
1010

11+
## [8.6.0] - 2022-04-13
12+
13+
> 🟥 __WARNINGS__ 🟥
14+
>
15+
> - If you have `logs.persistence.enabled` set to `true`, you MUST disable `scheduler.logCleanup.enabled` and `workers.logCleanup.enabled` or the upgrade will fail
16+
> - If using airflow `2.0.X` or `2.1.X`, you should set `triggerer.enabled` to `false`, as the triggerer was added in airflow `2.2.0` and will fail in older versions
17+
> - If you currently pin `dags.gitSync.image.tag`, please update to the new default of `v3.5.0`
18+
> - If you currently pin `pgbouncer.image.tag`, please update to the new default of `1.17.0-patch.0`
19+
> - If you currently pin `pgbouncer.maxClientConnections`, please update to the new default of `1000`
20+
21+
> 🟨 __NOTES__ 🟨
22+
>
23+
> - Consider enabling the new [Scheduler "task creation check"](docs/faq/monitoring/scheduler-liveness-probe.md#scheduler-task-creation-check) to prevent deadlocks, especially if using airflow versions before `2.1.1`
24+
> - If you disabled PgBouncer because of incompatibility with "Azure PostgreSQL", you can re-enable it if you [set `pgbouncer.authType = scram-sha-256` and `pgbouncer.serverSSL = verify-ca`](docs/faq/database/pgbouncer.md)
25+
> - This chart version fixes [an issue that caused `db-migrations` to hang](https://github.com/airflow-helm/charts/pull/529) when PgBouncer is enabled with airflow `2.2.0+`
26+
> - While NOT recommended, you can now set [external database](docs/faq/database/external-database.md) and [external redis](docs/faq/database/external-redis.md) passwords with a plain-text value
27+
> - If you are using [celery worker autoscaling](docs/faq/configuration/autoscaling-celery-workers.md), you must set a non-empty value for `workers.logCleanup.resources.requests`
28+
> - The new ["log-cleanup sidecar"](docs/faq/monitoring/log-cleanup.md) is enabled by default on schedulers and workers
29+
> - The new [PgBouncer startupProbe](https://github.com/airflow-helm/charts/pull/547) will only work in Kubernetes 1.18+
30+
> - The [`extraManifests` value](docs/faq/kubernetes/extra-manifests.md) has been significantly improved
31+
32+
> 🟦 __OTHER__ 🟦
33+
>
34+
> - If you appreciate the `User-Community Airflow Helm Chart` please consider supporting us!
35+
> - [give a ⭐ on GitHub](https://github.com/airflow-helm/charts/stargazers)
36+
> - [give a ⭐ on ArtifactHub](https://artifacthub.io/packages/helm/airflow-helm/airflow)
37+
38+
### Added
39+
- add "airflow triggerer" Deployment ([#555](https://github.com/airflow-helm/charts/pull/555))
40+
- add "log-cleanup sidecar" to scheduler and worker ([docs](docs/faq/monitoring/log-cleanup.md)) ([#554](https://github.com/airflow-helm/charts/pull/554))
41+
- add "task creation check" to scheduler liveness probe ([docs](docs/faq/monitoring/scheduler-liveness-probe.md#scheduler-task-creation-check)) ([#549](https://github.com/airflow-helm/charts/pull/549))
42+
- allow setting database passwords with values & setting database usernames from secrets ([docs](docs/faq/database/external-database.md#option-1---postgres)) ([#553](https://github.com/airflow-helm/charts/pull/553))
43+
- allow `airflow.users[].roles` to specify a list of roles ([docs](docs/faq/security/airflow-users.md)) ([#539](https://github.com/airflow-helm/charts/pull/539))
44+
- add `pgbouncer.authType` value ([docs](docs/faq/database/pgbouncer.md)) ([#498](https://github.com/airflow-helm/charts/pull/498))
45+
- add `ingressClassName` values to ingress ([docs](docs/faq/kubernetes/ingress.md)) ([#527](https://github.com/airflow-helm/charts/pull/527))
46+
- add `airflow.clusterDomain` value ([#441](https://github.com/airflow-helm/charts/pull/441))
47+
- add `labels` values for `sync` and `db-migrations` ([#467](https://github.com/airflow-helm/charts/pull/467))
48+
- add `airflow.kubernetesPodTemplate.extraContainers` value ([#456](https://github.com/airflow-helm/charts/pull/456))
49+
- add `airflow.kubernetesPodTemplate.extraInitContainers` value ([#446](https://github.com/airflow-helm/charts/pull/446))
50+
- add `airflow.kubernetesPodTemplate.shareProcessNamespace` value ([#408](https://github.com/airflow-helm/charts/pull/408))
51+
- add `airflow.kubernetesPodTemplate.podLabels` value ([#534](https://github.com/airflow-helm/charts/pull/534))
52+
53+
### Changed
54+
- the default `airflow.image` is now `apache/airflow:2.2.5-python3.8` (see the [airflow version support matrix](https://github.com/airflow-helm/charts/tree/main/charts/airflow#airflow-version-support))
55+
- support helm templating in `extraManifests` by allowing string elements ([docs](docs/faq/kubernetes/extra-manifests.md)) ([#523](https://github.com/airflow-helm/charts/pull/523))
56+
- update default `dags.gitSync.image.tag` to `v3.5.0` ([#544](https://github.com/airflow-helm/charts/pull/544))
57+
- update default `pgbouncer.image.tag` to `1.17.0-patch.0` ([#552](https://github.com/airflow-helm/charts/pull/552))
58+
- update default `pgbouncer.maxClientConnections` to `1000` ([#543](https://github.com/airflow-helm/charts/pull/543))
59+
60+
### Fixed
61+
- fix `airflow.{fernetKey,webserverSecretKey}` overshadowing `_CMD` and `_SECRET` configs ([docs-1](docs/faq/security/set-fernet-key.md), [docs-2](docs/faq/security/set-webserver-secret-key.md)) ([#508](https://github.com/airflow-helm/charts/pull/508))
62+
- fix PG_ADVISORY_LOCK not being released when using pgbouncer ([#529](https://github.com/airflow-helm/charts/pull/529))
63+
- only set `CONNECTION_CHECK_MAX_COUNT` once ([#533](https://github.com/airflow-helm/charts/pull/533))
64+
- set `DUMB_INIT_SETSID=0` for celery workers (fix warm shutdown) ([#550](https://github.com/airflow-helm/charts/pull/550))
65+
- replace pgbouncer readinessProbe with startupProbe ([#547](https://github.com/airflow-helm/charts/pull/547))
66+
- allow ingress `servicePort` to be string or number ([#530](https://github.com/airflow-helm/charts/pull/530))
67+
- fix `pgbouncer.livenessProbe.enabled` not being respected ([#546](https://github.com/airflow-helm/charts/pull/546))
68+
- cast user values with toString before b64enc ([#557](https://github.com/airflow-helm/charts/pull/557))
69+
1170
## [8.5.3] - 2022-01-10
1271

1372
> 🟥 __WARNINGS__ 🟥
@@ -622,7 +681,8 @@ TBD
622681
>
623682
> - To read about versions `7.0.0` and before, please see the [legacy repo](https://github.com/helm/charts/tree/master/stable/airflow).
624683
625-
[Unreleased]: https://github.com/airflow-helm/charts/compare/airflow-8.5.3...HEAD
684+
[Unreleased]: https://github.com/airflow-helm/charts/compare/airflow-8.6.0...HEAD
685+
[8.6.0]: https://github.com/airflow-helm/charts/compare/airflow-8.5.3...airflow-8.6.0
626686
[8.5.3]: https://github.com/airflow-helm/charts/compare/airflow-8.5.2...airflow-8.5.3
627687
[8.5.2]: https://github.com/airflow-helm/charts/compare/airflow-8.5.1...airflow-8.5.2
628688
[8.5.1]: https://github.com/airflow-helm/charts/compare/airflow-8.5.0...airflow-8.5.1

charts/airflow/Chart.yaml

+4-6
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,13 @@
11
apiVersion: v2
2-
description: Airflow Helm Chart (User Community) - used to deploy Apache Airflow on Kubernetes
2+
description: Airflow Helm Chart (User Community) - the standard way to deploy Apache Airflow on Kubernetes with Helm
33
name: airflow
4-
version: 8.5.3
5-
appVersion: 2.1.4
4+
version: 8.6.0
5+
appVersion: 2.2.5
66
icon: https://airflow.apache.org/_images/pin_large.png
7-
home: https://github.com/airflow-helm/charts
7+
home: https://github.com/airflow-helm/charts/tree/main/charts/airflow
88
maintainers:
99
- name: thesuperzapper
1010
url: https://github.com/thesuperzapper
11-
- name: gsemet
12-
url: https://github.com/gsemet
1311
sources:
1412
- https://github.com/airflow-helm/charts/tree/main/charts/airflow
1513
keywords:

charts/airflow/README.md

+6-1
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,11 @@
55
The `User-Community Airflow Helm Chart` is the standard way to deploy [Apache Airflow](https://airflow.apache.org/) on [Kubernetes](https://kubernetes.io/) with [Helm](https://helm.sh/).
66
Originally created in 2018, it has since helped thousands of companies create production-ready deployments of Airflow on Kubernetes.
77

8+
> If you appreciate the `User-Community Airflow Helm Chart` please consider supporting us!
9+
>
10+
> - [give a ⭐ on GitHub](https://github.com/airflow-helm/charts/stargazers)
11+
> - [give a ⭐ on ArtifactHub](https://artifacthub.io/packages/helm/airflow-helm/airflow)
12+
813
> __NOTE:__ this project is independent of the official chart found in the `apache/airflow` GitHub repository, and is supported by the kind contributions of users like yourself!
914
1015
## Project Goals
@@ -47,7 +52,7 @@ Originally created in 2018, it has since helped thousands of companies create pr
4752
## Frequently Asked Questions
4853

4954
- __Configuration:__
50-
- [`How to set the airflow version?`](https://github.com/airflow-helm/charts/tree/main/charts/airflow/docs/faq/configuration/airflow-version.md) <a id="how-to-use-a-specific-version-of-airflow"></a>
55+
- [`How to choose the airflow version?`](https://github.com/airflow-helm/charts/tree/main/charts/airflow/docs/faq/configuration/airflow-version.md) <a id="how-to-use-a-specific-version-of-airflow"></a>
5156
- [`How to set airflow configs?`](https://github.com/airflow-helm/charts/tree/main/charts/airflow/docs/faq/configuration/airflow-configs.md) <a id="how-to-set-airflow-configs"></a>
5257
- [`How to load airflow plugins?`](https://github.com/airflow-helm/charts/tree/main/charts/airflow/docs/faq/configuration/airflow-plugins.md)
5358
- [`How to install extra python packages?`](https://github.com/airflow-helm/charts/tree/main/charts/airflow/docs/faq/configuration/extra-python-packages.md) <a id="how-to-install-extra-pip-packages"></a>

charts/airflow/docs/faq/configuration/airflow-version.md

+5-4
Original file line numberDiff line numberDiff line change
@@ -2,13 +2,11 @@
22

33
> Note, this page was written for the [`User-Community Airflow Helm Chart`](https://github.com/airflow-helm/charts/tree/main/charts/airflow)
44
5-
# How to set the airflow version?
5+
# How to choose the airflow version?
66

77
> 🟦 __Tip__ 🟦
88
>
9-
> There is a default version (`airflow.image.tag`) of airflow shipped with each version of the chart, see the default [values.yaml](../../../values.yaml) for the current one.
10-
11-
> 🟦 __Tip__ 🟦
9+
> There is a default version of airflow shipped with each version of the chart, see the [default `values.yaml`](../../../values.yaml) for the current one.
1210
>
1311
> Many versions of airflow versions are supported by the chart, please see the [Airflow Version Support](../../..#airflow-version-support) matrix.
1412
@@ -58,4 +56,7 @@ airflow:
5856
5957
## WARNING: even if set to "Always" do not reuse tag names, as containers only pull the latest image when restarting
6058
pullPolicy: IfNotPresent
59+
60+
## sets first element of `spec.imagePullSecrets` on Pod templates (for access to private container registry)
61+
pullSecret: ""
6162
```

charts/airflow/values.yaml

+1-1
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ airflow:
1010
##
1111
image:
1212
repository: apache/airflow
13-
tag: 2.1.4-python3.8
13+
tag: 2.2.5-python3.8
1414
pullPolicy: IfNotPresent
1515
pullSecret: ""
1616
uid: 50000

0 commit comments

Comments
 (0)