You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This chart provides a standard way to deploy [Apache Airflow](https://airflow.apache.org/) on your Kubernetes cluster,
10
-
and is used by thousands of companies for their production deployments of Airflow.
9
+
The `Airflow Helm Chart (User Community)` provides a standard way to deploy [Apache Airflow](https://airflow.apache.org/) on Kubernetes with Helm, and is used by thousands of companies for production deployments of Airflow.
11
10
12
-
> 🟦 __Discussion__ 🟦
13
-
>
14
-
> The `user community` chart is an alternative to the `official` chart found in the `apache/airflow` repo.<br>
15
-
> There are differences between the charts, so you should evaluate which is better for your organisation.
16
-
>
17
-
> The `user community` chart has existed since 2018 and was previously called `stable/airflow` on the official [helm/charts](https://github.com/helm/charts/tree/master/stable/airflow) repo.
18
-
>
19
-
> The goals of the `user community` chart are:<br>
20
-
> (1) be easy to configure<br>
21
-
> (2) support older airflow versions<br>
22
-
> (3) provide great documentation<br>
23
-
> (4) automatically detect bad configs<br>
11
+
### Goals:
24
12
25
-
## Quickstart Guide
13
+
(1) Ease of Use<br>
14
+
(2) Great Documentation<br>
15
+
(3) Support for older Airflow Versions<br>
16
+
(4) Support for Kubernetes GitOps Tools (like ArgoCD)
26
17
27
-
These steps will allow you to quickly install Apache Airflow on your Kubernetes cluster using the `community` chart.
18
+
### History:
28
19
29
-
### 1. Install the Chart
20
+
The `Airflow Helm Chart (User Community)` is a popular alternative to the official chart released in 2021 inside the `apache/airflow` git repository.
21
+
It was created in 2018 and was previously called `stable/airflow` when it lived in the (now end-of-life) [helm/charts](https://github.com/helm/charts/tree/master/stable/airflow) repository.
30
22
31
-
> 🟨 __Note__ 🟨
32
-
>
33
-
> In production, we encourage using a tool like [ArgoCD](https://argoproj.github.io/argo-cd/), rather than running `helm install` manually
23
+
### Airflow Version Support:
24
+
25
+
Chart Version → <br> Airflow Version ↓ | `7.X.X` | `8.X.X` |
26
+
--- | --- | ---
27
+
`1.10.X` | ✅ | ✅️ <sub>[1]</sub>
28
+
`2.0.X`| ❌ | ✅
29
+
`2.1.X`| ❌ | ✅
30
+
31
+
<sub>[1] you must set `airflow.legacyCommands = true` to use airflow version `1.10.X` with chart version `8.X.X`
<sub>[1] we encourage you to use chart version `8.X.X`, so you can use the `airflow.kubernetesPodTemplate.*` values (note, requires airflow `1.10.11+`, as it uses [AIRFLOW__KUBERNETES__POD_TEMPLATE_FILE](https://airflow.apache.org/docs/apache-airflow/2.1.0/configurations-ref.html#pod-template-file))
42
+
43
+
44
+
## Quickstart Guide
34
45
46
+
### Install:
47
+
48
+
__(Step 1) - Add this helm repository:__
35
49
```sh
36
-
# add this repo as "airflow-stable"
50
+
## add this helm repository & pull updates from it
<sub>[1] we encourage you to upgrade the chart to `8.X.X`, so you can use the `airflow.kubernetesPodTemplate` values (which require airflow `1.10.11+`, as they set [AIRFLOW__KUBERNETES__POD_TEMPLATE_FILE](https://airflow.apache.org/docs/apache-airflow/2.1.0/configurations-ref.html#pod-template-file)) </sub>
105
+
### Examples:
96
106
97
-
### Examples
107
+
To help you create your `custom-values.yaml` file, we provide some examples for common situations:
98
108
99
-
We provide some example `values.yaml` files for common configurations:
> __NOTE:__ some values are not discussed in the `FAQ`, you can view the default [values.yaml](values.yaml) file for a full list of values
105
115
106
-
We recommend you review the following questions from the FAQ:
116
+
Review the FAQ to understand how the chart functions, here are some good starting points:
107
117
108
-
-[How to use a specific version of airflow?](#how-to-use-a-specific-version-of-airflow)
109
-
-[How to set airflow configs?](#how-to-set-airflow-configs)
110
-
-[How to create airflow users?](#how-to-create-airflow-users) or [How to authenticate airflow users with LDAP/OAUTH?](#how-to-authenticate-airflow-users-with-ldapoauth)
111
-
-[How to create airflow connections?](#how-to-create-airflow-connections)
112
-
-[How to use an external database?](#how-to-use-an-external-database)
113
-
-[How to persist airflow logs?](#how-to-persist-airflow-logs)
114
-
-[How to setup an Ingres?](#how-to-set-up-an-ingress)
118
+
-["How to use a specific version of airflow?"](#how-to-use-a-specific-version-of-airflow)
119
+
-["How to set airflow configs?"](#how-to-set-airflow-configs)
120
+
-["How to create airflow users?"](#how-to-create-airflow-users)
121
+
-["How to authenticate airflow users with LDAP/OAUTH?"](#how-to-authenticate-airflow-users-with-ldapoauth)
122
+
-["How to create airflow connections?"](#how-to-create-airflow-connections)
123
+
-["How to use an external database?"](#how-to-use-an-external-database)
124
+
-["How to persist airflow logs?"](#how-to-persist-airflow-logs)
125
+
-["How to set up an Ingress?"](#how-to-set-up-an-ingress)
115
126
116
127
## FAQ - Airflow
117
128
118
-
> These are some frequently asked questions related to airflow configs:
129
+
> __Frequently asked questions related to airflow configs__
119
130
120
131
### How to use a specific version of airflow?
121
132
<details>
@@ -1022,7 +1033,7 @@ serviceAccount:
1022
1033
1023
1034
## FAQ - Databases
1024
1035
1025
-
> These are some frequently asked questions related to database configs:
1036
+
> __Frequently asked questions related to database configs__
1026
1037
1027
1038
### How to use the embedded Postgres?
1028
1039
<details>
@@ -1146,7 +1157,7 @@ externalRedis:
1146
1157
1147
1158
## FAQ - Kubernetes
1148
1159
1149
-
> These are some frequently asked questions related to kubernetes configs:
1160
+
> __Frequently asked questions related to kubernetes configs__
1150
1161
1151
1162
### How to mount ConfigMaps/Secrets as environment variables?
1152
1163
<details>
@@ -1254,7 +1265,7 @@ ingress:
1254
1265
1255
1266
We expose the `ingress.web.precedingPaths` and `ingress.web.succeedingPaths` values, which are __before__ and __after__ the default path respectively.
1256
1267
1257
-
> 🟦 __Discussion__ 🟦
1268
+
> 🟦 __Tip__ 🟦
1258
1269
>
1259
1270
> A common use-case is [enabling SSL with the aws-alb-ingress-controller](https://kubernetes-sigs.github.io/aws-load-balancer-controller/v2.1/guide/tasks/ssl_redirect/), which needs a redirect path to be hit before the airflow-webserver one
1260
1271
@@ -1412,7 +1423,7 @@ extraManifests:
1412
1423
1413
1424
## Values Reference
1414
1425
1415
-
> The list of values provided by this chart (see the [values.yaml](values.yaml) file for more details):
1426
+
> __Values provided by this chart (for more info see [values.yaml](values.yaml))__
0 commit comments