Thanks Jarek! :)
---
Just to prevent confusion, edit, my mind going a bit ahead than what I am
writing sometimes :)
From:
Firstly, I released a difference while making breeze compatible...
To be (It is realized not released :)):
Firstly, I realized a difference while making breeze compatible...
Op za 21 mrt 2026, 16:24 schreef Jarek Potiuk <[email protected]>:
Ah...
OK I see it now:
breeze release-management prepare-helm-chart-tarball --version
${VERSION}
--version-suffix ${VERSION_SUFFIX}
This command removes the suffix and wrongly update the "staged" links and
ask release manager:
`Please create a PR with that change, get it merged, and try again.`
Which apparently did not happen :). So this is simply a bug in the
process.
Let me fix it :)
J.
On Sat, Mar 21, 2026 at 3:24 PM Buğra Öztürk <[email protected]>
wrote:
Firstly, I released a difference while making breeze compatible with
tool
install and enabling auto update in breeze. That made me realise we
have
a
parameter difference in verification and how the packages are built.
So I
thought we should do the same thing and even committed to raising a PR
to
sync the processes. Then, when I ran the verification a second time, it
created the packages. One we use version and another version suffix,
but
when created haven't dug thinking that it should have been from
an environment variable. I always skipped tagging to prevent overriding
the
tag created.
Verification:
https://github.com/apache/airflow/blob/d273d99262f93d9af601b3fb3c12f915f4ddbb27/dev/README_RELEASE_HELM_CHART.md?plain=1#L504
RC Creation:
https://github.com/apache/airflow/blob/d273d99262f93d9af601b3fb3c12f915f4ddbb27/dev/README_RELEASE_HELM_CHART.md?plain=1#L226
When I created it, I also saw the -dev suffix, but thought not a
breaking
change for the release process. The Chart.yaml has also been updated
automatically while creating. I rerun the process again to double-check
and
see that this also updates the doc links automatically.
Below is one running with `--skip-tagging` and seeing that updates the
doc
references inside Chart.yaml. Even with an empty `VERSION_SUFFIX`, it
seems
it is updating.
I ran the one in RC creation command first and then ran the one in
verification, which worked. I haven't seen any difference while
checking
the packages. I thought only the Chart.yaml making it `-dev` while
thinking
it isn't a great deal to stop the process made me overlook the doc URL,
also updated.
From the print you shared, Jarek, I think we should use the
Verification
approach then, while releasing, so that the doc references are also not
updated to staging. I also ran it once again in the verification
process,
and that only updates the version in Chart.yaml.
Sharing the details of what was mentioned above after `---`.
---
*Verification Process*
``` bash
VERSION=1.20.0 breeze release-management prepare-helm-chart-tarball
--version-suffix ${VERSION_SUFFIX} --ignore-version-check
--skip-tagging
```
Before
``` yaml
...
apiVersion: v2
name: airflow
version: 1.20.0-dev
appVersion: 3.1.8
description: The official Helm chart to deploy Apache Airflow, a
platform
to
programmatically author, schedule, and monitor workflows
home: https://airflow.apache.org/
...
```
After
``` yaml
...
apiVersion: v2
name: airflow
version: 1.20.0
appVersion: 3.1.8
description: The official Helm chart to deploy Apache Airflow, a
platform
to
programmatically author, schedule, and monitor workflows
home: https://airflow.apache.org/
...
```
*Release Process*
``` bash
breeze release-management prepare-helm-chart-tarball --version
${VERSION}
--version-suffix ${VERSION_SUFFIX} --skip-tagging
```
Before
``` yaml
...
apiVersion: v2
name: airflow
version: 1.20.0-dev
appVersion: 3.1.8
description: The official Helm chart to deploy Apache Airflow, a
platform
to
programmatically author, schedule, and monitor workflows
home: https://airflow.apache.org/
sources:
- https://github.com/apache/airflow
icon: https://airflow.apache.org/images/airflow_dark_bg.png
keywords:
- apache
- airflow
- workflow
- scheduler
dependencies:
- name: postgresql
version: 13.2.24
repository: https://charts.bitnami.com/bitnami
condition: postgresql.enabled
maintainers:
- email: [email protected]
name: Apache Airflow PMC
type: application
annotations:
artifacthub.io/links: |
- name: Documentation
url: https://airflow.apache.org/docs/helm-chart/1.20.0/
artifacthub.io/screenshots: |
- title: Home Page
url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/home_dark.png
- title: DAG Overview Dashboard
url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_dashboard.png
- title: DAGs View
url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/dags.png
- title: Assets View
url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/asset_view.png
- title: Grid View
url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_grid.png
- title: Graph View
url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_graph.png
- title: Variable View
url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/variable_hidden.png
- title: Code View
url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_code.png
...
```
After
``` yaml
...
apiVersion: v2
name: airflow
version: 1.20.0
appVersion: 3.1.8
description: The official Helm chart to deploy Apache Airflow, a
platform
to
programmatically author, schedule, and monitor workflows
home: https://airflow.staged.apache.org/
sources:
- https://github.com/apache/airflow
icon: https://airflow.staged.apache.org/images/airflow_dark_bg.png
keywords:
- apache
- airflow
- workflow
- scheduler
dependencies:
- name: postgresql
version: 13.2.24
repository: https://charts.bitnami.com/bitnami
condition: postgresql.enabled
maintainers:
- email: [email protected]
name: Apache Airflow PMC
type: application
annotations:
artifacthub.io/links: |
- name: Documentation
url: https://airflow.staged.apache.org/docs/helm-chart/1.20.0/
artifacthub.io/screenshots: |
- title: Home Page
url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/home_dark.png
- title: DAG Overview Dashboard
url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_dashboard.png
- title: DAGs View
url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/dags.png
- title: Assets View
url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/asset_view.png
- title: Grid View
url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_grid.png
- title: Graph View
url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_graph.png
- title: Variable View
url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/variable_hidden.png
- title: Code View
url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_code.png
...
```
On Sat, Mar 21, 2026 at 2:17 PM Jarek Potiuk <[email protected]> wrote:
Hmm. For now it's
-1: (binding) for me. I think we need to find out what happened here
:)
before making further decisions.
I am not sure exactly how the packages were produced (I followed the
verification procedure not the preparation procedure—but they look
quite
the same). Maybe? Possibly? I'm unaware of some subtle differences
in
the
release process, or perhaps the tag was pushed differently. I can't
really
explain it currently—unless someone made manual modifications to the
artifacts along the way to fix things (Jens?). This means our
reproducibility check would **in fact** detect such a thing - even if
it
were an innocent attempt to fix the produced artifact (absolutely no
doubt
about no malicious intent from Jens):
One thing is less important: when I use the `helm-chart/1.20.0rc1` -
I
can't produce the chart or tarball (breeze commands fail) unless I
manually correct the version from 1.20.0-dev (currently in sources
https://github.com/apache/airflow/blob/helm-chart/1.20.0rc1/chart/Chart.yaml
#L22
<
https://github.com/apache/airflow/blob/helm-chart/1.20.0rc1/chart/Chart.yaml#L22
).
When I manually change it to 1.20.0, both: `.tar.gz` and
`-source.tar.gz` are produced, they have correct names, and the
version
in
the chart is as expected (1.20.0).
Documenting the process to prepare the chart to remove the dev suffix
would
be acceptable and should resolve the issue without cancelling the
vote.
However, there is one, more serious issue: even if I change the
version,
the resulting Helm chart is different (diff below). Essentially, the
Helm
chart in SVN links to "staged.apache.org" documentation, not "
apache.org
".
That basically disqualifies what we currently have in SVN now from
promoting to release because documentation links are wrong. Small,
but
important thing.
I think there's a mishap regarding how the -dev prefix was added. We
used
to add it to the sources (usually) in the past, but we haven't done
that
for quite a while. We should probably agree on how to handle it (it
might
even be documented incorrectly somewhere). There is no mentioning of
the
prefix in the prefix, but I think Jed could have added it
"automatically"
here:
https://github.com/apache/airflow/commit/370c1dc27961b5f36b738e4be27b07c3cd6e5313
But basically the -dev suffix presence makes the links point to
staged.
So my hypothesis (Jens?) was that the version was modified manually,
and
we
should improve the process to automate it rather than rely on manual
modifications. But I am guessing now - however the chart in our SVN
now
is
not really good for release.
J.
---------
```
--- /Users/jarekpotiuk/code/airflow-clone/dist/airflow-1.20.0.tgz
+++
/Users/jarekpotiuk/code/asf-dist/dev/airflow/helm-chart/1.20.0rc1/airflow-1.20.0.tgz
├── airflow-1.20.0.tgz-content
│ ├── file list
│ │ @@ -1,12 +1,12 @@
│ │ drwx------ 0 root (0) root (0) 0
2026-03-17
21:55:32.000000 airflow/
│ │ -rw------- 0 root (0) root (0) 1196
2026-03-17
21:55:32.000000 airflow/.helmignore
│ │ -rw------- 0 root (0) root (0) 4148
2026-03-17
21:55:32.000000 airflow/.pre-commit-config.yaml
│ │ -rw------- 0 root (0) root (0) 227
2026-03-17
21:55:32.000000 airflow/Chart.lock
│ │ --rw------- 0 root (0) root (0) 7117
2026-03-17
21:55:32.000000 airflow/Chart.yaml
│ │ +-rw------- 0 root (0) root (0) 7194
2026-03-17
21:55:32.000000 airflow/Chart.yaml
│ │ -rw------- 0 root (0) root (0) 468
2026-03-17
21:55:32.000000 airflow/INSTALL
│ │ -rw------- 0 root (0) root (0) 10850
2026-03-17
21:55:32.000000 airflow/LICENSE
│ │ -rw------- 0 root (0) root (0) 863
2026-03-17
21:55:32.000000 airflow/NOTICE
│ │ -rw------- 0 root (0) root (0) 3715
2026-03-17
21:55:32.000000 airflow/README.md
│ │ -rw------- 0 root (0) root (0) 72480
2026-03-17
21:55:32.000000 airflow/RELEASE_NOTES.rst
│ │ drwx------ 0 root (0) root (0) 0
2026-03-17
21:55:32.000000 airflow/charts/
│ │ drwx------ 0 root (0) root (0) 0
2026-03-17
21:55:32.000000 airflow/charts/postgresql/
│ ├── airflow/Chart.yaml
│ │ @@ -142,43 +142,43 @@
│ │ - description: Allow to use short SPDX licence identifier
for
selected files
│ │ kind: fixed
│ │ links:
│ │ - name: '#62073'
│ │ url: https://github.com/apache/airflow/pull/62073
│ │ artifacthub.io/links: |
│ │ - name: Documentation
│ │ - url: https://airflow.apache.org/docs/helm-chart/1.20.0/
│ │ + url:
https://airflow.staged.apache.org/docs/helm-chart/1.20.0/
│ │ artifacthub.io/screenshots: |
│ │ - title: Home Page
│ │ - url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/home_dark.png
│ │ + url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/home_dark.png
│ │ - title: DAG Overview Dashboard
│ │ - url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_dashboard.png
│ │ + url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_dashboard.png
│ │ - title: DAGs View
│ │ - url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/dags.png
│ │ + url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/dags.png
│ │ - title: Assets View
│ │ - url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/asset_view.png
│ │ + url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/asset_view.png
│ │ - title: Grid View
│ │ - url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_grid.png
│ │ + url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_grid.png
│ │ - title: Graph View
│ │ - url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_graph.png
│ │ + url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_graph.png
│ │ - title: Variable View
│ │ - url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/variable_hidden.png
│ │ + url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/variable_hidden.png
│ │ - title: Code View
│ │ - url:
https://airflow.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_code.png
│ │ + url:
https://airflow.staged.apache.org/docs/apache-airflow/3.1.8/_images/dag_overview_code.png
│ │ apiVersion: v2
│ │ appVersion: 3.1.8
│ │ dependencies:
│ │ - condition: postgresql.enabled
│ │ name: postgresql
│ │ repository: https://charts.bitnami.com/bitnami
│ │ version: 13.2.24
│ │ description: The official Helm chart to deploy Apache Airflow, a
platform to programmatically
│ │ author, schedule, and monitor workflows
│ │ -home: https://airflow.apache.org/
│ │ -icon: https://airflow.apache.org/images/airflow_dark_bg.png
│ │ +home: https://airflow.staged.apache.org/
│ │ +icon:
https://airflow.staged.apache.org/images/airflow_dark_bg.png
│ │ keywords:
│ │ - apache
│ │ - airflow
│ │ - workflow
│ │ - scheduler
│ │ maintainers:
│ │ - email: [email protected]
```
On Sat, Mar 21, 2026 at 12:32 PM Jens Scheffler <[email protected]
wrote:
Note/Reminder: Still looking for more VOTE responses in order to
validate release.
All PMCs are on call for this (it is your duty!) and all other
contributers are also welcome to validate.
On 18.03.26 23:34, Buğra Öztürk wrote:
+1 (binding)
I have checked,
- SVN
- Reproducible package builds
- Licence
- Signature
- Checksums
Best regards,
Bugra Ozturk
On Wed, Mar 18, 2026 at 12:37 AM Jens Scheffler <
[email protected]
wrote:
Hello Apache Airflow Community,
This is a call for the vote to release Helm Chart version
1.20.0.
The release candidate is available at:
https://dist.apache.org/repos/dist/dev/airflow/helm-chart/1.20.0rc1/
airflow-chart-1.20.0-source.tar.gz - is the "main source
release"
that
comes with INSTALL instructions.
airflow-1.20.0.tgz - is the binary Helm Chart release.
Public keys are available at:
https://www.apache.org/dist/airflow/KEYS
For convenience "index.yaml" has been uploaded (though excluded
from
voting), so you can also run the below commands.
helm repo add apache-airflow-dev
https://dist.apache.org/repos/dist/dev/airflow/helm-chart/1.20.0rc1/
helm repo update
helm install airflow apache-airflow-dev/airflow
airflow-1.20.0.tgz.prov - is also uploaded for verifying Chart
Integrity, though not strictly required for releasing the
artifact
based
on ASF Guidelines.
$ helm gpg verify airflow-1.20.0.tgz
gpg: Signature made Mi 18 Mär 2026 00:07:31 CET
gpg: using EDDSA key
EFDA915011C4751F8A3AD979AEFD29C8BA60C0F4
gpg: issuer "[email protected]"
gpg: Good signature from "Jens Scheffler <[email protected]>"
[ultimate]
plugin: Chart SHA verified.
sha256:50b9de4c9d363be0af893bf018f49b234be8af69bdabf84915a7789e6930d329
The vote will be open for at least 72 hours (2026-03-20 23:36
UTC)
or
until the necessary number of votes is reached.
https://www.timeanddate.com/countdown/to?iso=20260320T2337&p0=136&font=cursive
Please vote accordingly:
[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove with the reason
Only votes from PMC members are binding, but members of the
community
are
encouraged to test the release and vote with "(non-binding)".
Consider this my (binding) +1.
For license checks, the .rat-excludes files is included, so you
can
run
the following to verify licenses (just update your path to rat):
tar -xvf airflow-chart-1.20.0-source.tar.gz
cd airflow-chart-1.20.0
java -jar apache-rat-0.13.jar chart -E .rat-excludes
Please note that the version number excludes the `rcX` string,
so
it's
now simply 1.20.0. This will allow us to rename the artifact
without
modifying the artifact checksums when we actually release it.
The status of testing the Helm Chart by the community is kept
here:
https://github.com/apache/airflow/issues/63859
Thanks,
Jens Scheffler
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
