[VOTE] Release Apache Airflow Helm Chart 1.13.1 based on 1.13.1rc1

[Jed Cunningham]

Hello Apache Airflow Community,

This is a call for the vote to release Helm Chart version 1.13.1.

The release candidate is available at:
https://dist.apache.org/repos/dist/dev/airflow/helm-chart/1.13.1rc1/

airflow-chart-1.13.1-source.tar.gz - is the "main source release" that
comes with INSTALL instructions.
airflow-1.13.1.tgz - is the binary Helm Chart release.

Public keys are available at: https://www.apache.org/dist/airflow/KEYS

For convenience "index.yaml" has been uploaded (though excluded from
voting), so you can also run the below commands.

helm repo add apache-airflow-dev
https://dist.apache.org/repos/dist/dev/airflow/helm-chart/1.13.1rc1/
helm repo update
helm install airflow apache-airflow-dev/airflow

airflow-1.13.1.tgz.prov - is also uploaded for verifying Chart Integrity,
though not strictly required for releasing the artifact based on ASF
Guidelines.

$ helm gpg verify airflow-1.13.1.tgz
gpg: Signature made Thu Mar 21 12:13:02 2024 MDT
gpg:using RSA key E1A1E984F55B8F280BD9CBA20BB7163892A2E48E
gpg:issuer "jedcunning...@apache.org"
gpg: Good signature from "Jed Cunningham "
[ultimate]
plugin: Chart SHA verified.
sha256:ed6b2dea0d8f99eb9bd9cd6bc418db95f88a7bb3b8d1afb7fdc266b1ea411a15

The vote will be open for at least 72 hours (2024-03-24 18:29 UTC) or until
the necessary number of votes is reached.

https://www.timeanddate.com/countdown/to?iso=20240324T1829=136=cursive

Please vote accordingly:

[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove with the reason

Only votes from PMC members are binding, but members of the community are
encouraged to test the release and vote with "(non-binding)".

Consider this my (binding) +1.

For license checks, the .rat-excludes files is included, so you can run the
following to verify licenses (just update your path to rat):

tar -xvf airflow-chart-1.13.1-source.tar.gz
cd airflow-chart-1.13.1
java -jar apache-rat-0.13.jar chart -E .rat-excludes

Please note that the version number excludes the `rcX` string, so it's now
simply 1.13.1. This will allow us to rename the artifact without modifying
the artifact checksums when we actually release it.

The status of testing the Helm Chart by the community is kept here:
https://github.com/apache/airflow/issues/38382

Thanks,
Jed

Re: Apache Airflow 2.9.0b1 available for testing

[Jarek Potiuk]

Just wanted to stress a note for this one:

*apache-airflow-providers-fab==1.0.2b0 must be installed alongside*
*this snapshot for Airflow to work.*

(we will improve it in the next release)
J.


On Thu, Mar 21, 2024 at 1:12 PM Ephraim Anierobi 
wrote:

> Hey fellow Airflowers,
>
> We have cut Airflow 2.9.0b1 now that all the main features have been
> included.
>
> Note: apache-airflow-providers-fab==1.0.2b0 must be installed alongside
> this snapshot for Airflow to work.
>
> This "snapshot" is intended for members of the Airflow developer community
> to test the build
> and allow early testing of 2.9.0. Please test this beta and create GitHub
> issues wherever possible if you encounter bugs, (use 2.9.0b1 in the version
> dropdown filter when creating the issue).
>
> For clarity, this is not an official release of Apache Airflow either -
> that doesn't happen until we make a release candidate and then vote on
> that.
>
> Airflow 2.9.0b1 is available at:
> https://dist.apache.org/repos/dist/dev/airflow/2.9.0b1/
>
> *apache-airflow-2.9.0-source.tar.gz* is a source release that comes with
> INSTALL instructions.
> *apache-airflow-2.9.0.tar.gz* is the binary Python "sdist" release.
> *apache_airflow-2.9.0-py3-none-any.whl* is the binary Python wheel "binary"
> release.
>
> This snapshot has been pushed to PyPI too at
> https://pypi.org/project/apache-airflow/2.9.0b1/
> and can be installed by running the following command:
>
> pip install 'apache-airflow==2.9.0b1'
>
> *Constraints files* are available at
> https://github.com/apache/airflow/tree/constraints-2.9.0b1
>
> Release Notes:
> https://github.com/apache/airflow/blob/2.9.0b1/RELEASE_NOTES.rst
>
> *Changes since 2.8.4rc1:*
>
> *Significant Changes*
>
>
> *Following Listener API methods are considered stable and can be used for
> production system (were experimental feature in older Airflow versions)
> (#36376):*
> Lifecycle events:
>
> - ``on_starting``
> - ``before_stopping``
>
> DagRun State Change Events:
>
> - ``on_dag_run_running``
> - ``on_dag_run_success``
> - ``on_dag_run_failed``
>
> TaskInstance State Change Events:
>
> - ``on_task_instance_running``
> - ``on_task_instance_success``
> - ``on_task_instance_failed``
>
> *Support for Microsoft SQL-Server for Airflow Meta Database has been
> removed (#36514)*
>
> After discussion
>  and a
> voting
> process  >,
> the Airflow's PMC and Committers have reached a resolution to no longer
> maintain MsSQL as a supported Database Backend.
>
> As of Airflow 2.9.0 support of MsSQL has been removed for Airflow Database
> Backend.
>
> A migration script which can help migrating the database *before* upgrading
> to Airflow 2.9.0 is available in airflow-mssql-migration repo on Github
> .
>
> Note that the migration script is provided without support and warranty.
>
> This does not affect the existing provider packages (operators and hooks),
> DAGs can still access and process data from MsSQL.
>
> *Dataset URIs are now validated on input (#37005)*
>
> Datasets must use a URI that conform to rules laid down in AIP-60, and the
> value
> will be automatically normalized when the DAG file is parsed. See
> `documentation on Datasets <
>
> https://airflow.apache.org/docs/apache-airflow/stable/authoring-and-scheduling/datasets.html
> >`_
> for
> a more detailed description on the rules.
>
> You may need to change your Dataset identifiers if they look like a URI,
> but are
> used in a less mainstream way, such as relying on the URI's auth section,
> or
> have a case-sensitive protocol name.
>
> *The method ``get_permitted_menu_items`` in ``BaseAuthManager`` has been
> renamed ``filter_permitted_menu_items`` (#37627)*
>
> *Add REST API actions to Audit Log events (#37734)*
>
> The Audit Log ``event`` name for REST API events will be prepended with
> ``api.`` or ``ui.``, depending on if it came from the Airflow UI or
> externally.
>
> *Airflow 2.9.0 is the first release that officially supports Python 3.12
> (#38025)*
> There are a few caveats though:
>
> * Pendulum2 does not support Python 3.12. For Python 3.12 you need to use
>   `Pendulum 3 <
> https://pendulum.eustace.io/blog/announcing-pendulum-3-0-0.html>`_
>
> * Minimum SQLAlchemy version supported when Pandas is installed for Python
> 3.12 is ``1.4.36`` released in
>   April 2022. Airflow 2.9.0 increases the minimum supported version of
> SQLAlchemy to ``1.4.36`` for all
>   Python versions.
>
> Not all Providers support Python 3.12. At the initial release of Airflow
> 2.9.0 the following providers
> are released without support for Python 3.12:
>
>   * ``apache.beam`` - pending on `Apache Beam support for 3.12 <
> https://github.com/apache/beam/issues/29149>`_
>   * ``papermill`` - pending on Releasing Python 3.12 compatible papermill
> client version
> `including this merged 

Apache Airflow 2.9.0b1 available for testing

[Ephraim Anierobi]

Hey fellow Airflowers,

We have cut Airflow 2.9.0b1 now that all the main features have been
included.

Note: apache-airflow-providers-fab==1.0.2b0 must be installed alongside
this snapshot for Airflow to work.

This "snapshot" is intended for members of the Airflow developer community
to test the build
and allow early testing of 2.9.0. Please test this beta and create GitHub
issues wherever possible if you encounter bugs, (use 2.9.0b1 in the version
dropdown filter when creating the issue).

For clarity, this is not an official release of Apache Airflow either -
that doesn't happen until we make a release candidate and then vote on that.

Airflow 2.9.0b1 is available at:
https://dist.apache.org/repos/dist/dev/airflow/2.9.0b1/

*apache-airflow-2.9.0-source.tar.gz* is a source release that comes with
INSTALL instructions.
*apache-airflow-2.9.0.tar.gz* is the binary Python "sdist" release.
*apache_airflow-2.9.0-py3-none-any.whl* is the binary Python wheel "binary"
release.

This snapshot has been pushed to PyPI too at
https://pypi.org/project/apache-airflow/2.9.0b1/
and can be installed by running the following command:

pip install 'apache-airflow==2.9.0b1'

*Constraints files* are available at
https://github.com/apache/airflow/tree/constraints-2.9.0b1

Release Notes:
https://github.com/apache/airflow/blob/2.9.0b1/RELEASE_NOTES.rst

*Changes since 2.8.4rc1:*

*Significant Changes*


*Following Listener API methods are considered stable and can be used for
production system (were experimental feature in older Airflow versions)
(#36376):*
Lifecycle events:

- ``on_starting``
- ``before_stopping``

DagRun State Change Events:

- ``on_dag_run_running``
- ``on_dag_run_success``
- ``on_dag_run_failed``

TaskInstance State Change Events:

- ``on_task_instance_running``
- ``on_task_instance_success``
- ``on_task_instance_failed``

*Support for Microsoft SQL-Server for Airflow Meta Database has been
removed (#36514)*

After discussion
 and a voting
process ,
the Airflow's PMC and Committers have reached a resolution to no longer
maintain MsSQL as a supported Database Backend.

As of Airflow 2.9.0 support of MsSQL has been removed for Airflow Database
Backend.

A migration script which can help migrating the database *before* upgrading
to Airflow 2.9.0 is available in airflow-mssql-migration repo on Github
.

Note that the migration script is provided without support and warranty.

This does not affect the existing provider packages (operators and hooks),
DAGs can still access and process data from MsSQL.

*Dataset URIs are now validated on input (#37005)*

Datasets must use a URI that conform to rules laid down in AIP-60, and the
value
will be automatically normalized when the DAG file is parsed. See
`documentation on Datasets <
https://airflow.apache.org/docs/apache-airflow/stable/authoring-and-scheduling/datasets.html>`_
for
a more detailed description on the rules.

You may need to change your Dataset identifiers if they look like a URI,
but are
used in a less mainstream way, such as relying on the URI's auth section, or
have a case-sensitive protocol name.

*The method ``get_permitted_menu_items`` in ``BaseAuthManager`` has been
renamed ``filter_permitted_menu_items`` (#37627)*

*Add REST API actions to Audit Log events (#37734)*

The Audit Log ``event`` name for REST API events will be prepended with
``api.`` or ``ui.``, depending on if it came from the Airflow UI or
externally.

*Airflow 2.9.0 is the first release that officially supports Python 3.12
(#38025)*
There are a few caveats though:

* Pendulum2 does not support Python 3.12. For Python 3.12 you need to use
  `Pendulum 3 <
https://pendulum.eustace.io/blog/announcing-pendulum-3-0-0.html>`_

* Minimum SQLAlchemy version supported when Pandas is installed for Python
3.12 is ``1.4.36`` released in
  April 2022. Airflow 2.9.0 increases the minimum supported version of
SQLAlchemy to ``1.4.36`` for all
  Python versions.

Not all Providers support Python 3.12. At the initial release of Airflow
2.9.0 the following providers
are released without support for Python 3.12:

  * ``apache.beam`` - pending on `Apache Beam support for 3.12 <
https://github.com/apache/beam/issues/29149>`_
  * ``papermill`` - pending on Releasing Python 3.12 compatible papermill
client version
`including this merged issue <
https://github.com/nteract/papermill/pull/771>`_

*New Features*
- Add ``Matomo`` as an option for analytics_tool. (#38221)
- Experimental: Support custom weight_rule implementation to calculate the
TI priority_weight (#38222)
- Adding ability to automatically set DAG to off after X times it failed
sequentially (#36935)
- Add dataset conditions to next run datasets modal (#38123)
- Add task log grouping to UI (#38021)
- Add dataset_expression to grid dag details (#38121)
- Introduce