Re: [VOTE] Airflow Providers prepared on May 01, 2024

2024-05-01 Thread Amogh Desai 
+1 non binding

Installed the tarball and ran some example DAGs for hive and cncf provider,
works as expected.

Thanks & Regards,
Amogh Desai


On Wed, May 1, 2024 at 10:49 PM Vincent Beck  wrote:

> +1 non binding. All AWS system tests are working successfully against
> apache-airflow-providers-amazon==8.21.0rc1. You can see the results here:
> https://aws-mwaa.github.io/#/open-source/system-tests/version/fe4605a10e26f1b8a180979ba5765d1cb7fb0111_8.21.0rc1.html.
> The only failure (example_bedrock) is a known issue in the test itself and
> is currently being worked on.
>
> On 2024/05/01 13:03:07 Elad Kalif wrote:
> > Hey all,
> >
> > I have just cut the new wave Airflow Providers packages. This email is
> > calling a vote on the release,
> > which will last for 72 hours - which means that it will end on May 04,
> 2024
> > 13:00 PM UTC and until 3 binding +1 votes have been received.
> >
> >
> > Consider this my (binding) +1.
> >
> > *Note some of the providers are rc2 and some rc1.*
> >
> > Airflow Providers are available at:
> > https://dist.apache.org/repos/dist/dev/airflow/providers/
> >
> > *apache-airflow-providers--*.tar.gz* are the binary
> >  Python "sdist" release - they are also official "sources" for the
> provider
> > packages.
> >
> > *apache_airflow_providers_-*.whl are the binary
> >  Python "wheel" release.
> >
> > The test procedure for PMC members is described in
> >
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-the-release-candidate-by-pmc-members
> >
> > The test procedure for and Contributors who would like to test this RC is
> > described in:
> >
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-the-release-candidate-by-contributors
> >
> >
> > Public keys are available at:
> > https://dist.apache.org/repos/dist/release/airflow/KEYS
> >
> > Please vote accordingly:
> >
> > [ ] +1 approve
> > [ ] +0 no opinion
> > [ ] -1 disapprove with the reason
> >
> > Only votes from PMC members are binding, but members of the community are
> > encouraged to test the release and vote with "(non-binding)".
> >
> > Please note that the version number excludes the 'rcX' string.
> > This will allow us to rename the artifact without modifying
> > the artifact checksums when we actually release.
> >
> > The status of testing the providers by the community is kept here:
> > https://github.com/apache/airflow/issues/39346
> >
> > The issue is also the easiest way to see important PRs included in the RC
> > candidates.
> > Detailed changelog for the providers will be published in the
> documentation
> > after the
> > RC candidates are released.
> >
> > You can find the RC packages in PyPI following these links:
> >
> > https://pypi.org/project/apache-airflow-providers-airbyte/3.8.0rc1/
> > https://pypi.org/project/apache-airflow-providers-alibaba/2.8.0rc1/
> > https://pypi.org/project/apache-airflow-providers-amazon/8.21.0rc1/
> > https://pypi.org/project/apache-airflow-providers-apache-beam/5.7.0rc1/
> >
> https://pypi.org/project/apache-airflow-providers-apache-cassandra/3.5.0rc1/
> > https://pypi.org/project/apache-airflow-providers-apache-drill/2.7.0rc1/
> >
> https://pypi.org/project/apache-airflow-providers-apache-druid/3.10.0rc1/
> > https://pypi.org/project/apache-airflow-providers-apache-flink/1.4.0rc1/
> > https://pypi.org/project/apache-airflow-providers-apache-hdfs/4.4.0rc2/
> > https://pypi.org/project/apache-airflow-providers-apache-hive/8.1.0rc1/
> >
> https://pypi.org/project/apache-airflow-providers-apache-impala/1.4.0rc1/
> > https://pypi.org/project/apache-airflow-providers-apache-kafka/1.4.0rc2/
> > https://pypi.org/project/apache-airflow-providers-apache-kylin/3.6.0rc2/
> > https://pypi.org/project/apache-airflow-providers-apache-livy/3.8.0rc1/
> > https://pypi.org/project/apache-airflow-providers-apache-pig/4.4.0rc2/
> > https://pypi.org/project/apache-airflow-providers-apache-pinot/4.4.0rc2/
> > https://pypi.org/project/apache-airflow-providers-apache-spark/4.8.0rc2/
> > https://pypi.org/project/apache-airflow-providers-apprise/1.3.0rc2/
> > https://pypi.org/project/apache-airflow-providers-arangodb/2.5.0rc1/
> > https://pypi.org/project/apache-airflow-providers-asana/2.5.0rc1/
> >
> https://pypi.org/project/apache-airflow-providers-atlassian-jira/2.6.0rc2/
> > https://pypi.org/project/apache-airflow-providers-celery/3.7.0rc1/
> > https://pypi.org/project/apache-airflow-providers-cloudant/3.5.0rc2/
> >
> https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.2.0rc1/
> > https://pypi.org/project/apache-airflow-providers-cohere/1.2.0rc2/
> > https://pypi.org/project/apache-airflow-providers-common-sql/1.13.0rc1/
> > https://pypi.org/project/apache-airflow-providers-databricks/6.4.0rc1/
> > https://pypi.org/project/apache-airflow-providers-datadog/3.6.0rc1/
> > https://pypi.org/project/apache-airflow-providers-dbt-cloud/3.8.0rc1/
> > https://pypi.org/project/apache-airflow-providers-ding

Re: [VOTE] Release Airflow 2.9.1 from 2.9.1rc1

2024-05-01 Thread Amogh Desai 
+1 non binding

Did a general testing by installing the RC, ran a few DAGs, performed some
random clicks on the UI, things seem to be working as expected.

Thanks & Regards,
Amogh Desai


On Wed, May 1, 2024 at 10:32 PM Scheffler Jens (XC-AS/EAE-ADA-T)
 wrote:

> +1 (non binding) - tested 2.9.1rc1 and works great, especially the UI
> glitches are removed.
>
> Mit freundlichen Grüßen / Best regards
>
> Jens Scheffler
>
> Alliance: Enabler - Tech Lead (XC-AS/EAE-ADA-T)
> Robert Bosch GmbH | Hessbruehlstraße 21 | 70565 Stuttgart-Vaihingen |
> GERMANY | http://www.bosch.com/
> Tel. +49 711 811-91508 | Mobil +49 160 90417410 |
> jens.scheff...@de.bosch.com
>
> Sitz: Stuttgart, Registergericht: Amtsgericht Stuttgart, HRB 14000;
> Aufsichtsratsvorsitzender: Prof. Dr. Stefan Asenkerschbaumer;
> Geschäftsführung: Dr. Stefan Hartung, Dr. Christian Fischer, Dr. Markus
> Forschner,
> Stefan Grosch, Dr. Markus Heyn, Dr. Frank Meyer, Dr. Tanja Rückert
>
> -Original Message-
> From: Ephraim Anierobi 
> Sent: Tuesday, April 30, 2024 1:04 PM
> To: dev@airflow.apache.org
> Subject: [VOTE] Release Airflow 2.9.1 from 2.9.1rc1
>
> Hey fellow Airflowers,
>
> I have cut Airflow 2.9.1rc1. This email is calling a vote on the release,
> which will last at least 72 hours, from Tuesday, April 30, 2024 at 11:00 am
> UTC until Friday, May 3, 2024, at 11:00 am UTC <
> https://www.timeanddate.com/worldclock/fixedtime.html?msg=8&iso=20240503T1100&p1=1440
> >,
> and until 3 binding +1 votes have been received.
>
> The status of testing of the release is kept at
> https://github.com/apache/airflow/issues/39326
>
> Consider this my (binding) +1.
>
> Airflow 2.9.1rc1 is available at:
> https://dist.apache.org/repos/dist/dev/airflow/2.9.1rc1/
>
> *apache-airflow-2.9.1-source.tar.gz* is a source release that comes with
> INSTALL instructions.
> *apache-airflow-2.9.1.tar.gz* is the binary Python "sdist" release.
> *apache_airflow-2.9.1-py3-none-any.whl* is the binary Python wheel "binary"
> release.
>
> Public keys are available at:
> https://dist.apache.org/repos/dist/release/airflow/KEYS
>
> Please vote accordingly:
>
> [ ] +1 approve
> [ ] +0 no opinion
> [ ] -1 disapprove with the reason
>
> Only votes from PMC members are binding, but all members of the community
> are encouraged to test the release and vote with "(non-binding)".
>
> The test procedure for PMC members is described in:
>
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md/#verify-the-release-candidate-by-pmc-members
>
> The test procedure for contributors and members of the community who would
> like to test this RC is described in:
>
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md/#verify-the-release-candidate-by-contributors
>
>
> Please note that the version number excludes the `rcX` string, so it's now
> simply 2.9.1. This will allow us to rename the artifact without modifying
> the artifact checksums when we actually release.
>
> Release Notes:
> https://github.com/apache/airflow/blob/2.9.1rc1/RELEASE_NOTES.rst
>
> For information on what goes into a release please see:
>
> https://github.com/apache/airflow/blob/main/dev/WHAT_GOES_INTO_THE_NEXT_RELEASE.md
>
> Changes since 2.9.0:
>
> *Significant Changes*
>
> *Stackdriver logging bugfix requires Google provider ``10.17.0`` or later
> (#38071)*
>
> If you use Stackdriver logging, you must use Google provider version
> ``10.17.0`` or later. Airflow ``2.9.1`` now passes ``gcp_log_name`` to the
> ``StackdriverTaskHandler`` instead of ``name``, and this will fail on
> earlier provider versions.
>
> This fixes a bug where the log name configured in ``[logging]
> remove_base_log_folder`` was overridden when Airflow configured logging,
> resulting in task logs going to the wrong destination.
>
> *Bug Fixes*
> - Make task log messages include run_id (#39280)
> - Copy menu_item ``href`` for nav bar (#39282)
> - Fix trigger kwarg encryption migration (#39246)
> - Add workaround for datetime-local input in ``firefox`` (#39261)
> - Add Grid button to Task Instance view (#39223)
> - Get served logs when remote or executor logs not available for
> non-running task try (#39177)
> - Fixed side effect of menu filtering causing disappearing menus (#39229)
> - Use grid view for Task Instance's ``log_url`` (#39183)
> - Improve task filtering ``UX`` (#39119)
> - Improve rendered_template ``ux`` in react dag page (#39122)
> - Graph view improvements (#38940)
> - Check that the dataset<>task exists before trying to render graph
> (#39069)
> - Hostname was "redacted", not "redact"; remove it when there is no context
> (#39037)
> - Check whether ``AUTH_ROLE_PUBLIC`` is set in ``check_authentication``
> (#39012)
> - Move rendering of ``map_index_template`` so it renders for failed tasks
> as long as it was defined before the point of failure (#38902)
> - ``Undeprecate`` ``BaseXCom.get_one`` method for now (#38991)
> - Add ``inherit_cache`` attribute for ``CreateTableAs`` custom SA Clause

Re: [VOTE] April 2024 PR of the Month

2024-05-01 Thread Wei Lee 
Thanks Kaxil for nominating me and thank you to everyone for your support 🙏

Best,
Wei

> On May 2, 2024, at 12:06 AM, Ankit Chaurasia  wrote:
> 
> My vote goes to #38674 .
> Awesome work Wei!
> 
> Ankit Chaurasia
> 
> 
> 
> 
> 
> 
> 
> *Ankit Chaurasia*
> HomePage  |  LinkedIn
>  |  +91-9987351649
> 
> 
> 
> 
> 
> 
> On Wed, May 1, 2024 at 9:37 PM Amogh Desai  wrote:
> 
>> My vote goes to #38674. Awesome work
>> 
>> Thanks & Regards,
>> Amogh Desai
>> 
>> 
>> On Wed, 1 May 2024 at 9:21 PM, Jed Cunningham 
>> wrote:
>> 
>>> I'll also vote for 38674 - cool stuff!
>>> 
>> 


-
To unsubscribe, e-mail: dev-unsubscr...@airflow.apache.org
For additional commands, e-mail: dev-h...@airflow.apache.org

Re: [VOTE] Airflow Providers prepared on May 01, 2024

2024-05-01 Thread Vincent Beck 
+1 non binding. All AWS system tests are working successfully against 
apache-airflow-providers-amazon==8.21.0rc1. You can see the results here: 
https://aws-mwaa.github.io/#/open-source/system-tests/version/fe4605a10e26f1b8a180979ba5765d1cb7fb0111_8.21.0rc1.html.
 The only failure (example_bedrock) is a known issue in the test itself and is 
currently being worked on.

On 2024/05/01 13:03:07 Elad Kalif wrote:
> Hey all,
> 
> I have just cut the new wave Airflow Providers packages. This email is
> calling a vote on the release,
> which will last for 72 hours - which means that it will end on May 04, 2024
> 13:00 PM UTC and until 3 binding +1 votes have been received.
> 
> 
> Consider this my (binding) +1.
> 
> *Note some of the providers are rc2 and some rc1.*
> 
> Airflow Providers are available at:
> https://dist.apache.org/repos/dist/dev/airflow/providers/
> 
> *apache-airflow-providers--*.tar.gz* are the binary
>  Python "sdist" release - they are also official "sources" for the provider
> packages.
> 
> *apache_airflow_providers_-*.whl are the binary
>  Python "wheel" release.
> 
> The test procedure for PMC members is described in
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-the-release-candidate-by-pmc-members
> 
> The test procedure for and Contributors who would like to test this RC is
> described in:
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-the-release-candidate-by-contributors
> 
> 
> Public keys are available at:
> https://dist.apache.org/repos/dist/release/airflow/KEYS
> 
> Please vote accordingly:
> 
> [ ] +1 approve
> [ ] +0 no opinion
> [ ] -1 disapprove with the reason
> 
> Only votes from PMC members are binding, but members of the community are
> encouraged to test the release and vote with "(non-binding)".
> 
> Please note that the version number excludes the 'rcX' string.
> This will allow us to rename the artifact without modifying
> the artifact checksums when we actually release.
> 
> The status of testing the providers by the community is kept here:
> https://github.com/apache/airflow/issues/39346
> 
> The issue is also the easiest way to see important PRs included in the RC
> candidates.
> Detailed changelog for the providers will be published in the documentation
> after the
> RC candidates are released.
> 
> You can find the RC packages in PyPI following these links:
> 
> https://pypi.org/project/apache-airflow-providers-airbyte/3.8.0rc1/
> https://pypi.org/project/apache-airflow-providers-alibaba/2.8.0rc1/
> https://pypi.org/project/apache-airflow-providers-amazon/8.21.0rc1/
> https://pypi.org/project/apache-airflow-providers-apache-beam/5.7.0rc1/
> https://pypi.org/project/apache-airflow-providers-apache-cassandra/3.5.0rc1/
> https://pypi.org/project/apache-airflow-providers-apache-drill/2.7.0rc1/
> https://pypi.org/project/apache-airflow-providers-apache-druid/3.10.0rc1/
> https://pypi.org/project/apache-airflow-providers-apache-flink/1.4.0rc1/
> https://pypi.org/project/apache-airflow-providers-apache-hdfs/4.4.0rc2/
> https://pypi.org/project/apache-airflow-providers-apache-hive/8.1.0rc1/
> https://pypi.org/project/apache-airflow-providers-apache-impala/1.4.0rc1/
> https://pypi.org/project/apache-airflow-providers-apache-kafka/1.4.0rc2/
> https://pypi.org/project/apache-airflow-providers-apache-kylin/3.6.0rc2/
> https://pypi.org/project/apache-airflow-providers-apache-livy/3.8.0rc1/
> https://pypi.org/project/apache-airflow-providers-apache-pig/4.4.0rc2/
> https://pypi.org/project/apache-airflow-providers-apache-pinot/4.4.0rc2/
> https://pypi.org/project/apache-airflow-providers-apache-spark/4.8.0rc2/
> https://pypi.org/project/apache-airflow-providers-apprise/1.3.0rc2/
> https://pypi.org/project/apache-airflow-providers-arangodb/2.5.0rc1/
> https://pypi.org/project/apache-airflow-providers-asana/2.5.0rc1/
> https://pypi.org/project/apache-airflow-providers-atlassian-jira/2.6.0rc2/
> https://pypi.org/project/apache-airflow-providers-celery/3.7.0rc1/
> https://pypi.org/project/apache-airflow-providers-cloudant/3.5.0rc2/
> https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.2.0rc1/
> https://pypi.org/project/apache-airflow-providers-cohere/1.2.0rc2/
> https://pypi.org/project/apache-airflow-providers-common-sql/1.13.0rc1/
> https://pypi.org/project/apache-airflow-providers-databricks/6.4.0rc1/
> https://pypi.org/project/apache-airflow-providers-datadog/3.6.0rc1/
> https://pypi.org/project/apache-airflow-providers-dbt-cloud/3.8.0rc1/
> https://pypi.org/project/apache-airflow-providers-dingding/3.5.0rc1/
> https://pypi.org/project/apache-airflow-providers-discord/3.7.0rc1/
> https://pypi.org/project/apache-airflow-providers-docker/3.11.0rc1/
> https://pypi.org/project/apache-airflow-providers-elasticsearch/5.4.0rc2/
> https://pypi.org/project/apache-airflow-providers-exasol/4.5.0rc1/
> https://pypi.org/project/apache-airflow-providers-fab/1.1.0rc1/
> https://pypi.o

RE: [VOTE] Release Airflow 2.9.1 from 2.9.1rc1

2024-05-01 Thread Scheffler Jens (XC-AS/EAE-ADA-T) 
+1 (non binding) - tested 2.9.1rc1 and works great, especially the UI glitches 
are removed.

Mit freundlichen Grüßen / Best regards

Jens Scheffler

Alliance: Enabler - Tech Lead (XC-AS/EAE-ADA-T)
Robert Bosch GmbH | Hessbruehlstraße 21 | 70565 Stuttgart-Vaihingen | GERMANY | 
http://www.bosch.com/
Tel. +49 711 811-91508 | Mobil +49 160 90417410 | jens.scheff...@de.bosch.com

Sitz: Stuttgart, Registergericht: Amtsgericht Stuttgart, HRB 14000;
Aufsichtsratsvorsitzender: Prof. Dr. Stefan Asenkerschbaumer;
Geschäftsführung: Dr. Stefan Hartung, Dr. Christian Fischer, Dr. Markus 
Forschner,
Stefan Grosch, Dr. Markus Heyn, Dr. Frank Meyer, Dr. Tanja Rückert

-Original Message-
From: Ephraim Anierobi 
Sent: Tuesday, April 30, 2024 1:04 PM
To: dev@airflow.apache.org
Subject: [VOTE] Release Airflow 2.9.1 from 2.9.1rc1

Hey fellow Airflowers,

I have cut Airflow 2.9.1rc1. This email is calling a vote on the release, which 
will last at least 72 hours, from Tuesday, April 30, 2024 at 11:00 am UTC until 
Friday, May 3, 2024, at 11:00 am UTC 
,
and until 3 binding +1 votes have been received.

The status of testing of the release is kept at
https://github.com/apache/airflow/issues/39326

Consider this my (binding) +1.

Airflow 2.9.1rc1 is available at:
https://dist.apache.org/repos/dist/dev/airflow/2.9.1rc1/

*apache-airflow-2.9.1-source.tar.gz* is a source release that comes with 
INSTALL instructions.
*apache-airflow-2.9.1.tar.gz* is the binary Python "sdist" release.
*apache_airflow-2.9.1-py3-none-any.whl* is the binary Python wheel "binary"
release.

Public keys are available at:
https://dist.apache.org/repos/dist/release/airflow/KEYS

Please vote accordingly:

[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove with the reason

Only votes from PMC members are binding, but all members of the community are 
encouraged to test the release and vote with "(non-binding)".

The test procedure for PMC members is described in:
https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md/#verify-the-release-candidate-by-pmc-members

The test procedure for contributors and members of the community who would like 
to test this RC is described in:
https://github.com/apache/airflow/blob/main/dev/README_RELEASE_AIRFLOW.md/#verify-the-release-candidate-by-contributors


Please note that the version number excludes the `rcX` string, so it's now 
simply 2.9.1. This will allow us to rename the artifact without modifying the 
artifact checksums when we actually release.

Release Notes:
https://github.com/apache/airflow/blob/2.9.1rc1/RELEASE_NOTES.rst

For information on what goes into a release please see:
https://github.com/apache/airflow/blob/main/dev/WHAT_GOES_INTO_THE_NEXT_RELEASE.md

Changes since 2.9.0:

*Significant Changes*

*Stackdriver logging bugfix requires Google provider ``10.17.0`` or later
(#38071)*

If you use Stackdriver logging, you must use Google provider version 
``10.17.0`` or later. Airflow ``2.9.1`` now passes ``gcp_log_name`` to the 
``StackdriverTaskHandler`` instead of ``name``, and this will fail on earlier 
provider versions.

This fixes a bug where the log name configured in ``[logging] 
remove_base_log_folder`` was overridden when Airflow configured logging, 
resulting in task logs going to the wrong destination.

*Bug Fixes*
- Make task log messages include run_id (#39280)
- Copy menu_item ``href`` for nav bar (#39282)
- Fix trigger kwarg encryption migration (#39246)
- Add workaround for datetime-local input in ``firefox`` (#39261)
- Add Grid button to Task Instance view (#39223)
- Get served logs when remote or executor logs not available for non-running 
task try (#39177)
- Fixed side effect of menu filtering causing disappearing menus (#39229)
- Use grid view for Task Instance's ``log_url`` (#39183)
- Improve task filtering ``UX`` (#39119)
- Improve rendered_template ``ux`` in react dag page (#39122)
- Graph view improvements (#38940)
- Check that the dataset<>task exists before trying to render graph (#39069)
- Hostname was "redacted", not "redact"; remove it when there is no context
(#39037)
- Check whether ``AUTH_ROLE_PUBLIC`` is set in ``check_authentication``
(#39012)
- Move rendering of ``map_index_template`` so it renders for failed tasks as 
long as it was defined before the point of failure (#38902)
- ``Undeprecate`` ``BaseXCom.get_one`` method for now (#38991)
- Add ``inherit_cache`` attribute for ``CreateTableAs`` custom SA Clause
(#38985)
- Don't wait for DagRun lock in mini scheduler (#38914)
- Fix calendar view with no DAG Run (#38964)
- Changed the background color of external task in graph (#38969)
- Fix dag run selection (#38941)
- Fix ``SAWarning`` 'Coercing Subquery object into a select() for use in IN()' 
(#38926)
- Fix implicit ``cartesian`` product in AirflowSecurityManagerV2 (#38913)
- Fix problem that links in legacy log view can not be clicked (#38882)
- Fix dag run

Re: [VOTE] Release Apache Airflow Python Client 2.9.0 from 2.9.0rc1

2024-05-01 Thread Hussein Awala 
+1 (binding)

On Wednesday, May 1, 2024, Kaxil Naik  wrote:

> +1 binding
>
> On Mon, 29 Apr 2024 at 05:14, Amogh Desai 
> wrote:
>
> > +1 non binding
> >
> > Installed the RC with breeze and was able to test some basic
> > functionalities of the client
> > like listing DAGs, getting tasks, creating DAGruns, retrieving
> > configuration, mainly through test_python_client.py.
> >
> > Looks good to me.
> >
> > Thanks & Regards,
> > Amogh Desai
> >
> >
> > On Tue, Apr 23, 2024 at 6:03 PM Pankaj Koti
> >  wrote:
> >
> > > +1 (non-binding)
> > >
> > > Tested the RC client to do some basic functionalities like get DAGs,
> > tasks
> > > for a DAG,
> > > trigger a DAG, get Airflow configuration. Everything went well!
> > >
> > > Best regards,
> > >
> > > *Pankaj Koti*
> > > Senior Software Engineer (Airflow OSS Engineering team)
> > > Location: Pune, Maharashtra, India
> > > Timezone: Indian Standard Time (IST)
> > >
> > >
> > > On Tue, Apr 23, 2024 at 5:39 PM Jarek Potiuk  wrote:
> > >
> > > > +1 (binding): tested reproducibility, signatures, checksums, licences
> > > (code
> > > > is autogenerated), run some basic tests with Airflow 2.9.0 with the
> RC1
> > > > client
> > > >
> > > > On Tue, Apr 23, 2024 at 1:05 AM Jed Cunningham <
> > jedcunning...@apache.org
> > > >
> > > > wrote:
> > > >
> > > > > Hey fellow Airflowers,
> > > > >
> > > > > I have cut the first release candidate for the Apache Airflow
> Python
> > > > Client
> > > > > 2.9.0.
> > > > > This email is calling for a vote on the release,
> > > > > which will last for 72 hours. Consider this my (binding) +1.
> > > > >
> > > > > Airflow Client 2.9.0rc1 is available at:
> > > > >
> > > https://dist.apache.org/repos/dist/dev/airflow/clients/
> python/2.9.0rc1/
> > > > >
> > > > > The apache_airflow_client-2.9.0.tar.gz is an sdist release that
> > > contains
> > > > > INSTALL instructions, and also is the official source release.
> > > > >
> > > > > The apache_airflow_client-2.9.0-py3-none-any.whl is a binary wheel
> > > > release
> > > > > that pip can install.
> > > > >
> > > > > Those packages do not contain .rc* version as, when approved, they
> > will
> > > > be
> > > > > released as the final version.
> > > > >
> > > > > The rc packages are also available at PyPI (with rc suffix) and you
> > can
> > > > > install it with pip as usual:
> > > > > https://pypi.org/project/apache-airflow-client/2.9.0rc1/
> > > > >
> > > > > Public keys are available at:
> > > > > https://dist.apache.org/repos/dist/release/airflow/KEYS
> > > > >
> > > > > Only votes from PMC members are binding, but all members of the
> > > community
> > > > > are encouraged to test the release and vote with "(non-binding)".
> > > > >
> > > > > The test procedure for PMC members is described in:
> > > > >
> > > > >
> > > >
> > >
> > https://github.com/apache/airflow/blob/main/dev/README_
> RELEASE_PYTHON_CLIENT.md#verify-the-release-candidate-by-pmc-members
> > > > >
> > > > > The test procedure for contributors and members of the community
> who
> > > > would
> > > > > like to test this RC is described in:
> > > > >
> > > > >
> > > >
> > >
> > https://github.com/apache/airflow/blob/main/dev/README_
> RELEASE_PYTHON_CLIENT.md#verify-the-release-candidate-by-contributors
> > > > >
> > > > > *Changelog:*
> > > > >
> > > > > *Major changes:*
> > > > >
> > > > > - Allow users to write dag_id and task_id in their national
> > characters,
> > > > > added display name for dag / task (v2) (#38446)
> > > > > - Add dataset_expression to grid dag details (#38121)
> > > > > - Adding run_id column to log table (#37731)
> > > > > - Show custom instance names for a mapped task in UI (#36797)
> > > > > - Add excluded/included events to get_event_logs api (#37641)
> > > > > - Filter Datasets by associated dag_ids (GET /datasets) (#37512)
> > > > > - Add data_interval_start and data_interval_end in dagrun create
> API
> > > > > endpoint (#36630)
> > > > > - Return the specified field when get dag/dagRun (#36641)
> > > > >
> > > > > *New API supported:*
> > > > >
> > > > > - Add post endpoint for dataset events (#37570)
> > > > > - Add "queuedEvent" endpoint to get/delete DatasetDagRunQueue
> > (#37176)
> > > > >
> > > > > Thanks,
> > > > > Jed
> > > > >
> > > >
> > >
> >
>

Re: [VOTE] Release Apache Airflow Python Client 2.9.0 from 2.9.0rc1

2024-05-01 Thread Kaxil Naik 
+1 binding

On Mon, 29 Apr 2024 at 05:14, Amogh Desai  wrote:

> +1 non binding
>
> Installed the RC with breeze and was able to test some basic
> functionalities of the client
> like listing DAGs, getting tasks, creating DAGruns, retrieving
> configuration, mainly through test_python_client.py.
>
> Looks good to me.
>
> Thanks & Regards,
> Amogh Desai
>
>
> On Tue, Apr 23, 2024 at 6:03 PM Pankaj Koti
>  wrote:
>
> > +1 (non-binding)
> >
> > Tested the RC client to do some basic functionalities like get DAGs,
> tasks
> > for a DAG,
> > trigger a DAG, get Airflow configuration. Everything went well!
> >
> > Best regards,
> >
> > *Pankaj Koti*
> > Senior Software Engineer (Airflow OSS Engineering team)
> > Location: Pune, Maharashtra, India
> > Timezone: Indian Standard Time (IST)
> >
> >
> > On Tue, Apr 23, 2024 at 5:39 PM Jarek Potiuk  wrote:
> >
> > > +1 (binding): tested reproducibility, signatures, checksums, licences
> > (code
> > > is autogenerated), run some basic tests with Airflow 2.9.0 with the RC1
> > > client
> > >
> > > On Tue, Apr 23, 2024 at 1:05 AM Jed Cunningham <
> jedcunning...@apache.org
> > >
> > > wrote:
> > >
> > > > Hey fellow Airflowers,
> > > >
> > > > I have cut the first release candidate for the Apache Airflow Python
> > > Client
> > > > 2.9.0.
> > > > This email is calling for a vote on the release,
> > > > which will last for 72 hours. Consider this my (binding) +1.
> > > >
> > > > Airflow Client 2.9.0rc1 is available at:
> > > >
> > https://dist.apache.org/repos/dist/dev/airflow/clients/python/2.9.0rc1/
> > > >
> > > > The apache_airflow_client-2.9.0.tar.gz is an sdist release that
> > contains
> > > > INSTALL instructions, and also is the official source release.
> > > >
> > > > The apache_airflow_client-2.9.0-py3-none-any.whl is a binary wheel
> > > release
> > > > that pip can install.
> > > >
> > > > Those packages do not contain .rc* version as, when approved, they
> will
> > > be
> > > > released as the final version.
> > > >
> > > > The rc packages are also available at PyPI (with rc suffix) and you
> can
> > > > install it with pip as usual:
> > > > https://pypi.org/project/apache-airflow-client/2.9.0rc1/
> > > >
> > > > Public keys are available at:
> > > > https://dist.apache.org/repos/dist/release/airflow/KEYS
> > > >
> > > > Only votes from PMC members are binding, but all members of the
> > community
> > > > are encouraged to test the release and vote with "(non-binding)".
> > > >
> > > > The test procedure for PMC members is described in:
> > > >
> > > >
> > >
> >
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PYTHON_CLIENT.md#verify-the-release-candidate-by-pmc-members
> > > >
> > > > The test procedure for contributors and members of the community who
> > > would
> > > > like to test this RC is described in:
> > > >
> > > >
> > >
> >
> https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PYTHON_CLIENT.md#verify-the-release-candidate-by-contributors
> > > >
> > > > *Changelog:*
> > > >
> > > > *Major changes:*
> > > >
> > > > - Allow users to write dag_id and task_id in their national
> characters,
> > > > added display name for dag / task (v2) (#38446)
> > > > - Add dataset_expression to grid dag details (#38121)
> > > > - Adding run_id column to log table (#37731)
> > > > - Show custom instance names for a mapped task in UI (#36797)
> > > > - Add excluded/included events to get_event_logs api (#37641)
> > > > - Filter Datasets by associated dag_ids (GET /datasets) (#37512)
> > > > - Add data_interval_start and data_interval_end in dagrun create API
> > > > endpoint (#36630)
> > > > - Return the specified field when get dag/dagRun (#36641)
> > > >
> > > > *New API supported:*
> > > >
> > > > - Add post endpoint for dataset events (#37570)
> > > > - Add "queuedEvent" endpoint to get/delete DatasetDagRunQueue
> (#37176)
> > > >
> > > > Thanks,
> > > > Jed
> > > >
> > >
> >
>

[ANNOUNCE] Apache Airflow Newsletter April 2024

2024-05-01 Thread Briana Okyere 
Hey All,

The April Issue of the Apache Airflow Newsletter is out! Please read it
here 

Or subscribe here to get it directly in your inbox <
https://apache.us14.list-manage.com/subscribe?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa
>

-- 
Briana Okyere
Community Manager
Astronomer

Re: [VOTE] April 2024 PR of the Month

2024-05-01 Thread Ankit Chaurasia 
My vote goes to #38674 .
Awesome work Wei!

Ankit Chaurasia







*Ankit Chaurasia*
HomePage  |  LinkedIn
 |  +91-9987351649






On Wed, May 1, 2024 at 9:37 PM Amogh Desai  wrote:

> My vote goes to #38674. Awesome work
>
> Thanks & Regards,
> Amogh Desai
>
>
> On Wed, 1 May 2024 at 9:21 PM, Jed Cunningham 
> wrote:
>
> > I'll also vote for 38674 - cool stuff!
> >
>

Re: [VOTE] April 2024 PR of the Month

2024-05-01 Thread Amogh Desai 
My vote goes to #38674. Awesome work

Thanks & Regards,
Amogh Desai


On Wed, 1 May 2024 at 9:21 PM, Jed Cunningham 
wrote:

> I'll also vote for 38674 - cool stuff!
>

Re: [VOTE] April 2024 PR of the Month

2024-05-01 Thread Jed Cunningham 
I'll also vote for 38674 - cool stuff!

Re: [VOTE] April 2024 PR of the Month

2024-05-01 Thread Kenten Danas 
I'll vote for #38674

On Wed, May 1, 2024 at 8:24 AM Briana Okyere
 wrote:

> We have 2 votes for 2 different PRs- anyone want to be the tie breaker?
>
> On Tue, Apr 30, 2024 at 4:26 PM Hussein Awala  wrote:
>
> > +1 for #38531
> >
> > On Wednesday, May 1, 2024, Kaxil Naik  wrote:
> >
> > > I would vote for Allowing tasks to start execution directly from
> > triggerer
> > > without going to worker (#38674)
> > > 
> > >
> > > On Tue, 30 Apr 2024 at 19:38, Briana Okyere
> > >  wrote:
> > >
> > > > Just a friendly reminder that voting closes today! Since we have not
> > > > received any votes, I will extend it to 5pm PST today, April 30th.
> > > >
> > > > On Thu, Apr 25, 2024 at 1:03 PM Briana Okyere <
> > > briana.oky...@astronomer.io
> > > > >
> > > > wrote:
> > > >
> > > > > Hey All,
> > > > >
> > > > > It’s once again time to vote for the PR of the Month!
> > > > >
> > > > > With the help of the `get_important_pr_candidates` script in
> > dev/stats,
> > > > > we've identified the following candidates:
> > > > >
> > > > > PR #37693: Add the deferrable mode to the Dataflow sensors <
> > > > > https://github.com/apache/airflow/pull/37693>
> > > > >
> > > > > PR #34457: heartbeat recovery message <
> > > > > https://github.com/apache/airflow/pull/34457>
> > > > >
> > > > > PR #38693: Amazon Bedrock - Model Customization Jobs <
> > > > > https://github.com/apache/airflow/pull/38693>
> > > > >
> > > > > PR #38531: Replace dill package to use cloudpickle
> > > > > 
> > > > >
> > > > > PR #38514: Implement start/end/debug for multiple executors in
> > > scheduler
> > > > > job 
> > > > >
> > > > > Please reply to this thread with your selection or offer your own
> > > > > nominee(s).
> > > > >
> > > > > Voting will close on Tuesday, April 30th at 10 AM PST. The
> winner(s)
> > > will
> > > > > be featured in the next issue of the Airflow newsletter.
> > > > >
> > > > > Also, if there’s an article or event that you think should be
> > included
> > > in
> > > > > this or a future issue of the newsletter, please drop me a line at
> <
> > > > > briana.oky...@astronomer.io>
> > > > >
> > > > > --
> > > > > Briana Okyere
> > > > > Community Manager
> > > > > Astronomer
> > > > >
> > > >
> > >
> >
>

Re: [VOTE] April 2024 PR of the Month

2024-05-01 Thread Briana Okyere 
We have 2 votes for 2 different PRs- anyone want to be the tie breaker?

On Tue, Apr 30, 2024 at 4:26 PM Hussein Awala  wrote:

> +1 for #38531
>
> On Wednesday, May 1, 2024, Kaxil Naik  wrote:
>
> > I would vote for Allowing tasks to start execution directly from
> triggerer
> > without going to worker (#38674)
> > 
> >
> > On Tue, 30 Apr 2024 at 19:38, Briana Okyere
> >  wrote:
> >
> > > Just a friendly reminder that voting closes today! Since we have not
> > > received any votes, I will extend it to 5pm PST today, April 30th.
> > >
> > > On Thu, Apr 25, 2024 at 1:03 PM Briana Okyere <
> > briana.oky...@astronomer.io
> > > >
> > > wrote:
> > >
> > > > Hey All,
> > > >
> > > > It’s once again time to vote for the PR of the Month!
> > > >
> > > > With the help of the `get_important_pr_candidates` script in
> dev/stats,
> > > > we've identified the following candidates:
> > > >
> > > > PR #37693: Add the deferrable mode to the Dataflow sensors <
> > > > https://github.com/apache/airflow/pull/37693>
> > > >
> > > > PR #34457: heartbeat recovery message <
> > > > https://github.com/apache/airflow/pull/34457>
> > > >
> > > > PR #38693: Amazon Bedrock - Model Customization Jobs <
> > > > https://github.com/apache/airflow/pull/38693>
> > > >
> > > > PR #38531: Replace dill package to use cloudpickle
> > > > 
> > > >
> > > > PR #38514: Implement start/end/debug for multiple executors in
> > scheduler
> > > > job 
> > > >
> > > > Please reply to this thread with your selection or offer your own
> > > > nominee(s).
> > > >
> > > > Voting will close on Tuesday, April 30th at 10 AM PST. The winner(s)
> > will
> > > > be featured in the next issue of the Airflow newsletter.
> > > >
> > > > Also, if there’s an article or event that you think should be
> included
> > in
> > > > this or a future issue of the newsletter, please drop me a line at <
> > > > briana.oky...@astronomer.io>
> > > >
> > > > --
> > > > Briana Okyere
> > > > Community Manager
> > > > Astronomer
> > > >
> > >
> >
>

[VOTE] Airflow Providers prepared on May 01, 2024

2024-05-01 Thread Elad Kalif 
Hey all,

I have just cut the new wave Airflow Providers packages. This email is
calling a vote on the release,
which will last for 72 hours - which means that it will end on May 04, 2024
13:00 PM UTC and until 3 binding +1 votes have been received.


Consider this my (binding) +1.

*Note some of the providers are rc2 and some rc1.*

Airflow Providers are available at:
https://dist.apache.org/repos/dist/dev/airflow/providers/

*apache-airflow-providers--*.tar.gz* are the binary
 Python "sdist" release - they are also official "sources" for the provider
packages.

*apache_airflow_providers_-*.whl are the binary
 Python "wheel" release.

The test procedure for PMC members is described in
https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-the-release-candidate-by-pmc-members

The test procedure for and Contributors who would like to test this RC is
described in:
https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md#verify-the-release-candidate-by-contributors


Public keys are available at:
https://dist.apache.org/repos/dist/release/airflow/KEYS

Please vote accordingly:

[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove with the reason

Only votes from PMC members are binding, but members of the community are
encouraged to test the release and vote with "(non-binding)".

Please note that the version number excludes the 'rcX' string.
This will allow us to rename the artifact without modifying
the artifact checksums when we actually release.

The status of testing the providers by the community is kept here:
https://github.com/apache/airflow/issues/39346

The issue is also the easiest way to see important PRs included in the RC
candidates.
Detailed changelog for the providers will be published in the documentation
after the
RC candidates are released.

You can find the RC packages in PyPI following these links:

https://pypi.org/project/apache-airflow-providers-airbyte/3.8.0rc1/
https://pypi.org/project/apache-airflow-providers-alibaba/2.8.0rc1/
https://pypi.org/project/apache-airflow-providers-amazon/8.21.0rc1/
https://pypi.org/project/apache-airflow-providers-apache-beam/5.7.0rc1/
https://pypi.org/project/apache-airflow-providers-apache-cassandra/3.5.0rc1/
https://pypi.org/project/apache-airflow-providers-apache-drill/2.7.0rc1/
https://pypi.org/project/apache-airflow-providers-apache-druid/3.10.0rc1/
https://pypi.org/project/apache-airflow-providers-apache-flink/1.4.0rc1/
https://pypi.org/project/apache-airflow-providers-apache-hdfs/4.4.0rc2/
https://pypi.org/project/apache-airflow-providers-apache-hive/8.1.0rc1/
https://pypi.org/project/apache-airflow-providers-apache-impala/1.4.0rc1/
https://pypi.org/project/apache-airflow-providers-apache-kafka/1.4.0rc2/
https://pypi.org/project/apache-airflow-providers-apache-kylin/3.6.0rc2/
https://pypi.org/project/apache-airflow-providers-apache-livy/3.8.0rc1/
https://pypi.org/project/apache-airflow-providers-apache-pig/4.4.0rc2/
https://pypi.org/project/apache-airflow-providers-apache-pinot/4.4.0rc2/
https://pypi.org/project/apache-airflow-providers-apache-spark/4.8.0rc2/
https://pypi.org/project/apache-airflow-providers-apprise/1.3.0rc2/
https://pypi.org/project/apache-airflow-providers-arangodb/2.5.0rc1/
https://pypi.org/project/apache-airflow-providers-asana/2.5.0rc1/
https://pypi.org/project/apache-airflow-providers-atlassian-jira/2.6.0rc2/
https://pypi.org/project/apache-airflow-providers-celery/3.7.0rc1/
https://pypi.org/project/apache-airflow-providers-cloudant/3.5.0rc2/
https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.2.0rc1/
https://pypi.org/project/apache-airflow-providers-cohere/1.2.0rc2/
https://pypi.org/project/apache-airflow-providers-common-sql/1.13.0rc1/
https://pypi.org/project/apache-airflow-providers-databricks/6.4.0rc1/
https://pypi.org/project/apache-airflow-providers-datadog/3.6.0rc1/
https://pypi.org/project/apache-airflow-providers-dbt-cloud/3.8.0rc1/
https://pypi.org/project/apache-airflow-providers-dingding/3.5.0rc1/
https://pypi.org/project/apache-airflow-providers-discord/3.7.0rc1/
https://pypi.org/project/apache-airflow-providers-docker/3.11.0rc1/
https://pypi.org/project/apache-airflow-providers-elasticsearch/5.4.0rc2/
https://pypi.org/project/apache-airflow-providers-exasol/4.5.0rc1/
https://pypi.org/project/apache-airflow-providers-fab/1.1.0rc1/
https://pypi.org/project/apache-airflow-providers-facebook/3.5.0rc2/
https://pypi.org/project/apache-airflow-providers-ftp/3.9.0rc1/
https://pypi.org/project/apache-airflow-providers-github/2.6.0rc1/
https://pypi.org/project/apache-airflow-providers-google/10.18.0rc1/
https://pypi.org/project/apache-airflow-providers-grpc/3.5.0rc2/
https://pypi.org/project/apache-airflow-providers-hashicorp/3.7.0rc2/
https://pypi.org/project/apache-airflow-providers-http/4.11.0rc1/
https://pypi.org/project/apache-airflow-providers-imap/3.6.0rc2/
https://pypi.org/project/apache-airflow-providers-influxdb/2.5.0rc1/
https://py