Re: Starting a CI/CD knowledge transfer process

2024-09-15 Thread Elad Kalif
It was a great meeting. Thabk you for setting it Jarek בתאריך שבת, 14 בספט׳ 2024, 01:34, מאת Jarek Potiuk ‏: > Hey here, > > Following a discussion on dev calls we had - we have started a bit "wider" > knowledge transfer for our CI/CD work. That was possible through using > targeted sponsorship A

[ANNOUNCE] Apache Airflow Providers prepared on August 25, 2024 are released

2024-08-28 Thread Elad Kalif
s-ssh/3.13.1/ https://pypi.org/project/apache-airflow-providers-tabular/1.6.1/ Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of August 25, 2024

2024-08-28 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on August 25, 2024 have been accepted. Provider openlineage is excluded from this release. 3 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Hussein Awala Vote thread: https://lists.apache.org/thread/p6zn4ghvzdl4sx25qvtszgm0gmpr

[VOTE] Airflow Providers prepared on August 25, 2024

2024-08-25 Thread Elad Kalif
-providers-openlineage/1.11.0rc2/ https://pypi.org/project/apache-airflow-providers-ssh/3.13.1rc1/ https://pypi.org/project/apache-airflow-providers-tabular/1.6.1rc1/ Cheers, Elad Kalif

[ANNOUNCE] Apache Airflow Providers prepared on August 19, 2024 are released

2024-08-22 Thread Elad Kalif
iders-zendesk/4.8.0/ Cheers, Elad Kalif

Re: [RESULT][VOTE] Airflow Providers - release of August 19, 2024

2024-08-22 Thread Elad Kalif
Yes sorry here is the updated count: 4 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Ash Berlin-Taylor - Hussein Awala 4 "+1" non binding votes received: - Vincent Beck - Freddy Demiane - Amogh Desai - Rahul Vats On Thu, Aug 22, 2024 at 1:17 PM Amogh Desai

[RESULT][VOTE] Airflow Providers - release of August 19, 2024

2024-08-22 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on August 19, 2024 have been accepted. Provider openlineage is excluded from this release. 4 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Ash Berlin-Taylor - Hussein Awala 3 "+1" binding votes received: - Vincent B

Re: [VOTE] New Provider for Core operators/sensor

2024-08-20 Thread Elad Kalif
t;core-add-on" option. It > > > gives the feeling that it's a provider that complements the > > > core(apache-airflow-providers-core-add-on). > > > > > > - 1 under common > > > > > > On Mon, 19 Aug 2024 at 22:12, Elad Kalif wrote: > >

Re: [VOTE] Airflow Providers prepared on August 19, 2024

2024-08-19 Thread Elad Kalif
checked all the changes of mine (mostly dependency upgrades). > > > > On Mon, Aug 19, 2024 at 10:18 AM Elad Kalif wrote: > > > > > Hey all, > > > > > > I have just cut the new wave Airflow Providers packages. This email is > > > calling a vote

Re: [VOTE] New Provider for Core operators/sensor

2024-08-19 Thread Elad Kalif
have chosen the "core-add-on" option. It > gives the feeling that it's a provider that complements the > core(apache-airflow-providers-core-add-on). > > - 1 under common > > On Mon, 19 Aug 2024 at 22:12, Elad Kalif wrote: > > > Hussein I believe

Re: [DISCUSS] Airflow 2.11 as bridge release

2024-08-19 Thread Elad Kalif
+ 1 but I think we should clarify the mental model of the 2.11 release. I wouldn't say it will have no features. If there are no features then why 2.11? it can just be 2.10.x I rather, we agree that it will have features which are relevant for the migration (for example: introduce new settings tha

Re: [VOTE] New Provider for Core operators/sensor

2024-08-19 Thread Elad Kalif
Hussein I believe the intent is that the provider comes as one unit with Airflow (it will be part of the pre-installed providers like: sqlite, http, ...) so in that spirit is essential. just to clarify PMC voting -1 is considered veto but the rule is applied to code change, I am not sure what it m

Re: [DISCUSS] New provider Common.time

2024-08-19 Thread Elad Kalif
; > > > > > But tbh I feel a “core provider” is different than “Airflow core” as > it > > > > will be a Provider I feel. Don’t have a strong opinion on it though — > > > > naming is hard > > > > > > > > On Fri, 16

[VOTE] Airflow Providers prepared on August 19, 2024

2024-08-19 Thread Elad Kalif
project/apache-airflow-providers-weaviate/2.1.0rc1/ https://pypi.org/project/apache-airflow-providers-yandex/3.12.0rc1/ https://pypi.org/project/apache-airflow-providers-ydb/1.3.0rc1/ https://pypi.org/project/apache-airflow-providers-zendesk/4.8.0rc1/ Cheers, Elad Kalif

Re: [DISCUSS] New provider Common.time

2024-08-16 Thread Elad Kalif
What about primary provider? בתאריך יום ו׳, 16 באוג׳ 2024, 16:49, מאת Jarek Potiuk ‏: > I also think "core" is not the best one as we are using "airflow core" as a > different meaning already (that's another example of Ash's "one thing > to mean in Airflow") . I still think "common.operators" wou

Re: [DISCUSS] New provider Common.time

2024-08-14 Thread Elad Kalif
Thanks for owning it Rom! +1 from me The common is needed because we have convention where the providers are packed under entity https://github.com/apache/airflow/tree/main/airflow/providers Common isnt new. We already have common.compat, common.io, common.sql Personally I don't mind about the n

Re: Tracking breaking changes for Airflow 3

2024-08-08 Thread Elad Kalif
Please try to have at least 2 approvals for each breaking change (when possible provide sufficient time for others to review as well). בתאריך יום ה׳, 8 באוג׳ 2024, 20:57, מאת Jed Cunningham ‏< jedcunning...@apache.org>: > Hello everyone, > > We ran out of time during the dev call today to discuss

Re: [RESULT][VOTE] Airflow Providers - release of August 03, 2024

2024-08-06 Thread Elad Kalif
were excluded this time :) > > J. > > > On Tue, Aug 6, 2024 at 10:22 PM Elad Kalif wrote: > > > Hello, > > > > Apache Airflow Providers prepared on August 03, 2024 have been accepted. > > providers amazon and google are excluded from this release. > >

[ANNOUNCE] Apache Airflow Providers prepared on August 03, 2024 are released

2024-08-06 Thread Elad Kalif
rflow-providers-sqlite/3.8.2/ https://pypi.org/project/apache-airflow-providers-ssh/3.12.0/ https://pypi.org/project/apache-airflow-providers-teradata/2.5.0/ https://pypi.org/project/apache-airflow-providers-ydb/1.2.0/ Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of August 03, 2024

2024-08-06 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on August 03, 2024 have been accepted. providers amazon and google are excluded from this release. 4 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Jed Cunningham - Hussein Awala 3 "+1" binding votes received: - Utkarsh S

Re: [ANNOUNCE] New PMC member: Jens Schaffler

2024-08-06 Thread Elad Kalif
Congratulations Jens 🎉 Very well deserved! On Tue, Aug 6, 2024 at 7:26 PM Pavankumar Gopidesu wrote: > Congratulations jens 🎉🎉. > > Regards, > Pavan > > On Tue, Aug 6, 2024 at 5:14 PM Brent Bovenzi > wrote: > > > Congrats! The trigger form and UI improvements have been > > greatly appreciated.

[VOTE] Airflow Providers prepared on August 03, 2024

2024-08-03 Thread Elad Kalif
teradata/2.5.0rc1/ https://pypi.org/project/apache-airflow-providers-ydb/1.2.0rc1/ Cheers, Elad Kalif

Re: [VOTE] AIP-82 - External event driven scheduling in Airflow

2024-08-02 Thread Elad Kalif
+1 binding Great work! On Sat, Aug 3, 2024 at 7:15 AM Jed Cunningham wrote: > +1 binding >

Re: [VOTE] AIP-83 Remove Execution Date Unique Constraint from DAG Run

2024-08-02 Thread Elad Kalif
+1 binding On Fri, Aug 2, 2024 at 8:12 AM Phani Kumar wrote: > +1 binding > > On Fri, Aug 2, 2024 at 8:30 AM Wei Lee wrote: > > > +1 binding. > > > > Best, > > Wei > > > > > On Aug 2, 2024, at 5:06 AM, Vishnu Chilukoori < > vish.chiluko...@gmail.com> > > wrote: > > > > > > +1 non-binding > > >

Re: [VOTE] AIP-79 & AIP-84 Remove Flask AppBuilder as a Core Dependency & UI REST API

2024-08-02 Thread Elad Kalif
+1 binding I am not sure I agree with previous statements regarding the LDAP issue (specifically about blocker or not blocker for Airflow 3) but let's not discuss this here as it's out of scope for the AIPs we are voting here. On Fri, Aug 2, 2024 at 7:15 PM Vincent Beck wrote: > Big +1 to this

[ANNOUNCE] Apache Airflow Providers prepared on July 28, 2024 are released

2024-07-31 Thread Elad Kalif
kages. Full list of released PyPI packages: https://pypi.org/project/apache-airflow-providers-fab/1.2.2/ Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of July 28, 2024

2024-07-31 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on July 28, 2024 have been accepted. providers amazon and google are excluded from this release. 5 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Kaxil Naik - Jed Cunningham - Hussein Awala Vote thread: https://lists.apache.

Re: [VOTE] Airflow Providers prepared on July 28, 2024

2024-07-31 Thread Elad Kalif
> Could just add a 1-liner or a link to the comment of why we had to exclude Amazon & Google It requires also to release apache-airflow-providers-common-compat which was not included in this ad-hoc wave. On Wed, Jul 31, 2024 at 3:29 PM Hussein Awala wrote: > +1 (binding) ran a few testing dags

Re: [VOTE] Airflow Providers prepared on July 28, 2024

2024-07-29 Thread Elad Kalif
issue with 2.9.3 > (we will update the constraints for 2.9.3 and refresh the images once this > version is out, so future installation of Airflow 2.9.3 with > constraints/images will not have the logout issue. > > On Sun, Jul 28, 2024 at 12:52 PM Elad Kalif wrote: > > > Hey al

[VOTE] Airflow Providers prepared on July 28, 2024

2024-07-28 Thread Elad Kalif
d in the documentation after the RC candidates are released. You can find the RC packages in PyPI following these links: https://pypi.org/project/apache-airflow-providers-amazon/8.27.0rc1/ https://pypi.org/project/apache-airflow-providers-fab/1.2.2rc1/ https://pypi.org/project/apache-airflow-providers-google/10.21.1rc1/ Cheers, Elad Kalif

[ANNOUNCE] Apache Airflow Providers prepared on July 21, 2024 are released

2024-07-25 Thread Elad Kalif
kages. Full list of released PyPI packages: https://pypi.org/project/apache-airflow-providers-apache-spark/4.9.0/#description Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of July 21, 2024

2024-07-25 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on July 21, 2024 have been accepted. provider apache.beam is excluded from this release. 4 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Kaxil Naik - Hussein Awala Vote thread: https://lists.apache.

Re: [VOTE] Release Apache Airflow Python Client 2.9.3 from 2.9.3rc1

2024-07-24 Thread Elad Kalif
We can ignore + yank 2.9.3rc1 and cut 2.9.1rc1 Since the next airflow release is 2.10 which also includes features for the python client it means the next version for python client is 2.10.0 so we won't need 2.9.3rc1 in the future. On Wed, Jul 24, 2024 at 2:10 PM Jarek Potiuk wrote: > I think it

Re: [VOTE] AIP-66: DAG Bundles and Parsing

2024-07-24 Thread Elad Kalif
+1 binding On Wed, Jul 24, 2024 at 10:27 AM Ephraim Anierobi wrote: > +1 binding > > On Tue, 23 Jul 2024 at 23:02, Buğra Öztürk > wrote: > > > +1 non-binding > > > > On Tue, 23 Jul 2024, 23:26 Kaxil Naik, wrote: > > > > > +1 binding > > > > > > On Tue, 23 Jul 2024 at 22:05, Oliveira, Niko > >

Re: [VOTE] Airflow Providers prepared on July 21, 2024

2024-07-23 Thread Elad Kalif
apache beam is removed from this wave due to bug found On Wed, Jul 24, 2024 at 1:14 AM Jarek Potiuk wrote: > +1 (binding) - checked reproducibility, signatures, checksums, licences - > all looks good. > > On Sun, Jul 21, 2024 at 10:04 AM Elad Kalif wrote: > > > Hey all, &g

Re: [VOTE] Release Apache Airflow Helm Chart 1.15.0 based on 1.15.0rc1

2024-07-23 Thread Elad Kalif
+1 binding On Wed, Jul 24, 2024 at 1:33 AM Jarek Potiuk wrote: > +1 (binding): checked reproducibility, licences, signatures, checksums. I > run airflow locally using the chart - looks good with 2.9.3 being default. > All looks good. > > On Sun, Jul 21, 2024 at 5:16 AM Jed Cunningham > wrote: >

[VOTE] Airflow Providers prepared on July 21, 2024

2024-07-21 Thread Elad Kalif
d in the documentation after the RC candidates are released. You can find the RC packages in PyPI following these links: https://pypi.org/project/apache-airflow-providers-apache-beam/5.7.2rc1/ https://pypi.org/project/apache-airflow-providers-apache-spark/4.9.0rc1/ Cheers, Elad Kalif

[ANNOUNCE] New committers: Rom Sharon & Shahar Epstein

2024-07-15 Thread Elad Kalif
The Project Management Committee (PMC) for Apache Airflow has invited Rom Sharon & Shahar Epstein to become a committers and we are pleased to announce that they have accepted. Congratulations Rom & Shahar and welcome!

[ANNOUNCE] Apache Airflow Providers prepared on July 12, 2024 are released

2024-07-15 Thread Elad Kalif
kages. Full list of released PyPI packages: https://pypi.org/project/apache-airflow-providers-amazon/8.26.0/ https://pypi.org/project/apache-airflow-providers-weaviate/2.0.0/ Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of July 12, 2024

2024-07-15 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on July 12, 2024 have been accepted. providers amazon and weaviate are excluded from this release. 3 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Hussein Awala 3 "+1" non-binding votes received: - Vincent Beck - Rahul V

Re: [VOTE] Airflow Providers prepared on July 12, 2024

2024-07-12 Thread Elad Kalif
flow/blob/main/dev/README_RELEASE_PROVIDER_PACKAGES.md%5C#verify-the-release-candidate-by-contributors> On Fri, Jul 12, 2024 at 5:20 PM Elad Kalif wrote: > Hey all, > > I have just cut rc2 for Amazon and Weaviate Providers packages. This email > is calling a vote on the release, whic

[VOTE] Airflow Providers prepared on July 12, 2024

2024-07-12 Thread Elad Kalif
d in the documentation after the RC candidates are released. You can find the RC packages in PyPI following these links: https://pypi.org/project/apache-airflow-providers-amazon/8.26.0rc2/ https://pypi.org/project/apache-airflow-providers-weaviate/2.0.0rc2/ Cheers, Elad Kalif

[ANNOUNCE] Apache Airflow Providers prepared on July 09, 2024 are released

2024-07-12 Thread Elad Kalif
s-ydb/1.1.0/ Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of July 09, 2024

2024-07-12 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on July 09, 2024 have been accepted. providers amazon and weaviate are excluded from this release. 3 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Hussein Awala 4 "+1" non-binding votes received: - Wei Lee - Vincen

Re: [VOTE] Airflow Providers prepared on July 09, 2024

2024-07-12 Thread Elad Kalif
and > worked > > > fine. > > > > > > > > > > Best, > > > > > Wei > > > > > > > > > > > > > > > > On Jul 10, 2024, at 6:42 AM, Vincent Beck > > > wrote: > > > > > > > >

Re: [VOTE] AIP-72: Task Execution Interface aka Task SDK

2024-07-11 Thread Elad Kalif
+1 binding On Thu, Jul 11, 2024 at 5:50 PM Bishundeo, Rajeshwar wrote: > +1 non-binding > > -- Rajesh > > > > > > > On 2024-07-11, 9:57 AM, "Vincent Beck" vincb...@apache.org>> wrote: > > > CAUTION: This email originated from outside of the organization. Do not > click links or open attachment

Re: [PROPOSE] Agree and document Ad-hoc release process for providers

2024-07-10 Thread Elad Kalif
+1 for making the policy more clear but as for the involvement in the release process I have some concerns. I am not against it but we need to keep in mind that only the PMC have binding votes so it's not just about the release process it's also about respecting PMCs time. I think the root cause o

Re: [VOTE] Airflow Providers prepared on July 09, 2024

2024-07-09 Thread Elad Kalif
;>> a PR fixing it https://github.com/apache/airflow/pull/40663 but it > >>> does not affect the packagesand can be fixed directly by regenerating > >>> the docs without regenerating the package, so it does not affect > >>> voting status. > >>>

[VOTE] Airflow Providers prepared on July 09, 2024

2024-07-09 Thread Elad Kalif
ypi.org/project/apache-airflow-providers-snowflake/5.6.0rc1/ https://pypi.org/project/apache-airflow-providers-teradata/2.4.0rc1/ https://pypi.org/project/apache-airflow-providers-weaviate/2.0.0rc1/ https://pypi.org/project/apache-airflow-providers-ydb/1.1.0rc1/ Cheers, Elad Kalif

Re: [VOTE] Airflow Providers prepared on July 02, 2024 (openlineage rc2)

2024-07-04 Thread Elad Kalif
+1 binding On Thu, Jul 4, 2024 at 6:55 PM Jarek Potiuk wrote: > I need one more binding vote :) > > On Thu, Jul 4, 2024 at 5:37 PM Jed Cunningham > wrote: > > > +1. Signatures are good now. Thanks Jarek! > > >

Re: [ANNOUNCE] New committer: Ryan Hatter

2024-06-28 Thread Elad Kalif
Congrats! On Fri, Jun 28, 2024 at 9:17 PM Vikram Koka wrote: > Awesome! > Congratulations Ryan! > > On Fri, Jun 28, 2024 at 11:07 AM Pierre Jeambrun > wrote: > > > Well done Ryan :) > > > > Le ven. 28 juin 2024 à 19:42, Ferruzzi, Dennis > > > > > a écrit : > > > > > Hey, congrats! > > > > > >

[ANNOUNCE] Apache Airflow Providers prepared on June 22, 2024 are released

2024-06-27 Thread Elad Kalif
rflow-providers-vertica/3.8.2/ https://pypi.org/project/apache-airflow-providers-weaviate/1.4.2/ https://pypi.org/project/apache-airflow-providers-yandex/3.11.2/ https://pypi.org/project/apache-airflow-providers-ydb/1.0.0/ Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of June 22, 2024

2024-06-27 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on June 22, 2024 have been accepted. provider openlineage is be excluded from this release 4 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Hussein Awala - Ephraim Anierobi 7 "+1" non-binding votes received: - Amogh Des

Re: [VOTE] Airflow Providers prepared on June 22, 2024

2024-06-27 Thread Elad Kalif
t; > > > > > > > > Regards, > > > > > > > > Rahul Vats > > > > > > > > 9953794332 > > > > > > > > > > > > > > > > > > > > > > > > On Mon, 24 Jun 2024 at 09:4

[VOTE] Airflow Providers prepared on June 22, 2024

2024-06-22 Thread Elad Kalif
/3.8.2rc1/ https://pypi.org/project/apache-airflow-providers-weaviate/1.4.2rc1/ https://pypi.org/project/apache-airflow-providers-yandex/3.11.2rc1/ https://pypi.org/project/apache-airflow-providers-ydb/1.0.0rc1/ Cheers, Elad Kalif

[Airflow 3] The Airflow actors

2024-06-12 Thread Elad Kalif
Hello everyone, As discussed in the last Airflow meeting I published a doc about the Airflow actors https://cwiki.apache.org/confluence/x/1gmTEg Thanks, Elad

Re: [VOTE] Release Airflow 2.9.2 from 2.9.2rc1

2024-06-09 Thread Elad Kalif
+1 binding ran some of my example dags all looks good On Sun, Jun 9, 2024 at 1:48 PM Jarek Potiuk wrote: > Changing my vote to +1 (binding). > > Updated the constraints for 2.9.2rc1 with **just released** providers > (celery 3.7.1, k8s 8.3.1 , amazon 8.24.0). Installed Airflow 2.9.2rc1 and > ran

[ANNOUNCE] Apache Airflow Providers prepared on June 07, 2024 are released

2024-06-09 Thread Elad Kalif
kages. Full list of released PyPI packages: https://pypi.org/project/apache-airflow-providers-amazon/8.24.0/ https://pypi.org/project/apache-airflow-providers-celery/3.7.2/ https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.3.1/ Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of June 07, 2024

2024-06-09 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on June 07, 2024 have been accepted. 4 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Jed Cunningham - Ephraim Anierobi 2 "+1" non-binding votes received: - Rom Sharon - Rahul Vats Vote thread: https://lis

[VOTE] Airflow Providers prepared on June 07, 2024

2024-06-07 Thread Elad Kalif
ct/apache-airflow-providers-celery/3.7.2rc1/ https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.3.1rc1/ Cheers, Elad Kalif

[ANNOUNCE] Apache Airflow Providers prepared on May 30, 2024 are released

2024-06-02 Thread Elad Kalif
kages. Full list of released PyPI packages: https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.3.0/ https://pypi.org/project/apache-airflow-providers-teradata/2.2.0/ Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of May 30, 2024

2024-06-02 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on May 30, 2024 have been accepted. Provider amazon is excluded from the release thus not counting votes related to this provider. 3 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Ephraim Anierobi 2 "+1" non-binding votes

Re: [DISCUSS] Restore the SQL server backend

2024-05-31 Thread Elad Kalif
I agree with Jarek I am a bit worried about the mental model of this proposal as you are offering to deliver a feature but you are not offering being a community member. I had a lot of frustration with the MsSQL backend tests, it really caused me pain as a contributor. According to your mental mod

[VOTE] Airflow Providers prepared on May 30, 2024

2024-05-30 Thread Elad Kalif
documentation after the RC candidates are released. You can find the RC packages in PyPI following these links: https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.3.0rc2/ https://pypi.org/project/apache-airflow-providers-amazon/8.24.0rc1/ https://pypi.org/project/apache-airflow-providers-teradata/2.2.0rc1/ Cheers, Elad Kalif

[ANNOUNCE] Apache Airflow Providers prepared on May 26, 2024 are released

2024-05-29 Thread Elad Kalif
oject/apache-airflow-providers-yandex/3.11.1/ https://pypi.org/project/apache-airflow-providers-zendesk/4.7.1/ Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of May 26, 2024

2024-05-29 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on May 26, 2024 have been accepted. Provider cncf.kubernetes is excluded from the release thus not counting votes related to this provider. 3 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Hussein Awala 4 "+1" non-bi

Re: [DISCUSS] AIP-63, AIP-64, and AIP-65: DAG Versioning

2024-05-28 Thread Elad Kalif
I have a general question about (maybe somehow related to the DAG Bundle concept introduced in the AIPs) The way I see it DAGs are tightly coupled with Datasets. Tasks take dependency on dataset or/and produce a dataset. We are focused on the versions of the code (DAG) but to make this play nicely

Re: [VOTE] Airflow Providers prepared on May 26, 2024

2024-05-28 Thread Elad Kalif
argument 'pod' in the read_namespaced_pod_log > > call. > > > >> Thanks to Wei for raising the fix PR > > > >> <https://github.com/apache/airflow/pull/39874>. > > > >> > > > >> Regards, > > > >> Rahul Vats

Re: [DISCUSS] AIP-71 Generalizing DAG Loader and Processor for Ephemeral Storage

2024-05-26 Thread Elad Kalif
Thank you Bolke! Interesting read. I have a question about what is the pain we try to solve here. Most use cases I encountered were about the need to sync dags from a branch in GitHub (or equivalent) to the Airflow DAG folder. Correct me if I am wrong but this AIP does not handle this. A sync comp

Re: [DISCUSS] Proposal to enhance Backfills

2024-05-26 Thread Elad Kalif
> In order for this to become a reality, Backfills need to be handled by the Airflow Scheduler as a normal DAG execution I think it's a good idea. It should solve natively problems like https://github.com/apache/airflow/issues/11302 On Fri, May 24, 2024 at 10:58 PM Vikram Koka wrote: > Fellow A

[VOTE] Airflow Providers prepared on May 26, 2024

2024-05-26 Thread Elad Kalif
/3.8.1rc1/ https://pypi.org/project/apache-airflow-providers-weaviate/1.4.1rc1/ https://pypi.org/project/apache-airflow-providers-yandex/3.11.1rc1/ https://pypi.org/project/apache-airflow-providers-zendesk/4.7.1rc1/ Cheers, Elad Kalif

Re: [DISCUSSION] TM1 Airflow provider

2024-05-26 Thread Elad Kalif
Hi Akos, Can you please elaborate about the reasoning? You mentioned the pain of setting up a custom provider. How will this be resolved by having it as an official Airflow provider? I took a look at the stats of the 3rd party package https://pypistats.org/packages/airflow-tm1 it has less than 90

Re: [HUGE DISCUSSION] Airflow3 and tactical (Airflow 2) vs strategic (Airflow 3) approach

2024-05-23 Thread Elad Kalif
Hi everyone, great discussion. I talked with several community members and I think that we should have a non technical discussion thread before we proceed. To give an example: We have several actors: Cluster Admin, Dag Author, UI user. In Airflow 2 perspective all these actors are the same user. F

[ANNOUNCE] Apache Airflow Providers prepared on May 12, 2024 are released

2024-05-17 Thread Elad Kalif
osoft-azure/10.1.0/ https://pypi.org/project/apache-airflow-providers-tabular/1.5.1/ Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of May 12, 2024

2024-05-17 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on May 12, 2024 have been accepted. Provider pinecone is excluded from the release thus not counting votes related to this provider. 4 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Hussein Awala - Kaxil Naik 5 "+1&quo

[VOTE] Airflow Providers prepared on May 12, 2024

2024-05-12 Thread Elad Kalif
viders-google/10.18.0rc2/ https://pypi.org/project/apache-airflow-providers-microsoft-azure/10.1.0rc2/ https://pypi.org/project/apache-airflow-providers-pinecone/2.0.0rc2/ https://pypi.org/project/apache-airflow-providers-tabular/1.5.1rc1/ Cheers, Elad Kalif

Re: [RESULT][VOTE] Airflow Providers - release of May 1, 2024

2024-05-06 Thread Elad Kalif
neering team) > Location: Pune, Maharashtra, India > Timezone: Indian Standard Time (IST) > > > On Mon, May 6, 2024 at 1:40 PM Elad Kalif wrote: > > > Hello, > > > > Apache Airflow Providers prepared on May 1, 2024 have been accepted. > > Providers pinecone, mic

[ANNOUNCE] Apache Airflow Providers prepared on May 01, 2024 are released

2024-05-06 Thread Elad Kalif
trino/5.7.0/ https://pypi.org/project/apache-airflow-providers-vertica/3.8.0/ https://pypi.org/project/apache-airflow-providers-weaviate/1.4.0/ https://pypi.org/project/apache-airflow-providers-yandex/3.11.0/ https://pypi.org/project/apache-airflow-providers-zendesk/4.7.0/ Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of May 1, 2024

2024-05-06 Thread Elad Kalif
ot;+1" binding votes received: - Elad Kalif - Hussein Awala - Andrey Anshin - Kaxil Naik 5 "+1" non-binding votes received: - Vincent Beck - Amogh Desai - Pankaj Singh - Wei Lee - Pankaj Koti - Rom Sharon Vote thread: https://lists.apache.org/thread/h2y4623hk0s7y35l184h14brjsl210y9 I&

Re: [VOTE] Airflow Providers prepared on May 01, 2024

2024-05-02 Thread Elad Kalif
uccessfully against > > > apache-airflow-providers-amazon==8.21.0rc1. You can see the results > here: > > > > > > https://aws-mwaa.github.io/#/open-source/system-tests/version/fe4605a10e26f1b8a180979ba5765d1cb7fb0111_8.21.0rc1.html > > . > > > The only failure (example_bedrock) is a kn

[VOTE] Airflow Providers prepared on May 01, 2024

2024-05-01 Thread Elad Kalif
/pypi.org/project/apache-airflow-providers-vertica/3.8.0rc1/ https://pypi.org/project/apache-airflow-providers-weaviate/1.4.0rc1/ https://pypi.org/project/apache-airflow-providers-yandex/3.11.0rc1/ https://pypi.org/project/apache-airflow-providers-zendesk/4.7.0rc2/ Cheers, Elad Kalif

[ANNOUNCE] Apache Airflow Providers prepared on April 16, 2024 are released

2024-04-21 Thread Elad Kalif
kages. Full list of released PyPI packages: https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.1.1/ https://pypi.org/project/apache-airflow-providers-databricks/6.3.0/ https://pypi.org/project/apache-airflow-providers-fab/1.0.4/ Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of April 16, 2024

2024-04-21 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on April 16, 2024 have been accepted. Provider databricks is excluded from the release thus not counting votes related to this provider. 3 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Hussein Awala 4 "+1" non-binding v

[VOTE] Airflow Providers prepared on April 16, 2024

2024-04-16 Thread Elad Kalif
documentation after the RC candidates are released. You can find the RC packages in PyPI following these links: https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.1.1rc1/ https://pypi.org/project/apache-airflow-providers-databricks/6.3.0rc3/ https://pypi.org/project/apache-airflow-providers-fab/1.0.4rc1/ Cheers, Elad Kalif

[ANNOUNCE] Apache Airflow Providers prepared on April 13, 2024 are released

2024-04-16 Thread Elad Kalif
kages. Full list of released PyPI packages: https://pypi.org/project/apache-airflow-providers-yandex/3.10.0/ Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of April 13, 2024

2024-04-16 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on April 13, 2024 have been accepted. Provider databricks is excluded from the release thus not counting votes related to this provider. 3 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Hussein Awala Vote thread: https://lists.

Re: [VOTE] Airflow Providers prepared on April 13, 2024

2024-04-14 Thread Elad Kalif
PRs in > the > RC to work well. > Also added a > https://github.com/apache/airflow/issues/38997#issuecomment-2053904837 on > the status issue. > > > On Sun, 14 Apr 2024, 02:07 Elad Kalif, wrote: > > > Hey all, > > > > I have just cut *RC2* version for Airflo

[VOTE] Airflow Providers prepared on April 13, 2024

2024-04-13 Thread Elad Kalif
https://pypi.org/project/apache-airflow-providers-yandex/3.10.0rc2/ Cheers, Elad Kalif

[ANNOUNCE] Apache Airflow Providers prepared on April 10, 2024 are released

2024-04-13 Thread Elad Kalif
oject/apache-airflow-providers-sftp/4.9.1/ https://pypi.org/project/apache-airflow-providers-slack/8.6.2/ https://pypi.org/project/apache-airflow-providers-snowflake/5.4.0/ https://pypi.org/project/apache-airflow-providers-weaviate/1.3.4/ Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of April 10, 2024

2024-04-13 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on April 10, 2024 have been accepted. Providers databricks and yandex are excluded from the release 3 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Hussein Awala 7 "+1" non-binding votes received: - Vincent beck - Panka

Re: [VOTE] Airflow Providers prepared on April 10, 2024

2024-04-11 Thread Elad Kalif
> > here: > > > https://github.com/apache/airflow/pull/38887). You can see the results > > > here: > > > > > > https://aws-mwaa.github.io/#/open-source/system-tests/version/3d804351aa7a875dfdba824c2b27300cc5ce9e92_8.20.0rc1.html > > > > > > On

[VOTE] Airflow Providers prepared on April 10, 2024

2024-04-10 Thread Elad Kalif
airflow-providers-slack/8.6.2rc1/ https://pypi.org/project/apache-airflow-providers-snowflake/5.4.0rc1/ https://pypi.org/project/apache-airflow-providers-weaviate/1.3.4rc1/ https://pypi.org/project/apache-airflow-providers-yandex/3.9.1rc1/ Cheers, Elad Kalif

Re: [ANNOUNCE] New committer: Wei Lee

2024-04-09 Thread Elad Kalif
Congrats! On Tue, Apr 9, 2024 at 7:15 AM Vikram Koka wrote: > Awesome! Congratulations Wei! > > Very well deserved. A tremendous amount of contributions in a > relatively short time! > > On Mon, Apr 8, 2024 at 2:27 PM Oliveira, Niko > > wrote: > > > Congrats Wei! Well deserved :) > > > > __

Re: [VOTE] Release Airflow 2.9.0 from 2.9.0rc3

2024-04-07 Thread Elad Kalif
+1 (binding) tested some of my dags. everything works as expected On Mon, Apr 8, 2024 at 7:55 AM Phani Kumar wrote: > +1 non binding.Verified by running few example DAGs > > On Mon, Apr 8, 2024 at 10:17 AM Rahul Vats wrote: > > > +1 (non-binding) > > > > Verified running example DAGs and perfo

[VOTE] Airflow Providers prepared on March 25, 2024

2024-03-25 Thread Elad Kalif
to see important PRs included in the RC candidates. Detailed changelog for the providers will be published in the documentation after the RC candidates are released. You can find the RC packages in PyPI following these links: https://pypi.org/project/apache-airflow-providers-fab/1.0.2rc1/ Cheers, Elad Kalif

Re: [VOTE] Remove experimental API

2024-03-17 Thread Elad Kalif
I am -0 for removal at this time. I think we better wait at least till major cloud vendors of Airflow stop supporting older versions of Airflow from my check both AWS and Google still support 1.10 I see that Google supports it until September 13, 2024 https://cloud.google.com/composer/docs/concepts

Re: Bad mixing of decorated and classic operators (users shooting themselves in their foot)

2024-03-10 Thread Elad Kalif
The issue here is not just about decorators it happens also with regular operators (operator inside operator) and also with operator inside on_x_callback For example: https://stackoverflow.com/questions/64291042/airflow-call-a-operator-inside-a-function/ https://stackoverflow.com/questions/6748354

[ANNOUNCE] Apache Airflow Providers prepared on March 04, 2024 are released

2024-03-08 Thread Elad Kalif
i.org/project/apache-airflow-providers-trino/5.6.3/ https://pypi.org/project/apache-airflow-providers-weaviate/1.3.3/ Cheers, Elad Kalif

[RESULT][VOTE] Airflow Providers - release of March 04, 2024

2024-03-08 Thread Elad Kalif
Hello, Apache Airflow Providers prepared on February 23, 2024 have been accepted. Provider cncf.kubernetes is excluded thus not counting votes casted on it. 3 "+1" binding votes received: - Elad Kalif - Jarek Potiuk - Hussein Awala 4 "+1" non-binding votes received: - Vince

Re: [DISCUSS] Deprecation policy for apache-airflow-providers-google package

2024-03-05 Thread Elad Kalif
; make sure the deprecation is present in already released > > > minor/patchlevel > > > >> version to be able to remove it (so even if it is deprecated 2 > months > > > ago > > > >> but we had release with the deprecation, it's ok to

  1   2   3   4   5   >