Re: Announcing SIG-Knative/ The Monthly Knative Executor Meetup/Call-for-contributers

2019-10-16 Thread Ash Berlin-Taylor
We meant October 30th (the date in the calendar is correct) -a > On 16 Oct 2019, at 18:57, Daniel Imberman wrote: > > Fixing the calendar link :) >

Re: Announcing SIG-Knative/ The Monthly Knative Executor Meetup/Call-for-contributers

2019-10-16 Thread James Meickle
Great stuff. I shared it with my team, and I'll try to make the first one at least. On Wed, Oct 16, 2019 at 1:35 PM Daniel Imberman wrote: > Hello fellow Airflowers! > > As some of you have heard, recently we’ve been looking into knative as a > new executor that will offer both the flexibility

Re: Announcing SIG-Knative/ The Monthly Knative Executor Meetup/Call-for-contributers

2019-10-16 Thread Tomasz Urbaszek
Awesome! Tomek On Wed, 16 Oct 2019 at 21:32, Bolke de Bruin wrote: > Really cool! > > Verstuurd vanaf mijn iPad > > > Op 16 okt. 2019 om 20:51 heeft Jarek Potiuk > het volgende geschreven: > > > > Fantastic! > > > >> On Wed, Oct 16, 2019 at 8:26 PM Driesprong, Fokko > > >> wrote: > >> > >>

Re: Announcing SIG-Knative/ The Monthly Knative Executor Meetup/Call-for-contributers

2019-10-16 Thread Bolke de Bruin
Really cool! Verstuurd vanaf mijn iPad > Op 16 okt. 2019 om 20:51 heeft Jarek Potiuk het > volgende geschreven: > > Fantastic! > >> On Wed, Oct 16, 2019 at 8:26 PM Driesprong, Fokko >> wrote: >> >> Awesome Daniel! >> >> Cheers, Fokko >> >> Op wo 16 okt. 2019 om 20:16 schreef Kevin Yang

Re: Announcing SIG-Knative/ The Monthly Knative Executor Meetup/Call-for-contributers

2019-10-16 Thread Jarek Potiuk
Fantastic! On Wed, Oct 16, 2019 at 8:26 PM Driesprong, Fokko wrote: > Awesome Daniel! > > Cheers, Fokko > > Op wo 16 okt. 2019 om 20:16 schreef Kevin Yang : > > > Exciting! > > > > Daniel Imberman 于2019年10月16日 周三上午10:58写道: > > > > > Fixing the calendar link :) > > > > > > > > >

Re: Announcing SIG-Knative/ The Monthly Knative Executor Meetup/Call-for-contributers

2019-10-16 Thread Driesprong, Fokko
Awesome Daniel! Cheers, Fokko Op wo 16 okt. 2019 om 20:16 schreef Kevin Yang : > Exciting! > > Daniel Imberman 于2019年10月16日 周三上午10:58写道: > > > Fixing the calendar link :) > > > > >

Re: [PLEASE PARTICIPATE][AIP-11] UI phase of Airflow website

2019-10-16 Thread Driesprong, Fokko
Thanks Kamil, Looks amazing. I really like the version from the meeting with Aizhamal; a bit more colorful. The gray boxes fade to the background. Cheers, Fokko Op wo 16 okt. 2019 om 19:17 schreef Chris Hendrixson : > Kamil & team, the site is really coming together! Great improvements >

Re: Announcing SIG-Knative/ The Monthly Knative Executor Meetup/Call-for-contributers

2019-10-16 Thread Daniel Imberman
Fixing the calendar link :) https://calendar.google.com/event?action=TEMPLATE=b2I4Yml2MWdhcXRtdGRtZmkzcXNxdmY5cThfMjAxOTEwMzBUMTUwMDAwWiBqMHY2c25uYzZ1N2l1cGI1Y2dxYTNpaTU4Z0Bn=j0v6snnc6u7iupb5cgqa3ii58g%40group.calendar.google.com=ALL On Wed, Oct 16, 2019 at 2:38 PM Aizhamal Nurmamat kyzy wrote:

Re: Announcing SIG-Knative/ The Monthly Knative Executor Meetup/Call-for-contributers

2019-10-16 Thread Aizhamal Nurmamat kyzy
This is awesome! Thank you for setting this up, Daniel. Also adding few Cloud Composer folks who are super interested in contributing to this effort. On Wed, Oct 16, 2019, 7:34 PM Daniel Imberman wrote: > Hello fellow Airflowers! > > As some of you have heard, recently we’ve been looking into

Announcing SIG-Knative/ The Monthly Knative Executor Meetup/Call-for-contributers

2019-10-16 Thread Daniel Imberman
Hello fellow Airflowers! As some of you have heard, recently we’ve been looking into knative as a new executor that will offer both the flexibility of the KubernetesExecutor and the speed of the CeleryExecutor. The Initial tests have been successful (with pretty awesome speed/scaling

Re: [PLEASE PARTICIPATE][AIP-11] UI phase of Airflow website

2019-10-16 Thread Chris Hendrixson
Kamil & team, the site is really coming together! Great improvements overall. The home page graphic with the colored boxes doesn't seem quite right yet. What is the vision there? I remember the Slack website reference and I think it worked because it used actual icons instead of just boxes. With

Re: [PROPOSAL] Migrate to Pytest

2019-10-16 Thread Dan Davydov
+1 On Wed, Oct 16, 2019 at 12:01 PM Christian Lellmann wrote: > +1 from my side too. > > Regards, > > Chris > > Driesprong, Fokko schrieb am Mi., 16. Okt. 2019, > 17:01: > > > +1 > > > > Op ma 14 okt. 2019 om 16:50 schreef Felix Uellendall > > > >: > > > > > +1, successfully using pytest for

Re: [PLEASE PARTICIPATE][AIP-11] UI phase of Airflow website

2019-10-16 Thread Kamil Breguła
Hello, The idea seems interesting to me, but I'm afraid that it goes far beyond the scope of work. We want to prepare a static website and we do not have servers that can provide demo versions. The website is created by a graphic team and front-end developer. Preparation of the demo version is a

Re: [PROPOSAL] Migrate to Pytest

2019-10-16 Thread Christian Lellmann
+1 from my side too. Regards, Chris Driesprong, Fokko schrieb am Mi., 16. Okt. 2019, 17:01: > +1 > > Op ma 14 okt. 2019 om 16:50 schreef Felix Uellendall > >: > > > +1, successfully using pytest for airflow plugins for almost 2 years now. > > > > Felix > > > > Sent from ProtonMail Mobile > >

Re: [PLEASE PARTICIPATE][AIP-11] UI phase of Airflow website

2019-10-16 Thread Kamil Breguła
Hello, The team has worked hard and we have another version that takes into account your and other people's comments. https://projects.invisionapp.com/share/29UEJ5U6YN3#/screens The following changes have been made: * on the community page: it contains the accordion and more icons now. This will

Re: [VOTE] AIP-24: Persisting serialized DAG in DB for webserver scalability

2019-10-16 Thread Dan Davydov
Responses inline. On Wed, Oct 16, 2019 at 6:07 AM Ash Berlin-Taylor wrote: > Thanks for the feedback and discussion everyone - it's nice to know people > feel strongly about this. Let's make sure we build this right! > > As a reminder: the main goals of this AIP: > > - To speed up bootup/worker

Re: [PROPOSAL] Migrate to Pytest

2019-10-16 Thread Driesprong, Fokko
+1 Op ma 14 okt. 2019 om 16:50 schreef Felix Uellendall : > +1, successfully using pytest for airflow plugins for almost 2 years now. > > Felix > > Sent from ProtonMail Mobile > > On Mon, Oct 14, 2019 at 16:39, Daniel Imberman < > dimberman.opensou...@gmail.com> wrote: > > > Huge +1 from me on

Re: Updating Apache website with new logos

2019-10-16 Thread Ash Berlin-Taylor
Done - not sure when the site will update though. https://svn.apache.org/repos/asf/comdev/project-logos/originals/airflow-1.svg https://svn.apache.org/repos/asf/comdev/project-logos/originals/airflow-2.svg

Re: Updating Apache website with new logos

2019-10-16 Thread Leah Cole
Woohoo - thanks for the quick response, Ash! On Wed, Oct 16, 2019 at 3:54 PM Ash Berlin-Taylor wrote: > Oh thanks, I forgot to update it there! > > Doing this now. > > -a > > > On 16 Oct 2019, at 14:53, Leah Cole wrote: > > > > Hi all! > > > > I noticed today that the new Airflow logo hasn't

Re: Updating Apache website with new logos

2019-10-16 Thread Ash Berlin-Taylor
Oh thanks, I forgot to update it there! Doing this now. -a > On 16 Oct 2019, at 14:53, Leah Cole wrote: > > Hi all! > > I noticed today that the new Airflow logo hasn't quite made it to svn repo > linked here on the Apache website . > I went to make

Updating Apache website with new logos

2019-10-16 Thread Leah Cole
Hi all! I noticed today that the new Airflow logo hasn't quite made it to svn repo linked here on the Apache website . I went to make the change myself, but it seems like I can't as a non-ASF-committer (or if I can, would someone be willing to walk me

Re: [Discuss] EMR Step operator/sensor

2019-10-16 Thread Daniel Mateus Pires
Good seeing that more people have been working around this. I'm curious as to what is the impact on the community (are they writing over and over Operators combining Sensor + Operator to cover async cases? Are they using custom code to have atomicity, like python functions used in the hooks ? )

Re: [VOTE] AIP-24: Persisting serialized DAG in DB for webserver scalability

2019-10-16 Thread Ash Berlin-Taylor
Thanks for the feedback and discussion everyone - it's nice to know people feel strongly about this. Let's make sure we build this right! As a reminder: the main goals of this AIP: - To speed up bootup/worker recycle time of the webserver If you have a large number of DAGs or highly dynamic

Re: [VOTE] AIP-24: Persisting serialized DAG in DB for webserver scalability

2019-10-16 Thread Kamil Breguła
Hello, I think it's worth to mark this feature as experimental, which means that its behavior may change. In this way, we will not have to ensure backward compatibility, but we will be able to test this feature in a real environment. This is how feature are introduced in the Kubernetes project,

Re: [VOTE] AIP-24: Persisting serialized DAG in DB for webserver scalability

2019-10-16 Thread Sumit Maheshwari
On this, I'm more aligned with the +1 community here. While I agree that this is not the complete solution and work doesn't stop here, but I see it as a stepping stone in the right direction. It's a very big challenge to develop and deliver a change of this magnitude, so I believe that should be