Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-24 Thread Kaxil Naik
@Barni Seetharaman - Github Issues have been enabled. Feel free to create/use them. Regards, Kaxil On Fri, Jan 24, 2020 at 1:49 PM Kaxil Naik wrote: > Oh yes forgot about that, thanks Kamil > > On Fri, Jan 24, 2020 at 1:34 PM Kamil Breguła > wrote: > >> Here is guide - how to enable issues on

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-24 Thread Kaxil Naik
Oh yes forgot about that, thanks Kamil On Fri, Jan 24, 2020 at 1:34 PM Kamil Breguła wrote: > Here is guide - how to enable issues on GitHub: > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=127405038 > > On Fri, Jan 24, 2020, 5:45 AM Kaxil Naik wrote: > > > We can ask the INF

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-24 Thread Kamil Breguła
Here is guide - how to enable issues on GitHub: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=127405038 On Fri, Jan 24, 2020, 5:45 AM Kaxil Naik wrote: > We can ask the INFRA team to enable "ISSUES" on this repo. So that we don't > mix it with Airflow Jira board. > > I will as

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-23 Thread Kaxil Naik
We can ask the INFRA team to enable "ISSUES" on this repo. So that we don't mix it with Airflow Jira board. I will ask that and let you all know when it is enabled. On Fri, Jan 24, 2020, 10:09 Tao Feng wrote: > Yes, that's it. I am +1 on adding a new label or component for k8s > operator. > > >

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-23 Thread Tao Feng
Yes, that's it. I am +1 on adding a new label or component for k8s operator. On Thu, Jan 23, 2020 at 2:30 PM Barni Seetharaman wrote: > Is this the j > > ira: https://issues.apache.org/jira/projects/AIRFL

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-23 Thread Barni Seetharaman
Is this the j ira: https://issues.apache.org/jira/projects/AIRFLOW/summary Do we need to add a new component for "Airflow-on-k8s-operator" ? regs Barni On Thu, Jan 23, 2020 at 2:12 PM Tao Feng wrote: > I

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-23 Thread Tao Feng
I don't think Airflow is using github issues. I am a committer and can't create issue on the repo as well. I assume it is disabled by Apache infra. We could always file a jira for the issue :) . On Thu, Jan 23, 2020 at 1:54 PM Barni Seetharaman wrote: > Over the last few days we merged a few cha

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-23 Thread Barni Seetharaman
Over the last few days we merged a few changes to get the repo to be functional. I dont see the ability to create Issues on this repo. Can only commiters create an issue ? On Mon, Jan 20, 2020 at 12:36 PM Aizhamal Nurmamat kyzy wrote: > Indeed. I have previously requested +Barni Seetharaman (t

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-20 Thread Aizhamal Nurmamat kyzy
Indeed. I have previously requested +Barni Seetharaman (the author of the operator) to write up a post about how and when to use this operator with examples. If Barni's bandwidth doesn't allow him to work on it at the moment, maybe we can have other volunteers who know the code to contribute the d

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-19 Thread Xinbin Huang
Some doc or content about what is it and potential use cases and why we should use this would be great. Thanks for everything! On Fri, Jan 17, 2020 at 1:04 AM Jiajie Zhong wrote: > It’s great for community, I can see the repo in > https://github.com/apache/airflow-on-k8s-operator < > https://gi

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-17 Thread Jiajie Zhong
It’s great for community, I can see the repo in https://github.com/apache/airflow-on-k8s-operator One more thing: should we add some content in our document to attract attention for users? Best Wish — Jiajie

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-16 Thread Tao Feng
great!!! On Wed, Jan 15, 2020 at 4:41 PM Pablo Estrada wrote: > Very cool : ) > > On Wed, Jan 15, 2020 at 1:04 PM Jarek Potiuk > wrote: > > > Awesome! > > > > On Wed, Jan 15, 2020 at 10:01 PM Kaxil Naik wrote: > > > > > Awesome, thanks Aizhamal, Jakob and everyone involved. > > > > > > On Wed,

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-15 Thread Pablo Estrada
Very cool : ) On Wed, Jan 15, 2020 at 1:04 PM Jarek Potiuk wrote: > Awesome! > > On Wed, Jan 15, 2020 at 10:01 PM Kaxil Naik wrote: > > > Awesome, thanks Aizhamal, Jakob and everyone involved. > > > > On Wed, Jan 15, 2020 at 6:15 PM Aizhamal Nurmamat kyzy < > > aizha...@apache.org> > > wrote: >

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-15 Thread Jarek Potiuk
Awesome! On Wed, Jan 15, 2020 at 10:01 PM Kaxil Naik wrote: > Awesome, thanks Aizhamal, Jakob and everyone involved. > > On Wed, Jan 15, 2020 at 6:15 PM Aizhamal Nurmamat kyzy < > aizha...@apache.org> > wrote: > > > Forgot to clarify that I will create the repo :) Thanks > > > > On Wed, Jan 15,

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-15 Thread Kaxil Naik
Awesome, thanks Aizhamal, Jakob and everyone involved. On Wed, Jan 15, 2020 at 6:15 PM Aizhamal Nurmamat kyzy wrote: > Forgot to clarify that I will create the repo :) Thanks > > On Wed, Jan 15, 2020 at 10:07 AM Aizhamal Nurmamat kyzy < > aizha...@apache.org> > wrote: > > > Hi everyone,, > > > >

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-15 Thread Aizhamal Nurmamat kyzy
Forgot to clarify that I will create the repo :) Thanks On Wed, Jan 15, 2020 at 10:07 AM Aizhamal Nurmamat kyzy wrote: > Hi everyone,, > > We have finally pushed through the process of getting the IP clearance for > this donation. Thanks for driving a lot of the effort, Jakob! > > As per Apache

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-15 Thread Aizhamal Nurmamat kyzy
Hi everyone,, We have finally pushed through the process of getting the IP clearance for this donation. Thanks for driving a lot of the effort, Jakob! As per Apache Infra response [1], we now can create a new 'airflow-on-k8s-operator' repo under apache/airflow and move the code. [1] https://iss

Re: [DISCUSS] Donating Airflow k8s Operator

2019-11-15 Thread Aizhamal Nurmamat kyzy
Hi Tao and everyone, Sorry that we haven't updated you in a while. We have just changed the licenses into appropriate ones and currently still dealing with its dependencies. But it is moving now. +Jakob Homan I think was about to start a vote soon. On Fri, Nov 15, 2019 at 12:13 AM Tao Feng wrot

Re: [DISCUSS] Donating Airflow k8s Operator

2019-11-15 Thread Tao Feng
Hey, Is the Airflow k8s Operator project now part of airflow code base now? Or still waiting for IP clearance? Thanks, -Tao On Tue, Sep 17, 2019 at 10:34 AM Aizhamal Nurmamat kyzy wrote: > Thanks everyone for participating in the discussion! I see there is a > consensus among the community on

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-17 Thread Aizhamal Nurmamat kyzy
Thanks everyone for participating in the discussion! I see there is a consensus among the community on this regard, therefore we will move forward with the process. Next step is to get IP clearance as described here [1]. This step is done by the receiving PMC, and @Jakob Homan has agreed to help.

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-13 Thread Kamil Breguła
+1 On Fri, Sep 13, 2019 at 8:40 PM Jarek Potiuk wrote: > > +1 for aieflow-on-k8s-operator. Good enough :) > > J. > > pt., 13 wrz 2019, 19:19 użytkownik Tao Feng napisał: > > > +1 on `airflow-on-k8s-operator` as well > > > > On Fri, Sep 13, 2019 at 10:07 AM Ry Walker wrote: > > > > > +1 from me

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-13 Thread Jarek Potiuk
+1 for aieflow-on-k8s-operator. Good enough :) J. pt., 13 wrz 2019, 19:19 użytkownik Tao Feng napisał: > +1 on `airflow-on-k8s-operator` as well > > On Fri, Sep 13, 2019 at 10:07 AM Ry Walker wrote: > > > +1 from me for sure. Thanks for pushing this through Aizhamal. > > > > GCP just named the

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-13 Thread Tao Feng
+1 on `airflow-on-k8s-operator` as well On Fri, Sep 13, 2019 at 10:07 AM Ry Walker wrote: > +1 from me for sure. Thanks for pushing this through Aizhamal. > > GCP just named their flink operator ( > https://github.com/GoogleCloudPlatform/flink-on-k8s-operator > ) *flink-on-k8s-operator.* > > So

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-13 Thread Ry Walker
+1 from me for sure. Thanks for pushing this through Aizhamal. GCP just named their flink operator ( https://github.com/GoogleCloudPlatform/flink-on-k8s-operator )  *flink-on-k8s-operator.* So  for name, I prefer either *k8s-operator-for-airflow* or *airflow-on-k8s-operator*. I sort of like the

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-12 Thread Barni Seetharaman
Thanks Aizhamal for starting the conversation. Thanks to Daniel Imberman for his support over the last year. Iam definitely maintaining it. Just trying to prioritize it among other things. regs Barni On Thu, Sep 12, 2019 at 10:45 AM Aizhamal Nurmamat kyzy wrote: > On Tao's comment: yes, the cu

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-12 Thread Aizhamal Nurmamat kyzy
On Tao's comment: yes, the current author - Barni (cc'ed here) will continue to maintain the project :) On Thu, Sep 12, 2019 at 10:05 AM Daniel Imberman < dimberman.opensou...@gmail.com> wrote: > +1 here! > > On Thu, Sep 12, 2019 at 10:20 AM Jarek Potiuk > wrote: > > > The name is indeed mislea

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-12 Thread Daniel Imberman
+1 here! On Thu, Sep 12, 2019 at 10:20 AM Jarek Potiuk wrote: > The name is indeed misleading. My proposal would be > k8s-operator-for-airflow - this might make it unambiguous . > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk > > napisał: > > > Fantastic! Strong +1 from me. > > > > To alle

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-12 Thread Jarek Potiuk
The name is indeed misleading. My proposal would be k8s-operator-for-airflow - this might make it unambiguous . czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk napisał: > Fantastic! Strong +1 from me. > > To alleviate some of the concerns - we @Polidea are just starting a > project for big and

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-12 Thread Jarek Potiuk
Fantastic! Strong +1 from me. To alleviate some of the concerns - we @Polidea are just starting a project for big and serious customer where we will most likely use and extend Kubernetes Operator. We have 3 people that could become contributors and commiters day one, so we can already help buildi

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-12 Thread Kaxil Naik
Agree to Ash's comment. On Thu, Sep 12, 2019, 11:37 Andrii Soldatenko wrote: > +1 > +1 to Ash comment, maybe "airflow-k8s-operator" or something in this > manner. > > On Thu, Sep 12, 2019 at 12:25 PM Kaxil Naik wrote: > > > +1 > > > > On Thu, Sep 12, 2019, 10:22 Ash Berlin-Taylor wrote: > > >

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-12 Thread Andrii Soldatenko
+1 +1 to Ash comment, maybe "airflow-k8s-operator" or something in this manner. On Thu, Sep 12, 2019 at 12:25 PM Kaxil Naik wrote: > +1 > > On Thu, Sep 12, 2019, 10:22 Ash Berlin-Taylor wrote: > > > +1 > > > > My only "concern" is what we call it - the term operator clashes between > > Kubernet

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-12 Thread Kaxil Naik
+1 On Thu, Sep 12, 2019, 10:22 Ash Berlin-Taylor wrote: > +1 > > My only "concern" is what we call it - the term operator clashes between > Kubernetes and Airflow to mean different things. > > -ash > > On 12 September 2019 08:22:39 CEST, Tao Feng wrote: > >+1 as well. One question: does the ori

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-12 Thread Ash Berlin-Taylor
+1 My only "concern" is what we call it - the term operator clashes between Kubernetes and Airflow to mean different things. -ash On 12 September 2019 08:22:39 CEST, Tao Feng wrote: >+1 as well. One question: does the original author still actively >maintain >or would like to continue maintain

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-11 Thread Tao Feng
+1 as well. One question: does the original author still actively maintain or would like to continue maintaining the code base after the repo is moved to Airflow? On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari wrote: > Strong +1 > > On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy < > a

Re: [DISCUSS] Donating Airflow k8s Operator

2019-09-11 Thread Sumit Maheshwari
Strong +1 On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy wrote: > Hello Airflow community, > > Over the last year, an engineer at Google developed, and open sourced a > Kubernetes operator to run Airflow[1]. Anyone can use it to deploy Airflow > on their k8s cluster freely. > > There hav