Re: Apache Airflow welcome new committer/PMC member : Naik Kaxil (a.k.a. kaxil)

2018-05-08 Thread Tao Feng
Welcome! On Tue, May 8, 2018 at 1:47 PM, Driesprong, Fokko wrote: > Hi Airflow'ers, > > Please join the Apache Airflow PMC in welcoming its newest member and > co-committer, Naik Kaxil (a.k.a. kaxil ). > Welcome > Kaxil, great to have you on

Re: Subdag tasks unable to start

2018-05-08 Thread Arthur Wiedmer
Hi Victor, Usually, we expect the Schedules to match with Subdags, I am not sure Airflow supports heterogeneous schedules like this. What you could have is one Triggering DAG, and a second DAG that it triggers at the right interval. Would you be able to explain further what you mean by simulate

Re: Subdag tasks unable to start

2018-05-08 Thread Victor Noagbodji
Thanks for replying : ) Thought I sent my messages to the wrong email or group. > On May 8, 2018, at 4:41 PM, Arthur Wiedmer wrote: > > Hi Victor, > > Usually, we expect the Schedules to match with Subdags, I am not sure > Airflow supports heterogeneous schedules like

Re: Apache Airflow welcome new committer/PMC member : Naik Kaxil (a.k.a. kaxil)

2018-05-08 Thread Feng Lu
Welcome Naik! On Tue, May 8, 2018 at 3:39 PM Tao Feng wrote: > Welcome! > > On Tue, May 8, 2018 at 1:47 PM, Driesprong, Fokko > wrote: > > > Hi Airflow'ers, > > > > Please join the Apache Airflow PMC in welcoming its newest member and > >

Re: Airflow tree view display issue

2018-05-08 Thread Tao Feng
I would suggest you create a jira ticket and attach the image onto the ticket. I think your image is filtered by apache email and can't be viewed by others. On Tue, May 8, 2018 at 5:53 PM, Wang, Larry wrote: > Are there anybody get chance to check this thread? > > > >

Re: Apache Airflow welcome new committer/PMC member : Naik Kaxil (a.k.a. kaxil)

2018-05-08 Thread Matthijs Brouns
Welcome! 2018-05-09 2:14 GMT+02:00 Feng Lu : > Welcome Naik! > > On Tue, May 8, 2018 at 3:39 PM Tao Feng wrote: > > > Welcome! > > > > On Tue, May 8, 2018 at 1:47 PM, Driesprong, Fokko > > wrote: > > > > > Hi Airflow'ers, >

RE: Airflow tree view display issue

2018-05-08 Thread Wang, Larry
Are there anybody get chance to check this thread? From: Wang, Larry Sent: Tuesday, May 8, 2018 2:44 PM To: 'dev@airflow.incubator.apache.org' Subject: Airflow tree view display issue Hi Airflow experts, We recently met an issue when displaying a long chained DAGs in airflow tree views, are

Subdag tasks unable to start

2018-05-08 Thread Victor Noagbodji
Guys, So we have a dag containing a subdag that triggers itself using TriggerDagRunOperator. Seems, after some research, that it's one way to simulate loops. The triggered subdag gets added. But none of the tasks ever start. I researched the issue and no solution I found so far worked. We

Airflow tree view display issue

2018-05-08 Thread Wang, Larry
Hi Airflow experts, We recently met an issue when displaying a long chained DAGs in airflow tree views, are there any fix we could do for this? [cid:image001.png@01D3E6DB.077F0EB0] Thanks and best regards Larry Wang

Re: Problem with SparkSubmit

2018-05-08 Thread Arthur Wiedmer
No excuse necessary, we are glad you found the issue! Best, Arthur On Tue, May 8, 2018 at 8:06 AM Anton Mushin wrote: > I found mistake in my connection configuration. > The problem is not relevant. Excuse me for troubling. > > Best Regards, > Anton > > -Original

Re: Airflow tree view display issue

2018-05-08 Thread Arthur Wiedmer
Hi Larry, Unfortunately, embedded images do not make through the mailing list. Would you be able to send a link to your picture, via the hosting service of your choice so we can help diagnose? Best, Arthur On Tue, May 8, 2018 at 8:06 AM Wang, Larry wrote: > Hi Airflow

Regarding airflow scheduler starting PID periodically.

2018-05-08 Thread nitish sharma
Hi Team, I have a situation where i want to create dag with unique dag id and run that dag once as soon as it is created. For eg : 1.py , 2.py are two different dags. 1.py (has 3 tasks) and 2.py(has 2 tasks). Once these are run i would have next set of dags with me for eg 3.py, 4.py, 5.py and

Re: Subdag tasks unable to start

2018-05-08 Thread Victor Noagbodji
anyone? > On May 8, 2018, at 9:01 AM, Victor Noagbodji > wrote: > > Guys, > > So we have a dag containing a subdag that triggers itself using > TriggerDagRunOperator. Seems, after some research, that it's one way to > simulate loops. > > The triggered subdag