Hi, Airflow developers,
On Airflow 1.6, we found sometimes a dag's status was set to "Failed" even when some tasks were still running. The steps to illustrate this behavior is: (suppose a dag contains 2 tasks , A and B.) 1. let task A and B starts running. --> The dag status is "Running". 2. Clear task A. --> the task A process will be killed and the task A will set to "Failed". 3. Task B is still running. 4. The dag status becomes "Failed", even though the Task B is still running. I wonder whether this is an Airflow bug or an expected behavior. Any comments are welcome. Thanks. Michael ________________________________ From: Michael Gong <[email protected]> Sent: Friday, March 3, 2017 8:56 PM To: [email protected] Subject: Re: Airflow running different with different user id ? Hi, Dan, Thanks for the encouraging news. Maybe you could direct me to the documentation about "run_as" so I could see whether it is for my purpose. I guess it will be passed as an argument for the DAG object , right ? Thanks again. Michael ________________________________ From: Dan Davydov <[email protected]> Sent: Friday, March 3, 2017 8:44 PM To: [email protected] Subject: Re: Airflow running different with different user id ? Within a couple of weeks. On Fri, Mar 3, 2017 at 12:34 PM, Michael Gong <[email protected]> wrote: > When approximately will it be released? > > Sent from my PP•KING™ smartphone > > On Mar 3, 2017 1:42 PM, Dan Davydov <[email protected]> > wrote: > Yes it is starting on 1.8.0 which will be released soon, you can look in > the documentation/grep for "run_as". > > On Mar 3, 2017 8:50 AM, "Michael Gong" <[email protected]> wrote: > > > Hi, > > > > > > Suppose I have 1 airflow instance running 2 different DAGs, is it > possible > > to specify the 2 DAGs running under 2 different ids ? > > > > > > Any advises are welcomed. > > > > > > Thanks. > > > > Michael > > > > > > > > > > >
