Re: Custom DagBag collection based on dags_folder prefix

+1. I think having a design doc is good. And it would be great if you could create couples of small jiras for the related task. I am interested in helping out if possible. Thanks, -Tao On Fri, Mar 16, 2018 at 3:52 AM, Diogo Franco wrote: > Created this JIRA

The BranchPythonOperator, skip semantics and trigger_rules

Hi there, I have been struggling to get the BranchPythonOperator to work correctly. The documentation [1] is relatively thin, and a related answer on StackOverflow [2] did not clarify a lot. So I set up a bunch of demo DAGs that show the in my opinion faulty behaviour and a workaround with a

Tasks getting killed as Zombie process ( Mysql DB download specific tasks)

Hi, I am using airflow v1.7.1.3. Some of the tasks in the pipeline gets killed as Zombie. A pattern in that has come out that it happens in those jobs which are downloading data from MySql DB. I am doing the following steps in those tasks: 1. getting connection from db, using Hook 2. Execute

Re: Custom DagBag collection based on dags_folder prefix

Created this JIRA . I'm happy to take a shot at this with an initial implementation for review, but If it is preferred to start with a design doc or something, let me know. Thank you for the guidance, cheers, Diogo On 16 March 2018 at 00:08,