Abdul Nimeri created AIRFLOW-2777:
-------------------------------------

             Summary: dag.sub_dag(...) speedups
                 Key: AIRFLOW-2777
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2777
             Project: Apache Airflow
          Issue Type: Improvement
            Reporter: Abdul Nimeri
            Assignee: Abdul Nimeri


dag.sub_dag(...) currently works by first deep copying the entire dag, and then 
filtering down to the appropriate tasks. that can be slow since deep copying a 
big dag takes a while. specifically, copying over all the tasks is the 
bottleneck

this can be a lot faster by instead only copying over the filtered down tasks

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to