[
https://issues.apache.org/jira/browse/AIRFLOW-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398220#comment-16398220
]
ASF subversion and git services commented on AIRFLOW-2203:
----------------------------------------------------------
Commit 781c5bf6967473701e4812d72ace4f675f5b5c94 in incubator-airflow's branch
refs/heads/master from [~wongwill]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=781c5bf ]
[AIRFLOW-2203] Store task ids as sets not lists
Massively improve performance by using sets to represent a task's
upstream and downstream task ids.
> Dag import too slow for very large dags
> ---------------------------------------
>
> Key: AIRFLOW-2203
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2203
> Project: Apache Airflow
> Issue Type: Improvement
> Components: DAG
> Affects Versions: 1.8.1, 1.8.0, 1.9.0, 1.9.1
> Reporter: Will Wong
> Assignee: Will Wong
> Priority: Major
> Labels: performance, usability
>
> Dag import for large dags is too slow. It is very easy to timeout very large
> dags with < 500 tasks.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
