[
https://issues.apache.org/jira/browse/AIRFLOW-910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15906287#comment-15906287
]
ASF subversion and git services commented on AIRFLOW-910:
---------------------------------------------------------
Commit d7d9f883e4db3d864eb88ce510988456e8d468c4 in incubator-airflow's branch
refs/heads/master from [~bolke]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=d7d9f88 ]
AIRFLOW-932][AIRFLOW-932][AIRFLOW-921][AIRFLOW-910] Do not mark tasks removed
when backfilling[
In a backfill one can specify a specific task to
execute. We
create a subset of the orginal tasks in a subdag
from the original dag.
The subdag has the same name as the original dag.
This breaks
the integrity check of a dag_run as tasks are
suddenly not in
scope any more.
Closes #2122 from bolkedebruin/AIRFLOW-921
> Parallelize dag runs in backfills
> ---------------------------------
>
> Key: AIRFLOW-910
> URL: https://issues.apache.org/jira/browse/AIRFLOW-910
> Project: Apache Airflow
> Issue Type: Sub-task
> Components: backfill
> Affects Versions: 1.8.0rc4
> Reporter: Bolke de Bruin
> Assignee: Bolke de Bruin
> Priority: Blocker
> Fix For: 1.8.0
>
>
> Currently dag runs are executed sequentially while backfilling. This is a
> regression and slows down the processing off tasks.
> [~aoen]
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)