[
https://issues.apache.org/jira/browse/AIRFLOW-4509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16902410#comment-16902410
]
ASF subversion and git services commented on AIRFLOW-4509:
----------------------------------------------------------
Commit 0be39219cd058ba7d50cdf34b2cc46513f4f5ab3 in airflow's branch
refs/heads/master from Chao-Han Tsai
[ https://gitbox.apache.org/repos/asf?p=airflow.git;h=0be3921 ]
[AIRFLOW-4509] SubDagOperator using scheduler instead of backfill (#5498)
Change SubDagOperator to use Airflow scheduler to schedule
tasks in subdags instead of backfill.
In the past, SubDagOperator relies on backfill scheduler
to schedule tasks in the subdags. Tasks in parent DAG
are scheduled via Airflow scheduler while tasks in
a subdag are scheduled via backfill, which complicates
the scheduling logic and adds difficulties to maintain
the two scheduling code path.
This PR simplifies how tasks in subdags are scheduled.
SubDagOperator is reponsible for creating a DagRun for subdag
and wait until all the tasks in the subdag finish. Airflow
scheduler picks up the DagRun created by SubDagOperator,
create andschedule the tasks accordingly.
> SubDagOperator using scheduler instead of backfill
> --------------------------------------------------
>
> Key: AIRFLOW-4509
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4509
> Project: Apache Airflow
> Issue Type: New Feature
> Components: scheduler
> Affects Versions: 1.10.3
> Reporter: Chao-Han Tsai
> Assignee: Chao-Han Tsai
> Priority: Major
> Fix For: 1.10.5
>
>
> Make SubDagOperator use Airflow scheduler instead of backfill to schedule
> tasks.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
