dimberman opened a new issue #8078: Execute SubDAG tasks as part of parent DAG
URL: https://github.com/apache/airflow/issues/8078
 
 
   **Description**
   
   Currently, the SubDagOperator launches a completely different DAG and then 
monitors it as a separate entity. This has lead to all sorts of edge case (e.g. 
when workers have different executors than the scheduler).
   
   This Issue suggests that we instead merge all tasks from the subdag into the 
original DAG with an extra "original_dag" label. this means at the UI level we 
can still condense all subdag tasks into a single task, but a single scheduler 
will still perform all task launching.
   
   **Use case / motivation**
   
   We want SubDag tasks to act exactly the same as non-subdag tasks
   
   **Related Issues**
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to