AlexSingle commented on issue #61208:
URL: https://github.com/apache/airflow/issues/61208#issuecomment-3818268486
My production DAG is really complex, basically i have a process, that reads
a json config and generates full dag with task groups and dependencies. I tried
to create a simplified example, but it worked correctly. Example was like this
group_a
task_a1
task_a2
task_a3
sensor_a4
task_a4
task_a1 -> task_a2
task_a1 -> task_a3
sensor_a4 -> task_a4
task_a3 -> task_a4
group_b
sensor_b1
task_b1
task_b2
sensor_b1 -> task_b1
group_c
task_c1
task_c2
task_a4 -> task_c1
task_c1 -> task_c2
task_b2 -> task_c2
group_d
sensor_d1
task_d1
task_d2
task_d3
task_d4
sensor_d1 -> task_d1
task_d1 -> task_d2
task_d1 -> task_d2
task_d2 -> task_d4
task_d3 -> task_d4
group_e
task_e1
task_e2
task_d4 -> task_e1
task_d4 -> task_e2
group_f
task_f1
task_e2 -> task_f1
task_c1 -> task_f1
group_g
task_g1
sensor_g2
task_g2
task_g3
task_e2 -> task_g1
task_c1 -> task_g1
sensor_g2 -> task_g2
task_c1 -> task_g2
and I deleted group_c and all tasks.
This is the first time I've encountered this error, so maybe I'm missing
something. But before, I could simply add and remove any tasks and everything
worked fine. Perhaps if I need to remove something in the future, I can create
a more accurate example.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
