roachlord commented on issue #7934:
URL: https://github.com/apache/airflow/issues/7934#issuecomment-617738964
We have a use case for more flexible trigger_rules -
We have task (C) with two upstream processes (A & B)
A (required) -> C
B (optional) -> C (apologies for the poor diagram)
one of the upstream processes (B) is optional and allowed to fail. The other
task (A) *must* succeed for C to run successfully. We can set task C's
trigger_rule to `all_done` or `one_success` but this lessens the strict
criteria of task C that A must succeed.
We believe we can achieve this behavior by adding an additional
DummyOperators into the dag but this seems unsatisfactory. For example -
A (required) -> C
B (optional) -> D -> C
Where D is a DummyOperator with trigger rule = `all_done` and task C has
trigger_rule `all_success`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
