vincbeck commented on PR #69524: URL: https://github.com/apache/airflow/pull/69524#issuecomment-4904549621
Good topic, this inconsistency across operators has always bothered me. I am on the side of: - `wait_for_completion` configures whether you want to wait (regardless of the mode) - `deferrable` configures whether you want to use the triggerer to wait or the worker So I agree `wait_for_completion=False` and `deferrable=True` seems to not making a lot of sense, BUT, actually I think it is, what happens if an environment set `AIRFLOW__OPERATORS__DEFAULT_DEFERRABLE` to `True`? Every operator with `wait_for_completion=False` would receive a warning? I also know that some operators decide to wait solely based on the value of `deferrable` which I think is wrong, because again, if `AIRFLOW__OPERATORS__DEFAULT_DEFERRABLE` is set to `True` on the environment level, it makes wait all operators. WDYT? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
