amoghrajesh commented on code in PR #76918: URL: https://github.com/apache/airflow/pull/76918#discussion_r4585626085
########## providers/dbt/cloud/docs/operators.rst: ########## @@ -87,6 +87,41 @@ by providing the ``project_name``, ``environment_name``, and ``job_name``. Please note that it will only work if the above three parameters uniquely identify a job in your account (i.e. you cannot have two jobs with the same name in the same project and environment). +Durable execution +""""""""""""""""" + +On Airflow 3.3 and later, when ``wait_for_termination`` is True, the operator stores the dbt Cloud run +id in the :doc:`task state store <apache-airflow:core-concepts/task-state-store>` before it waits. If +the worker dies and the task retries, the operator checks that run instead of triggering a new one: + +* If the run is still queued, starting or running, the operator waits on it again, in deferrable mode + too. +* If the run succeeded, the operator returns its run id without triggering anything. +* If the run errored, was cancelled or no longer exists, the operator triggers a new run as before, + which respects ``retry_from_failure``. + +Clearing the task instance from the UI or the REST API discards the stored run id by default, so the Review Comment: It matches core (or will match, theres a PR open for that too). The Snowflake and Glue wording is out of date and gets fixed in #76968. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
