boraberke commented on PR #38868: URL: https://github.com/apache/airflow/pull/38868#issuecomment-2088750430
@Lee-W, I have tested and here how it works: When first run already uses `steps_override, schema_override, additional_run_config` and the first run is failed, rerunning it will use the same config including `steps_override, schema_override, additional_run_config`. However, if the first run with `steps_override, schema_override, additional_run_config` is finished succesfully, rerunning it does not include any of those. Thus, it does not re-uses the config of the previous run. This means in any case where the operator had failed but dbt job is successful, when try_number > 1, it would run without the `overrides`. I think it is best to raise an error if any of `steps_override, schema_override, additional_run_config` provided when `retry_from_failure` is True. I have updated this PR accordingly. Let me know what you think! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
