awildturtok edited a comment on issue #19469: URL: https://github.com/apache/airflow/issues/19469#issuecomment-965041215
It seems to me that retries and rescheduling are not compatible. How would we implement a logic that Reschedules 5 times? The specific use case is that a database we are using has spurious problems with contention that cannot be disambiguated from actual problems with our query from the error message. (sum of all queries > capacity vs single query > capacity) and backing of should ameliorate the first while the latter is an error on our side, which should fail the task We also thought about failing over into a pool of size one, but the DAG and logic would be quite odd (ie twice the same nodes with an intentional bottleneck in-between, but `A'` only runs when `A` failed with a specific error 🤕 ) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
