Subham-KRLX commented on issue #67178: URL: https://github.com/apache/airflow/issues/67178#issuecomment-4494399362
I looked into this bug and found out why the EMR tasks are failing randomly the problem is that our AWS waiter fails immediately when it gets a throttling error from the API to fix this I will make the waiter ignore these temporary API throttling errors and keep retrying It will still fail right away for real errors like wrong permissions so that is safe. I am working on this fix right now and will open a pull request soon to solve it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
