o-nikolas commented on issue #21711: URL: https://github.com/apache/airflow/issues/21711#issuecomment-1275507844
A fairly common recipe is to handle the `ThrottlingException` in situations like this. So the `list_processing_jobs` (or more specifically the `_list_request` helper`) can catch that exception when it's exhausted the quota, and then sleep for a second or two and then continue another burst of requests. This way we don't drop existing functionality and the code remains backwards compatible. We've been a bit heavy-handed with deprecations and breaking changes in the Amazon Provider package as of late. WDYT @vincbeck, @eladkal, @ferruzzi -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
