ferruzzi opened a new pull request, #31192: URL: https://github.com/apache/airflow/pull/31192
**Overview** `delete_bucket` requires that the bucket is empty before it can be deleted but does not provide a convenient `empty_bucket` method. We have found that on some edge cases, an API call might write logs or artifacts to the S3 bucket with a delay, which causes the delete_bucket task to fail if the object was added while we were iterating the list of objects. This PR attempts to ensure all objects are actually deleted by retrying (up to N times) until no objects remain before trying to delete the bucket. @o-nikolas , @vincbeck , @vandonr-amz - This is the PR we discussed yesterday. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
