[
https://issues.apache.org/jira/browse/AIRFLOW-5231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941199#comment-16941199
]
jack commented on AIRFLOW-5231:
-------------------------------
In luigi it was solved with loop deleting 1000 files each time
[https://github.com/spotify/luigi/pull/2529]
[~feluelle] maybe you would be interested in this
> S3Hook delete fails with over 1000 keys
> ---------------------------------------
>
> Key: AIRFLOW-5231
> URL: https://issues.apache.org/jira/browse/AIRFLOW-5231
> Project: Apache Airflow
> Issue Type: Bug
> Components: aws, hooks
> Affects Versions: 2.0.0
> Reporter: Silviu Tantos
> Priority: Major
>
> Error raised:
> {noformat}
> botocore.exceptions.ClientError: An error occurred (MalformedXML) when
> calling the DeleteObjects operation: The XML you provided was not well-formed
> or did not validate against our published schema{noformat}
> See also: https://github.com/spotify/luigi/issues/2511
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
