codope commented on issue #6024: URL: https://github.com/apache/hudi/issues/6024#issuecomment-1204896178
@Gatsby-Lee You mentioned > since it will raise an exception, you have to wrap the Spark Write. What exception did you get? I ran a test locally and tried to delete a non-existing partition. The `replacecommit` due to DELETE_PARTITION succeeded in my case (though it did not delete any data). Though it sounds counter-intuitive and one would expect to fail fast in such scenarios, but we do not do so because detecting non-existing partitions require listing which is a costly operation. Instead, from 0.11.0 onwards, the partitions are [lazily deleted](https://github.com/apache/hudi/pull/4489) by the cleaner. If a partition does not exist, then even though the DELETE_PARTITION operation will succeed, nothing will be deleted and no extra metadata folder will be created. Can you please try again after upgrading to version 0.11.1 ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
