bvaradar commented on a change in pull request #1870:
URL: https://github.com/apache/hudi/pull/1870#discussion_r467524645
##########
File path:
hudi-client/src/main/java/org/apache/hudi/table/action/clean/CleanActionExecutor.java
##########
@@ -116,6 +119,19 @@ HoodieCleanerPlan requestClean(JavaSparkContext jsc) {
PartitionCleanStat partitionCleanStat =
partitionCleanStatMap.get(partitionPath);
partitionCleanStat.addDeleteFilePatterns(deletePath.getName());
partitionCleanStat.addDeletedFileResult(deletePath.getName(),
deletedFileResult);
+
+ // If CleanBootstrapSourceFileEnabled and it is a metadata bootstrap
commit, also delete the corresponding source file
+ if (cleanBootstrapSourceFileEnabled && !FSUtils.isLogFile(deletePath)
+ &&
FSUtils.getCommitTime(delFileName).equals(HoodieTimeline.METADATA_BOOTSTRAP_INSTANT_TS))
{
+ Option<HoodieBaseFile> baseFile =
fileSystemView.getBaseFileOn(partitionPath,
Review comment:
@zhedoubushishi : Please also note that for ensuring backwards
compatibility, I add a migrator class (CleanPlanMigrator.java) to handle pre
and post 0.6 .clean.requested files.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
