[ https://issues.apache.org/jira/browse/HUDI-846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17112434#comment-17112434 ]
Balaji Varadarajan commented on HUDI-846: ----------------------------------------- Incremental cleaning is enabled by default as part of [https://github.com/apache/incubator-hudi/pull/1634/files] > Turn on incremental cleaning bu default in 0.6.0 > ------------------------------------------------ > > Key: HUDI-846 > URL: https://issues.apache.org/jira/browse/HUDI-846 > Project: Apache Hudi (incubating) > Issue Type: Sub-task > Components: Cleaner > Reporter: Balaji Varadarajan > Assignee: Balaji Varadarajan > Priority: Blocker > Labels: pull-request-available > Fix For: 0.6.0, 0.5.3 > > > Incremental cleaner will track commits that have happened since the last > clean operation to figure out partitions which needs to be scanned for > cleaning. This avoids the costly scanning of all partition paths. > Incremental cleaning is currently disabled by default. We need to enable it > by default in 0.6.0. > No special handling is required for upgrade/downgrade scenarios as > incremental cleaning relies on standard format of commit metadata -- This message was sent by Atlassian Jira (v8.3.4#803005)