[ https://issues.apache.org/jira/browse/HUDI-846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Balaji Varadarajan updated HUDI-846: ------------------------------------ Status: In Progress (was: Open) > Turn on incremental cleaning bu default in 0.6.0 > ------------------------------------------------ > > Key: HUDI-846 > URL: https://issues.apache.org/jira/browse/HUDI-846 > Project: Apache Hudi (incubating) > Issue Type: Sub-task > Components: Cleaner > Reporter: Balaji Varadarajan > Assignee: Balaji Varadarajan > Priority: Blocker > Labels: pull-request-available > Fix For: 0.6.0, 0.5.3 > > > Incremental cleaner will track commits that have happened since the last > clean operation to figure out partitions which needs to be scanned for > cleaning. This avoids the costly scanning of all partition paths. > Incremental cleaning is currently disabled by default. We need to enable it > by default in 0.6.0. > No special handling is required for upgrade/downgrade scenarios as > incremental cleaning relies on standard format of commit metadata -- This message was sent by Atlassian Jira (v8.3.4#803005)