zhangyue19921010 commented on PR #12601: URL: https://github.com/apache/hudi/pull/12601#issuecomment-2581604354
Hi @TheR1sing3un ， Thanks for your attention. > @zhangyue19921010 Hi, judging from the rfc content, the goal this time is to use incremental `compaction` and `clustering`. Should we consider incorporating the incremental processing logic for `clean` as well? Sure thing we can build a unified incremental policy. But as we know, clean action is not a Strategy-Coding-Style-Action, even though we have many different cleaning strategies(clean by commits or clean by versions). So that we may need to reconstruct the clean plan phase and abstract it into different strategy objects. We can do it in the next PR. > By the way, whether we can solve this problem: #11647 , it seems that we can solve it at the time of implementation. Unfortunately, this PR shouldn't solve the problem. This PR solves the problem of incremental processing, that is, how to process only incremental partitions next time after the last table service is completed. #11647 focuses on how to trigger the first action in an elegant way -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
