lilei1128 opened a new pull request, #7537:
URL: https://github.com/apache/paimon/pull/7537
### Purpose
Add a new option `compaction.skip-expired-partitions` (default: false)
that allows the Flink compaction job to skip partitions already expired
under the `values-time` partition expiration strategy, avoiding
unnecessary compaction work on soon-to-be-deleted dataPlease continue.
- Add CoreOptions.COMPACTION_SKIP_EXPIRED_PARTITIONS config option
- Filter expired partitions in CompactorSourceBuilder.build() when the
option enabled.
Close #7531
### Tests
- Add testSkipExpiredPartitions, testNotSkipExpiredPartitionsByDefault
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
