JingsongLi opened a new pull request, #8329: URL: https://github.com/apache/paimon/pull/8329
## Summary Support manifest sort rewrite for data evolution tables by using RowID-aware sort keys. Partitioned data evolution tables sort entries by partition first, then RowID range, while non-partitioned tables sort directly by RowID. ## Changes - Add a manifest sort key abstraction so existing partition sorting and data evolution RowID sorting share the same compaction flow. - Route non-partitioned data evolution manifests with complete RowID stats through sort compaction. - Order data evolution manifest entries by partition, first RowID, RowID range end, and descending max sequence number for duplicate RowID ranges. - Allow manifest sort validation for data evolution tables without partition keys. - Add tests for partitioned and non-partitioned data evolution manifest sorting. ## Testing - [x] mvn -pl paimon-core -am -Pfast-build -DfailIfNoTests=false -Dtest=ManifestFileMetaTest#testDataEvolutionManifestSortByPartitionAndRowId,NoPartitionManifestFileMetaTest#testDataEvolutionManifestSortByRowId,SchemaValidationTest#testManifestSortValidation test - [x] mvn -pl paimon-core -am -DskipTests compile - [x] git diff --check ## Notes No migration required. If any manifest lacks RowID stats, data evolution sorting falls back to the existing non-RowID path. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
