discivigour opened a new pull request, #8357:
URL: https://github.com/apache/paimon/pull/8357

   ### Purpose
   
   Improve manifest file sort compaction to avoid heap-heavy in-memory sorting 
for large manifest entries by introducing spillable external sorting. The 
change also propagates a Paimon IOManager through commit paths so manifest sort 
can use configured spill directories in Flink, while non-Flink/default contexts 
can keep IOManager creation local to the sorter.
   
   ### Tests
   
   - mvn -pl paimon-core -Pfast-build 
-Dtest=ManifestFileMetaTest#testManifestSortUsesExternalIOManagerWithoutClosingIt
 test
   - mvn -pl paimon-flink/paimon-flink-common -am -Pfast-build -DskipTests 
compile
   - mvn -pl paimon-core,paimon-flink/paimon-flink-common -am -Pfast-build 
-DfailIfNoTests=false -Dtest=CommitterOperatorTest test
   - mvn -pl paimon-core,paimon-flink/paimon-flink-common -am -Pfast-build 
-DfailIfNoTests=false -Dtest=StoreMultiCommitterTest test


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to