leaves12138 opened a new pull request, #9194: URL: https://github.com/apache/paimon/pull/9194
### Purpose Extract manifest Avro writing from `ManifestFile` into a dedicated writer and provide the encoded-record / raw-block writing primitives required by subsequent manifest compaction optimizations. ### Changes - add `AvroBlockWriter` for normal rows, encoded Avro records, and compressed Avro blocks - add `ManifestAvroWriter` with rolling, manifest statistics, row-id statistics, and abort cleanup - migrate regular manifest writes, external-sort output, manifest merging, and fixed-path manifest rewriting to the unified writer - remove the duplicated writer implementation nested in `ManifestFile` - add coverage for writing a manifest to an explicit path This PR only introduces and adopts the writer infrastructure. It does not include the run-merge sorting algorithm. ### Tests - `mvn -pl paimon-core,paimon-flink/paimon-flink-common -am -DskipTests compile` - `mvn -pl paimon-core -am -DskipITs -Dtest=ManifestFileTest,ManifestFileMetaTest -Dsurefire.failIfNoSpecifiedTests=false test` - `~/bin/check` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
