Zouxxyy opened a new pull request, #9017:
URL: https://github.com/apache/paimon/pull/9017

   ### Purpose
   
   - Stage fixed-bucket writes for postpone bucket tables in uncommitted bucket 
-2 files, then derive per-partition bucket counts from staged `DataFileMeta` 
statistics.
   - Round inferred bucket counts up to powers of two and rescale only 
overloaded existing layouts, supporting different target bucket counts per 
partition.
   - Keep the staged fixed-bucket flow on Spark DataSource V1 while leaving 
ordinary DataSource V2 postpone writes unchanged.
   - Reuse the existing postpone scan split-merging logic and preserve 
overwrite, commit, abort, and cleanup semantics.
   
   ### Tests
   
   - `mvn -pl paimon-core -am -Pspark3,fast-build -DfailIfNoTests=false 
-DwildcardSuites=none -Dtest=PostponeUtilsTest test`
   - `mvn -pl paimon-spark/paimon-spark-3.5 -Pspark3,fast-build -DskipITs 
-Dsuites=org.apache.paimon.spark.sql.PostponeBucketTableTest scalatest:test`
   - `mvn -pl paimon-spark/paimon-spark-3.5 -am -Pspark3,fast-build -DskipTests 
clean install`
   - `mvn spotless:check -Pspark3`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to