JingsongLi opened a new pull request, #8992:
URL: https://github.com/apache/paimon/pull/8992

   ### Purpose
   
   Postpone fixed-bucket batch writes currently fabricate a replacement table, 
bypass bucket validation through implementation casts, and reconstruct commit 
messages in Spark and Flink. This makes the engine integrations depend on 
internal implementation details and risks the writer and router using different 
bucket counts.
   
   This change introduces a dedicated Core write path for postpone fixed-bucket 
writes:
   
   - Add `PostponeFixedBucketWriteBuilder` and expose it from `FileStoreTable`.
   - Carry the runtime total bucket count through `FileStoreWrite`, validate 
it, and produce correct commit messages directly.
   - Migrate Spark and Flink to the shared builder/write contract, removing 
table swaps, deep casts, ignored checks, and commit-message rewrites.
   - Keep Flink routing consistent with 
`postpone.batch-write-fixed-bucket.max-parallelism`.
   
   ### Tests
   
   - `PrimaryKeySimpleTableTest#testPostponeFixedBucketWriteBuilder`
   - `PostponeFixedBucketChannelComputerTest`
   - Relevant postpone fixed-bucket methods in `StoreCompactOperatorTest`
   - Full `PostponeBucketTableTest` with Spark 3
   - Core, Flink common, and Spark common compile
   - Spotless checks for all affected modules
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to