liangjie3138 opened a new pull request, #10318:
URL: https://github.com/apache/paimon/pull/10318

   ### Purpose
   
   Fix overlapping ranges in Flink `RangeShuffle` when sampling boundaries 
contain duplicate values. Assign non-boundary keys deterministically while 
preserving random distribution for equal keys to avoid data skew.
   
   ### Tests
   
   Added parameterized operator tests in `RangeShuffleTest` to verify that:
   
   - Keys below, between, and above repeated boundaries always enter the 
correct range.
   - Keys equal to repeated boundaries stay within the corresponding range 
group.
   - All-identical boundaries, distinct boundaries, and empty boundaries are 
handled correctly.
   - Each input record is emitted once with its key and payload preserved


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to