ArnavBalyan opened a new pull request, #9193:
URL: https://github.com/apache/paimon/pull/9193
### Purpose
- Dynamic bucket assigners track the maximum bucket ID across all partitions.
- Once one partition reaches `dynamic-bucket.max-buckets`, new partitions
incorrectly - cannot create their remaining buckets and send all rows to the
first available bucket. (this is incorrect and causes skew)
- Track bucket upper bound for each partition so every partition can
independently allocate its available buckets instead of having a global counter.
### Tests
- UT
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
