KnightChess opened a new pull request, #11608:
URL: https://github.com/apache/hudi/pull/11608

   ### Change Logs
   
   as https://github.com/apache/hudi/pull/11578 describe, current algorithm in 
some case has drawbacks, but this new algorithm also has drawbacks, so we can 
proceed based on practical considerations desgin the ut.
   
   old algorithm:
   <img width="952" alt="image" 
src="https://github.com/apache/hudi/assets/20125927/101cfedf-3a63-4f28-be20-9572adc8f5a7";>
   
   new algorithm:
   
![image](https://github.com/apache/hudi/assets/20125927/c4637dbe-1e91-4322-b3aa-020545b7e023)
   
   both of them perform bad case 
https://github.com/apache/hudi/pull/11578#issuecomment-2219339643 : partition 
values are discontinuous
   parallelism = 10, bucketNumber = 5 and partition = ["2021-01-01", 
"2021-01-03"]
   old: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
   new: [2, 2, 2, 2, 2]
   
   parallelism = 20, bucketNumber = 5 and partition = ["2021-01-01", 
"2021-01-03"]
   old: [2, 2, 2, 2, 2]
   new: [1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
   
   ### Impact
   
   none
   
   ### Risk level (write none, low medium or high below)
   
   low
   
   ### Documentation Update
   
   none
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's 
guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [ ] Change Logs and Impact were stated clearly
   - [ ] Adequate tests were added if applicable
   - [ ] CI passed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to