SteNicholas opened a new pull request, #6792:
URL: https://github.com/apache/hudi/pull/6792

   ### Change Logs
   
   Managed memory weight should be set when sort clustering is enabled, 
otherwise the fraction of memory to allocate is 0 that throws the following 
exception when initialzing the sorter.
   
   - Sets the managed memory weight when sort clustering is enabled in 
Pipelines#cluster()
   - Initializes the `BinaryExternalSorter` in 
`ClusteringOperator#doClustering()`.
   
   ### Impact
   
   When sort clustering is enabled, the `ClusteringOperator` could initialize 
the `BinaryExternalSorter`.
   
   **Risk level: none | low | medium | high**
   
   high.
   
   - Introduces the `testWriteCopyOnWriteWithSortClustering` in 
`ITTestDataStreamWrite` to verify whether the sort clustering could work 
normally.
   
   ### Contributor's checklist
   
   - [x] Read through [contributor's 
guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [x] Change Logs and Impact were stated clearly
   - [x] Adequate tests were added if applicable
   - [x] CI passed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to