yihua opened a new pull request, #7402: URL: https://github.com/apache/hudi/pull/7402
### Change Logs This PR adds a new bulk insert sort mode, `PARTITION_PATH_REDISTRIBUTE`, which does the following - For a physically partitioned table, repartition the input records based on the partition path, limiting the shuffle parallelism to specified `outputSparkPartitions` - For a physically non-partitioned table, simply does coalesce for the input rows with `outputSparkPartitions` New unit tests are added to verify the added functionality. ### Impact This PR adds a new bulk insert sort mode. Existing sort modes are not affected. ### Risk level none ### Documentation Update This PR revises docs for `hoodie.bulkinsert.sort.mode` in `HoodieWriteConfig`. ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [ ] Change Logs and Impact were stated clearly - [ ] Adequate tests were added if applicable - [ ] CI passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
