cshuo opened a new pull request, #19518:
URL: https://github.com/apache/hudi/pull/19518

   ### Describe the issue this Pull Request addresses
   
   Closes #19517.
   
   With Flink bucket bulk inserts under non-blocking concurrency control 
(NBCC), fixed bucket file IDs can repeat across partitions. Sorting and caching 
write handles only by file ID can therefore mix records from different 
partitions or reuse the wrong handle.
   
   ### Summary and Changelog
   
   - Include the partition path in regular and LSM bucket internal sort rows 
only when NBCC is enabled, and sort by the partition-aware file group identity.
   - Cache NBCC write handles by `HoodieFileGroupId` while retaining the 
existing file-ID-only path for non-NBCC writes.
   - Add regression coverage for both sorted and unsorted NBCC bucket bulk 
inserts with identical file IDs across partitions.
   
   ### Impact
   
   This change affects only Flink bucket bulk inserts using NBCC. It introduces 
no public API or configuration changes. Non-NBCC row schemas, sort keys, and 
handle lookup behavior remain unchanged, avoiding additional overhead on 
existing paths; NBCC sort rows carry one additional partition-path field.
   
   ### Risk Level
   
   Low. The behavior change is scoped to NBCC bucket bulk inserts and is 
covered by a parameterized regression test for sorted and unsorted input.
   
   ### Documentation Update
   
   None.
   
   ### Contributor's checklist
   
   - [ ] Read through [contributor's 
guide](https://hudi.apache.org/contribute/how-to-contribute)
   - [x] Enough context is provided in the sections above
   - [x] Adequate tests were added if applicable
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to