yihua opened a new pull request, #10717: URL: https://github.com/apache/hudi/pull/10717
### Change Logs This PR adds the replication and block size information to `StoragePathInfo` so that it is backward compatible for generating `FileStatus` and Hive's `FileInputFormat` to properly generate splits based on the block size. Hive's relevant logic is mentioned below. Without this change, Hive's input format generates a huge number of splits with size 1, without block size (0), causing performance regression. <img width="820" alt="Screenshot 2024-02-20 at 12 15 53" src="https://github.com/apache/hudi/assets/2497195/5b96caab-d5ca-4de4-913f-0ca53a014f43";> This fixes the test issue in the integration of `HoodieStorage` abstraction, which can be found in #10591. ### Impact Fixes backward compatibility in `HoodieStorage` abstraction. ### Risk level low ### Documentation Update N/A ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [ ] Change Logs and Impact were stated clearly - [ ] Adequate tests were added if applicable - [ ] CI passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
