giftbowen opened a new pull request, #6830: URL: https://github.com/apache/hudi/pull/6830
### Change Logs Skip checking corrupt log blocks for transactional write file systems ### Impact - The benchmark results show corrupted block check could be 100's of msecs for larger file sizes. - This change would boost block read of 100's of ms per block. **Risk level: low** - Only turned on S3 and GCS for this feature, those for sure supports transactional write. - For other file systems, there's no change. ### Documentation Update It can be considered a small feature, probably worth mentioning that for cloud storage with transactional write support, there're certain optimization around it. ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [ ] Change Logs and Impact were stated clearly - [ ] Adequate tests were added if applicable - [ ] CI passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
