usberkeley opened a new pull request, #11924: URL: https://github.com/apache/hudi/pull/11924
### Change Logs Implement efficient streaming reads for HoodieDataBlocks. This feature currently only supports AvroDataBlock. ### Impact Streaming reading of DataBlock enables concurrent reading of DataBlock, reduces memory usage, decreases the likelihood of timeouts when reading from HDFS, and reduces the probability of out-of-memory (OOM) errors. Future support will be provided for merge algorithms such as Merge Sort. ### Risk level (write none, low medium or high below) medium ### Documentation Update none ### Contributor's checklist - [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [x] Change Logs and Impact were stated clearly - [x] Adequate tests were added if applicable - [x] CI passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
