hudi-bot opened a new issue, #17082: URL: https://github.com/apache/hudi/issues/17082
FG reader does not support point lookup by default. So after integration with MDT, there is a behavior difference caused. 1. LogScanner allows on-demand read for Hfile data block only (not for Avro, Parquet); in which case the keys are pushed down into native hfile reader that filters records during the internal scan. FG reader uses full-scan by default, which means hfile reader iterates all records, and does filtering outside of the native hfile reader. 2. LogScanner enables point lookup for all partitoins but Files partition. FG reader does not allow on-demand for all partitions. Therefore, we should fix this behavior change. ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-9581 - Type: New Feature - Fix version(s): - 1.1.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
