alexeykudinkin commented on issue #6758: URL: https://github.com/apache/hudi/issues/6758#issuecomment-1258624704
@Zhangshunyu as @yihua already called out we approach partition-based filtering differently in MT leveraging HFile, which is (sorted) key-value based format allowing to do faster lookups based on the key's prefix, which allows us to only scan a portion of the Column Stats Index when we look it up for particular partition(s) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
