fatemehp commented on issue #37559: URL: https://github.com/apache/arrow/issues/37559#issuecomment-1710963655
+1 to implementing the most basic building blocks first. The building blocks here seem to be: (1) The ability to express and push down a filter to the parquet reader. (2) The ability to evaluate a filter in the parquet reader and return matching rows. We need to also have the option of returning the matching row ranges. Consider this query: SELECT A, B, C FROM t WHERE A = 10. We want to first read A and find the matching rows. Then we want to use that to skip non-matching rows for B, C. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
