alamb commented on issue #23263: URL: https://github.com/apache/datafusion/issues/23263#issuecomment-4903068435
I don't understand what this ticket is proposing As @zhuqi-lucas points out, we know that enabling filter_pushdown for Q23 makes it go a lot faster (due to the late materialization you are pointing out). I think this epic is tracking - https://github.com/apache/datafusion/issues/20324 While the flag is called "filter_pushdown" in my mind it is really a form of late materialization (within the parquet reader -- @hhhizzz wrote a blog about this: https://arrow.apache.org/blog/2025/12/11/parquet-late-materialization-deep-dive/ So if you want to help figure out ways to get filter_pushdown on for real, that sounds like a great idea -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
