alamb commented on issue #3463: URL: https://github.com/apache/arrow-datafusion/issues/3463#issuecomment-1418150220
@Dandandan ❤️ thank you I know of three major items: 1. Enable page index by default https://github.com/apache/arrow-datafusion/issues/4085 2. Ensure that enabling filter pushdown by default doesn't cause performance regressions in cases where the filter isn't very selective. I know @tustvold had some thoughts in this area. For item 1, I tried a few times, but am currently blocked by https://github.com/apache/arrow-datafusion/issues/5104 and haven't had time to return to it For item 2, I think someone needs to look at some benchmark results (perhaps TPCH) and figure out what we can do to avoid the regression (or measure and determine it isn't significant) I keep hoping to have time to work on item 1, as I am pretty sure I know what the problem is, but other things keep coming up :( I haven't had a chance to work on 2 yet -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
