Dandandan commented on PR #15697: URL: https://github.com/apache/datafusion/pull/15697#issuecomment-2803470520
> I am am thinking that the topk filter pushdown will already filter out rows that are known not to be in the topK Yes, in those cases it might not be adding somethingbut it is still useful in the following cases: * Filter pushdown not enabled (this is not yet default) * Stats not enabled or not in useful distribution to allow effective pruning * Non Parquet sources * TopK on a plan that doesn't allow pushing down the filter to a source (i.e. most plans involving aggregate, joins, ...) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
