sigmod edited a comment on pull request #35789: URL: https://github.com/apache/spark/pull/35789#issuecomment-1064777368
> Just not sure if this is in this PR's scope: the filter could be pushed down to table scan node[1], > thus filescan is also faster. The injected filter predicate is just a `BloomFilterMightContain` expression, which is nothing special from other expressions w.r.t. pushdown-ability. Filter pushdown is achieved by existing rules. Thus, if other filter expressions can be pushed down to a data source scan, it should also work for BloomFilterMightContain. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
