mingmwang commented on PR #4923: URL: https://github.com/apache/arrow-datafusion/pull/4923#issuecomment-1386818233
@ygf11 BTW, just let you know that SparkSQL also had some issues within the InferFilters and Filter push down logic, the LeftSemi/LeftAnti/IN_EXISTS Subquery push down logic is not consistent. You can have a try. ```sql -- left semi join, t2.id filter push down, t1 filter push down explain extended SELECT t1.id, t1.name FROM t1 LEFT SEMI JOIN t2 ON (t1.id = t2.id and t2.id > 11); -- left semi join, t1 filter push down, t2.id filter not push down ??? explain extended SELECT t1.id, t1.name FROM t1 WHERE EXISTS (SELECT 1 FROM t2 WHERE t1.id = t2.id and t1.id > 11); -- left semi join, t2.id filter push down, t1 filter not push down ??? explain extended SELECT t1.id, t1.name FROM t1 WHERE EXISTS (SELECT 1 FROM t2 WHERE t1.id = t2.id and t2.id > 11); ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
