[ https://issues.apache.org/jira/browse/SPARK-25482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
GuangWeiHong updated SPARK-25482: --------------------------------- Description: the datasource filter should be push down, so there will be to subquery on this query select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 from part) the opt rule about ReuseSubquery will be apply on subquery, but afterRule plan will not be found by method fastEquals() and subquery will be executed two times. was: the datasource filter should be push down, so there will have to subquery on this query select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 from part) the opt rule about ReuseSubquery will be apply on subquery, but afterRule plan will not be found by method fastEquals() and subquery will be executed two times. > Fast equal can not check reuseSubquery when apply rule about ReuseSubquery > -------------------------------------------------------------------------- > > Key: SPARK-25482 > URL: https://issues.apache.org/jira/browse/SPARK-25482 > Project: Spark > Issue Type: Bug > Components: Optimizer, SQL > Affects Versions: 2.3.1 > Reporter: GuangWeiHong > Priority: Minor > > the datasource filter should be push down, so there will be to subquery on > this query > select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 > from part) > the opt rule about ReuseSubquery will be apply on subquery, but afterRule > plan will not be found by method fastEquals() and subquery will be executed > two times. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org