[jira] [Commented] (SPARK-42869) can not analyze window exp on sub query
[ https://issues.apache.org/jira/browse/SPARK-42869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713987#comment-17713987 ] GuangWeiHong commented on SPARK-42869: -- OK, thanks > can not analyze window exp on sub query > --- > > Key: SPARK-42869 > URL: https://issues.apache.org/jira/browse/SPARK-42869 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.2.1 >Reporter: GuangWeiHong >Priority: Major > Attachments: image-2023-03-20-18-00-40-578.png, > image-2023-04-17-19-06-28-069.png, image-2023-04-17-19-09-41-485.png > > > > CREATE TABLE test_noindex_table(`name` STRING,`age` INT,`city` STRING) > PARTITIONED BY (`date` STRING); > > SELECT > * > FROM > ( > SELECT *, COUNT(1) OVER itr AS grp_size > FROM test_noindex_table > WINDOW itr AS (PARTITION BY city) > ) tbl > WINDOW itr2 AS (PARTITION BY > city > ) > > Window specification itr is not defined in the WINDOW clause. > !image-2023-03-20-18-00-40-578.png|width=560,height=361! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-42869) can not analyze window exp on sub query
[ https://issues.apache.org/jira/browse/SPARK-42869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GuangWeiHong updated SPARK-42869: - Description: CREATE TABLE test_noindex_table(`name` STRING,`age` INT,`city` STRING) PARTITIONED BY (`date` STRING); SELECT * FROM ( SELECT *, COUNT(1) OVER itr AS grp_size FROM test_noindex_table WINDOW itr AS (PARTITION BY city) ) tbl WINDOW itr2 AS (PARTITION BY city ) Window specification itr is not defined in the WINDOW clause. !image-2023-03-20-18-00-40-578.png|width=560,height=361! was: SELECT * FROM ( SELECT *, COUNT(1) OVER itr AS grp_size FROM test WINDOW itr AS (PARTITION BY model) ) tbl WINDOW itr2 AS (PARTITION BY model ) Window specification itr is not defined in the WINDOW clause. !image-2023-03-20-18-00-40-578.png|width=560,height=361! > can not analyze window exp on sub query > --- > > Key: SPARK-42869 > URL: https://issues.apache.org/jira/browse/SPARK-42869 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.2.1 >Reporter: GuangWeiHong >Priority: Major > Attachments: image-2023-03-20-18-00-40-578.png > > > > CREATE TABLE test_noindex_table(`name` STRING,`age` INT,`city` STRING) > PARTITIONED BY (`date` STRING); > > SELECT > * > FROM > ( > SELECT *, COUNT(1) OVER itr AS grp_size > FROM test_noindex_table > WINDOW itr AS (PARTITION BY city) > ) tbl > WINDOW itr2 AS (PARTITION BY > city > ) > > Window specification itr is not defined in the WINDOW clause. > !image-2023-03-20-18-00-40-578.png|width=560,height=361! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-42869) can not analyze window exp on sub query
[ https://issues.apache.org/jira/browse/SPARK-42869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GuangWeiHong updated SPARK-42869: - Description: SELECT * FROM ( SELECT *, COUNT(1) OVER itr AS grp_size FROM test WINDOW itr AS (PARTITION BY model) ) tbl WINDOW itr2 AS (PARTITION BY model ) Window specification itr is not defined in the WINDOW clause. !image-2023-03-20-18-00-40-578.png|width=560,height=361! was: SELECT * FROM ( SELECT *, COUNT(1) OVER itr AS grp_size FROM test WINDOW itr AS (PARTITION BY model) ) tbl WINDOW itr2 AS (PARTITION BY model ) Window specification itr is not defined in the WINDOW clause. > can not analyze window exp on sub query > --- > > Key: SPARK-42869 > URL: https://issues.apache.org/jira/browse/SPARK-42869 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.2.1 >Reporter: GuangWeiHong >Priority: Major > Attachments: image-2023-03-20-18-00-40-578.png > > > > SELECT * FROM ( SELECT *, COUNT(1) OVER itr AS grp_size FROM test WINDOW itr > AS (PARTITION BY model) ) tbl WINDOW itr2 AS (PARTITION BY model ) > > Window specification itr is not defined in the WINDOW clause. > !image-2023-03-20-18-00-40-578.png|width=560,height=361! -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-42869) can not analyze window exp on sub query
[ https://issues.apache.org/jira/browse/SPARK-42869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GuangWeiHong updated SPARK-42869: - Attachment: image-2023-03-20-18-00-40-578.png > can not analyze window exp on sub query > --- > > Key: SPARK-42869 > URL: https://issues.apache.org/jira/browse/SPARK-42869 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 3.2.1 >Reporter: GuangWeiHong >Priority: Major > Attachments: image-2023-03-20-18-00-40-578.png > > > > SELECT * FROM ( SELECT *, COUNT(1) OVER itr AS grp_size FROM test WINDOW itr > AS (PARTITION BY model) ) tbl WINDOW itr2 AS (PARTITION BY model ) > > Window specification itr is not defined in the WINDOW clause. > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-42869) can not analyze window exp on sub query
GuangWeiHong created SPARK-42869: Summary: can not analyze window exp on sub query Key: SPARK-42869 URL: https://issues.apache.org/jira/browse/SPARK-42869 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 3.2.1 Reporter: GuangWeiHong SELECT * FROM ( SELECT *, COUNT(1) OVER itr AS grp_size FROM test WINDOW itr AS (PARTITION BY model) ) tbl WINDOW itr2 AS (PARTITION BY model ) Window specification itr is not defined in the WINDOW clause. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-25482) Fast equal can not check reuseSubquery when apply rule about ReuseSubquery
[ https://issues.apache.org/jira/browse/SPARK-25482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GuangWeiHong updated SPARK-25482: - Description: the datasource filter should be push down, so there will be two subquery on this query select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 from part) One of the subquery will apply a rule about ReuseSubquery and generate a new plan, but the new plan will be ignored by method fastEquals() and subquery will be executed two times. was: the datasource filter should be push down, so there will be two subquery on this query select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 from part) One of the subquery will apply a rule about ReuseSubquery and generate a new plan, but the new plan will ignored by method fastEquals() and subquery will be executed two times. > Fast equal can not check reuseSubquery when apply rule about ReuseSubquery > -- > > Key: SPARK-25482 > URL: https://issues.apache.org/jira/browse/SPARK-25482 > Project: Spark > Issue Type: Bug > Components: Optimizer, SQL >Affects Versions: 2.3.1 >Reporter: GuangWeiHong >Priority: Minor > > the datasource filter should be push down, so there will be two subquery on > this query > select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 > from part) > One of the subquery will apply a rule about ReuseSubquery and generate a new > plan, but the new plan will be ignored by method fastEquals() and subquery > will be executed two times. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-25482) Fast equal can not check reuseSubquery when apply rule about ReuseSubquery
[ https://issues.apache.org/jira/browse/SPARK-25482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GuangWeiHong updated SPARK-25482: - Description: the datasource filter should be push down, so there will be two subquery on this query select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 from part) One of the subquery will apply a rule about ReuseSubquery and generate a new plan, but the new plan will ignored by method fastEquals() and subquery will be executed two times. was: the datasource filter should be push down, so there will be two subquery on this query select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 from part) the opt rule about ReuseSubquery will be apply on subquery, but afterRule plan will not be found by method fastEquals() and subquery will be executed two times. > Fast equal can not check reuseSubquery when apply rule about ReuseSubquery > -- > > Key: SPARK-25482 > URL: https://issues.apache.org/jira/browse/SPARK-25482 > Project: Spark > Issue Type: Bug > Components: Optimizer, SQL >Affects Versions: 2.3.1 >Reporter: GuangWeiHong >Priority: Minor > > the datasource filter should be push down, so there will be two subquery on > this query > select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 > from part) > One of the subquery will apply a rule about ReuseSubquery and generate a new > plan, but the new plan will ignored by method fastEquals() and subquery will > be executed two times. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-25482) Fast equal can not check reuseSubquery when apply rule about ReuseSubquery
[ https://issues.apache.org/jira/browse/SPARK-25482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GuangWeiHong updated SPARK-25482: - Description: the datasource filter should be push down, so there will be two subquery on this query select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 from part) the opt rule about ReuseSubquery will be apply on subquery, but afterRule plan will not be found by method fastEquals() and subquery will be executed two times. was: the datasource filter should be push down, so there will be to subquery on this query select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 from part) the opt rule about ReuseSubquery will be apply on subquery, but afterRule plan will not be found by method fastEquals() and subquery will be executed two times. > Fast equal can not check reuseSubquery when apply rule about ReuseSubquery > -- > > Key: SPARK-25482 > URL: https://issues.apache.org/jira/browse/SPARK-25482 > Project: Spark > Issue Type: Bug > Components: Optimizer, SQL >Affects Versions: 2.3.1 >Reporter: GuangWeiHong >Priority: Minor > > the datasource filter should be push down, so there will be two subquery on > this query > select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 > from part) > the opt rule about ReuseSubquery will be apply on subquery, but afterRule > plan will not be found by method fastEquals() and subquery will be executed > two times. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-25482) Fast equal can not check reuseSubquery when apply rule about ReuseSubquery
[ https://issues.apache.org/jira/browse/SPARK-25482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GuangWeiHong updated SPARK-25482: - Description: the datasource filter should be push down, so there will be to subquery on this query select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 from part) the opt rule about ReuseSubquery will be apply on subquery, but afterRule plan will not be found by method fastEquals() and subquery will be executed two times. was: the datasource filter should be push down, so there will have to subquery on this query select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 from part) the opt rule about ReuseSubquery will be apply on subquery, but afterRule plan will not be found by method fastEquals() and subquery will be executed two times. > Fast equal can not check reuseSubquery when apply rule about ReuseSubquery > -- > > Key: SPARK-25482 > URL: https://issues.apache.org/jira/browse/SPARK-25482 > Project: Spark > Issue Type: Bug > Components: Optimizer, SQL >Affects Versions: 2.3.1 >Reporter: GuangWeiHong >Priority: Minor > > the datasource filter should be push down, so there will be to subquery on > this query > select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 > from part) > the opt rule about ReuseSubquery will be apply on subquery, but afterRule > plan will not be found by method fastEquals() and subquery will be executed > two times. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-25482) Fast equal can not check reuseSubquery when apply rule about ReuseSubquery
GuangWeiHong created SPARK-25482: Summary: Fast equal can not check reuseSubquery when apply rule about ReuseSubquery Key: SPARK-25482 URL: https://issues.apache.org/jira/browse/SPARK-25482 Project: Spark Issue Type: Bug Components: Optimizer, SQL Affects Versions: 2.3.1 Reporter: GuangWeiHong the datasource filter should be push down, so there will have to subquery on this query select count(1) from lineitem where i_partkey > (select max(p_partkey)-1000 from part) the opt rule about ReuseSubquery will be apply on subquery, but afterRule plan will not be found by method fastEquals() and subquery will be executed two times. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
