[jira] [Commented] (SPARK-46428) The stage that retries due to FetchFailed will cause the downstream skewJoin AQE become ineffective

2023-12-17 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17797994#comment-17797994 ] Tongwei commented on SPARK-46428: - cc [~yumwang]  > The stage that retries due to FetchFailed will

[jira] [Updated] (SPARK-46428) The stage that retries due to FetchFailed will cause the downstream skewJoin AQE become ineffective

2023-12-17 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-46428: Description: In our production environment, a SQL statement containing a Union all was executed. Due to a

[jira] [Created] (SPARK-44456) ConstantPropagation

2023-07-17 Thread Tongwei (Jira)
Tongwei created SPARK-44456: --- Summary: ConstantPropagation Key: SPARK-44456 URL: https://issues.apache.org/jira/browse/SPARK-44456 Project: Spark Issue Type: Improvement Components: SQL

[jira] [Resolved] (SPARK-44007) Unresolved hint cause query failure

2023-06-09 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei resolved SPARK-44007. - Resolution: Won't Fix > Unresolved hint cause query failure > --- > >

[jira] [Updated] (SPARK-44007) Unresolved hint cause query failure

2023-06-08 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-44007: Attachment: (was: image-2023-06-08-17-26-59-186.png) > Unresolved hint cause query failure >

[jira] [Updated] (SPARK-44007) Unresolved hint cause query failure

2023-06-08 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-44007: Description: After the Resolve Hints Rules are completed, immediately remove unknown Hints to *avoid

[jira] [Updated] (SPARK-44007) Unresolved hint cause query failure

2023-06-08 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-44007: Description: After the Resolve Hints Rules are completed, immediately remove unknown Hints to avoid

[jira] [Updated] (SPARK-44007) Unresolved hint cause query failure

2023-06-08 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-44007: Description:   {code:java} CREATE TABLE t0(c0 bigint) USING PARQUET CREATE TABLE t1(c1 bigint) USING

[jira] [Updated] (SPARK-44007) Unresolved hint cause query failure

2023-06-08 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-44007: Description:   {code:java} CREATE TABLE t0(c0 bigint) USING PARQUET CREATE TABLE t1(c1 bigint) USING

[jira] [Updated] (SPARK-44007) Unresolved hint cause query failure

2023-06-08 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-44007: Attachment: image-2023-06-08-17-26-59-186.png > Unresolved hint cause query failure >

[jira] [Updated] (SPARK-44007) Unresolved hint cause query failure

2023-06-08 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-44007: Description:   {code:java} CREATE TABLE t0(c0 bigint) USING PARQUET CREATE TABLE t1(c1 bigint) USING

[jira] [Updated] (SPARK-44007) Unresolved hint cause query failure

2023-06-08 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-44007: Affects Version/s: 3.4.0 > Unresolved hint cause query failure > --- > >

[jira] [Updated] (SPARK-44007) Unresolved hint cause query failure

2023-06-08 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-44007: Description:   {code:java} CREATE TABLE t0(c0 bigint) USING PARQUET CREATE TABLE t1(c1 bigint) USING

[jira] [Created] (SPARK-44007) Unresolved hint cause query failure

2023-06-08 Thread Tongwei (Jira)
Tongwei created SPARK-44007: --- Summary: Unresolved hint cause query failure Key: SPARK-44007 URL: https://issues.apache.org/jira/browse/SPARK-44007 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-42356) Cannot resolve orderby attributes in DISTINCT

2023-02-06 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei resolved SPARK-42356. - Resolution: Won't Fix > Cannot resolve orderby attributes in DISTINCT >

[jira] [Updated] (SPARK-42356) Cannot resolve orderby attributes in DISTINCT

2023-02-06 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-42356: Description: query: {code:java} CREATE TABLE students (name VARCHAR(64), address VARCHAR(64)) USING

[jira] [Updated] (SPARK-42356) Cannot resolve orderby attributes in DISTINCT

2023-02-06 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-42356: Description: query:   {code:java} CREATE TABLE students (name VARCHAR(64), address VARCHAR(64)) USING

[jira] [Created] (SPARK-42356) Cannot resolve orderby attributes in DISTINCT

2023-02-06 Thread Tongwei (Jira)
Tongwei created SPARK-42356: --- Summary: Cannot resolve orderby attributes in DISTINCT Key: SPARK-42356 URL: https://issues.apache.org/jira/browse/SPARK-42356 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-38173) Quoted column cannot be recognized correctly when quotedRegexColumnNames is true

2022-02-10 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-38173: Description: When spark.sql.parser.quotedRegexColumnNames=true {code:java}  SELECT `(C3)?+.+`,`C1` * C2

[jira] [Updated] (SPARK-38173) Quoted column cannot be recognized correctly when quotedRegexColumnNames is true

2022-02-10 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-38173: Description: When spark.sql.parser.quotedRegexColumnNames=true {code:java}  SELECT `(C3)?+.+`,`C1` * C2

[jira] [Updated] (SPARK-38173) Quoted column cannot be recognized correctly when quotedRegexColumnNames is true

2022-02-10 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-38173: Description: When spark.sql.parser.quotedRegexColumnNames=true {code:java}  SELECT `(C3)?+.+`,`C1` * C2

[jira] [Updated] (SPARK-38173) Quoted column cannot be recognized correctly when quotedRegexColumnNames is true

2022-02-10 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-38173: Description: When spark.sql.parser.quotedRegexColumnNames=true ```  SELECT `(C3)?+.+`,`C1` * C2 FROM

[jira] [Created] (SPARK-38173) Quoted column cannot be recognized correctly when quotedRegexColumnNames is true

2022-02-10 Thread Tongwei (Jira)
Tongwei created SPARK-38173: --- Summary: Quoted column cannot be recognized correctly when quotedRegexColumnNames is true Key: SPARK-38173 URL: https://issues.apache.org/jira/browse/SPARK-38173 Project:

[jira] [Updated] (SPARK-37519) Support Relation With LateralView

2021-12-02 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-37519: Description: {code:java} CREATE TABLE person (id INT, name STRING, age INT, class INT, address STRING);

[jira] [Updated] (SPARK-37519) Support Relation With LateralView

2021-12-02 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-37519: Description: {code:java} CREATE TABLE person (id INT, name STRING, age INT, class INT, address STRING);

[jira] [Updated] (SPARK-37519) Support Relation With LateralView

2021-12-02 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-37519: Description: ``` CREATE TABLE person (id INT, name STRING, age INT, class INT, address STRING); INSERT

[jira] [Created] (SPARK-37519) Support Relation With LateralView

2021-12-02 Thread Tongwei (Jira)
Tongwei created SPARK-37519: --- Summary: Support Relation With LateralView Key: SPARK-37519 URL: https://issues.apache.org/jira/browse/SPARK-37519 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-37131) Support use IN/EXISTS with subquery in Project/Aggregate

2021-10-27 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-37131: Description: {code:java} CREATE TABLE tbl1 (col1 INT, col2 STRING) USING PARQUET; INSERT OVERWRITE TABLE

[jira] [Updated] (SPARK-37131) Support use IN/EXISTS with subquery in Project/Aggregate

2021-10-27 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-37131: Description:     {code:java} CREATE TABLE tbl1 (col1 INT, col2 STRING) USING PARQUET; INSERT OVERWRITE

[jira] [Updated] (SPARK-37131) Support use IN/EXISTS with subquery in Project/Aggregate

2021-10-27 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-37131: Description: CREATE TABLE tbl1 (col1 INT, col2 STRING) USING PARQUET; INSERT OVERWRITE TABLE tbl1 SELECT

[jira] [Updated] (SPARK-37131) Support use IN/EXISTS with subquery in Project/Aggregate

2021-10-27 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-37131: Description: ``` CREATE TABLE tbl1 (col1 INT, col2 STRING) USING PARQUET; INSERT OVERWRITE TABLE tbl1

[jira] [Created] (SPARK-37131) Support use IN/EXISTS with subquery in Project/Aggregate

2021-10-27 Thread Tongwei (Jira)
Tongwei created SPARK-37131: --- Summary: Support use IN/EXISTS with subquery in Project/Aggregate Key: SPARK-37131 URL: https://issues.apache.org/jira/browse/SPARK-37131 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36727) Support sql overwrite a path that is also being read from when partitionOverwriteMode is dynamic

2021-09-17 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-36727: Priority: Major (was: Minor) > Support sql overwrite a path that is also being read from when >

[jira] [Updated] (SPARK-36727) Support sql overwrite a path that is also being read from when partitionOverwriteMode is dynamic

2021-09-13 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-36727: External issue URL: https://github.com/apache/spark/pull/33986 > Support sql overwrite a path that is

[jira] [Updated] (SPARK-36727) Support sql overwrite a path that is also being read from when partitionOverwriteMode is dynamic

2021-09-13 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-36727: External issue URL: (was: https://github.com/apache/spark/pull/33986) > Support sql overwrite a path

[jira] [Updated] (SPARK-36727) Support sql overwrite a path that is also being read from when partitionOverwriteMode is dynamic

2021-09-12 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-36727: Description: {code:java} // non-partitioned table overwrite CREATE TABLE tbl (col1 INT, col2 STRING)

[jira] [Updated] (SPARK-36727) Support sql overwrite a path that is also being read from when partitionOverwriteMode is dynamic

2021-09-12 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-36727: Description: {code:java} // non-partitioned table overwrite CREATE TABLE tbl (col1 INT, col2 STRING)

[jira] [Updated] (SPARK-36727) Support sql overwrite a path that is also being read from when partitionOverwriteMode is dynamic

2021-09-12 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-36727: Description: {code:java} // non-partitioned table overwrite CREATE TABLE tbl (col1 INT, col2 STRING)

[jira] [Closed] (SPARK-33648) Moving file stage failed cause dulpicated data

2021-09-12 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei closed SPARK-33648. --- > Moving file stage failed cause dulpicated data > --- > >

[jira] [Created] (SPARK-36727) Support sql overwrite a path that is also being read from when partitionOverwriteMode is dynamic

2021-09-12 Thread Tongwei (Jira)
Tongwei created SPARK-36727: --- Summary: Support sql overwrite a path that is also being read from when partitionOverwriteMode is dynamic Key: SPARK-36727 URL: https://issues.apache.org/jira/browse/SPARK-36727

[jira] [Updated] (SPARK-33648) Moving file stage failed cause dulpicated data

2020-12-03 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-33648: Summary: Moving file stage failed cause dulpicated data (was: Moving file failed cause dulpicated data

[jira] [Updated] (SPARK-33648) Moving file failed cause dulpicated data

2020-12-03 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei updated SPARK-33648: Summary: Moving file failed cause dulpicated data (was: null) > Moving file failed cause dulpicated

[jira] [Moved] (SPARK-33648) null

2020-12-03 Thread Tongwei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tongwei moved HIVE-24476 to SPARK-33648: Component/s: SQL Key: SPARK-33648 (was: HIVE-24476)