[jira] [Updated] (SPARK-33846) Include Comments for StructType toDDL function

2020-12-18 Thread Jacob Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacob Kim updated SPARK-33846: -- Priority: Minor (was: Major) > Include Comments for StructType toDDL function >

[jira] [Created] (SPARK-33846) Change toDDL function

2020-12-18 Thread Jacob Kim (Jira)
Jacob Kim created SPARK-33846: - Summary: Change toDDL function Key: SPARK-33846 URL: https://issues.apache.org/jira/browse/SPARK-33846 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-33846) Include Comments for StructType toDDL function

2020-12-18 Thread Jacob Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacob Kim updated SPARK-33846: -- Summary: Include Comments for StructType toDDL function (was: Change toDDL function ) > Include

[jira] [Commented] (SPARK-33795) gapply fails execution with rbind error

2020-12-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252115#comment-17252115 ] Hyukjin Kwon commented on SPARK-33795: -- display is Databricks specific API. If it can't be

[jira] [Resolved] (SPARK-33812) splt the histogram column stats when saving to hive metastore as table property

2020-12-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33812. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30809

[jira] [Commented] (SPARK-33845) Improve SimplifyConditionals

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252106#comment-17252106 ] Apache Spark commented on SPARK-33845: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33845) Improve SimplifyConditionals

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33845: Assignee: (was: Apache Spark) > Improve SimplifyConditionals >

[jira] [Assigned] (SPARK-33845) Improve SimplifyConditionals

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33845: Assignee: Apache Spark > Improve SimplifyConditionals > - >

[jira] [Commented] (SPARK-33845) Improve SimplifyConditionals

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252101#comment-17252101 ] Apache Spark commented on SPARK-33845: -- User 'wangyum' has created a pull request for this issue:

[jira] [Created] (SPARK-33845) Improve SimplifyConditionals

2020-12-18 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33845: --- Summary: Improve SimplifyConditionals Key: SPARK-33845 URL: https://issues.apache.org/jira/browse/SPARK-33845 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-33844) InsertIntoDir failed since query column name contains ',' cause column type and column names size not equal

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252100#comment-17252100 ] Apache Spark commented on SPARK-33844: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-33844) InsertIntoDir failed since query column name contains ',' cause column type and column names size not equal

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33844: Assignee: (was: Apache Spark) > InsertIntoDir failed since query column name

[jira] [Assigned] (SPARK-33844) InsertIntoDir failed since query column name contains ',' cause column type and column names size not equal

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33844: Assignee: Apache Spark > InsertIntoDir failed since query column name contains ',' cause

[jira] [Commented] (SPARK-33844) InsertIntoDir failed since query column name contains ',' cause column type and column names size not equal

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252099#comment-17252099 ] Apache Spark commented on SPARK-33844: -- User 'AngersZh' has created a pull request for this

[jira] [Updated] (SPARK-33844) InsertIntoDir failed since query column name contains ',' cause column type and column names size not equal

2020-12-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-33844: -- Description:   After hive-2.3 we will set COLUMN_NAME_DELIMITER to special char when col name

[jira] [Created] (SPARK-33844) InsertIntoDir failed since query column name contains ',' cause column type and column names size not equal

2020-12-18 Thread angerszhu (Jira)
angerszhu created SPARK-33844: - Summary: InsertIntoDir failed since query column name contains ',' cause column type and column names size not equal Key: SPARK-33844 URL:

[jira] [Commented] (SPARK-33798) Simplify EqualTo(CaseWhen/If, Literal) always false

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252086#comment-17252086 ] Apache Spark commented on SPARK-33798: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-33798) Simplify EqualTo(CaseWhen/If, Literal) always false

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252085#comment-17252085 ] Apache Spark commented on SPARK-33798: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-33657) After spark sql is executed to generate hdfs data, the relevant status information is printed

2020-12-18 Thread Su Qilong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252064#comment-17252064 ] Su Qilong commented on SPARK-33657: --- This should be an improvement?  > After spark sql is executed

[jira] [Commented] (SPARK-33843) Upgrade to Zstd 1.4.7

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252059#comment-17252059 ] Apache Spark commented on SPARK-33843: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-33843) Upgrade to Zstd 1.4.7

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33843: Assignee: (was: Apache Spark) > Upgrade to Zstd 1.4.7 > - > >

[jira] [Assigned] (SPARK-33843) Upgrade to Zstd 1.4.7

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33843: Assignee: Apache Spark > Upgrade to Zstd 1.4.7 > - > >

[jira] [Created] (SPARK-33843) Upgrade to Zstd 1.4.7

2020-12-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-33843: - Summary: Upgrade to Zstd 1.4.7 Key: SPARK-33843 URL: https://issues.apache.org/jira/browse/SPARK-33843 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-30654) Update Docs Bootstrap to 4.4.1

2020-12-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30654: -- Component/s: (was: Documentation) Spark Core > Update Docs Bootstrap to

[jira] [Comment Edited] (SPARK-23862) Spark ExpressionEncoder should support java enum type in scala

2020-12-18 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252049#comment-17252049 ] Erik Krogen edited comment on SPARK-23862 at 12/18/20, 11:45 PM: - I'm

[jira] [Commented] (SPARK-23862) Spark ExpressionEncoder should support java enum type in scala

2020-12-18 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252049#comment-17252049 ] Erik Krogen commented on SPARK-23862: - I'm going to take up this work. > Spark ExpressionEncoder

[jira] [Updated] (SPARK-33357) Support SparkLauncher in Kubernetes

2020-12-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33357: -- Affects Version/s: (was: 3.0.1) 3.2.0 > Support SparkLauncher in

[jira] [Updated] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33841: -- Issue Type: Bug (was: Task) > Jobs disappear intermittently from the SHS under high load >

[jira] [Updated] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33841: -- Fix Version/s: 3.0.2 > Jobs disappear intermittently from the SHS under high load >

[jira] [Updated] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33841: -- Fix Version/s: 3.1.0 > Jobs disappear intermittently from the SHS under high load >

[jira] [Updated] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33841: -- Affects Version/s: 3.2.0 3.1.0 > Jobs disappear intermittently from

[jira] [Updated] (SPARK-33757) Fix the R dependencies build error on GitHub Actions and AppVeyor

2020-12-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33757: -- Issue Type: Bug (was: Improvement) > Fix the R dependencies build error on GitHub Actions

[jira] [Updated] (SPARK-33733) PullOutNondeterministic should check and collect deterministic field

2020-12-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33733: -- Issue Type: Bug (was: Improvement) > PullOutNondeterministic should check and collect

[jira] [Updated] (SPARK-33593) Vector reader got incorrect data with binary partition value

2020-12-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33593: -- Fix Version/s: 3.0.2 > Vector reader got incorrect data with binary partition value >

[jira] [Updated] (SPARK-33835) Refector AbstractCommandBuilder

2020-12-18 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-33835: Affects Version/s: (was: 3.0.0) 3.2.0 > Refector

[jira] [Resolved] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33841. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30845

[jira] [Assigned] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33841: - Assignee: Vladislav Glinskiy > Jobs disappear intermittently from the SHS under high

[jira] [Commented] (SPARK-33795) gapply fails execution with rbind error

2020-12-18 Thread MvR (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251988#comment-17251988 ] MvR commented on SPARK-33795: - [~gurwls223] I can execute the code locally on a single node cluster.

[jira] [Commented] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251969#comment-17251969 ] Apache Spark commented on SPARK-33841: -- User 'vladhlinsky' has created a pull request for this

[jira] [Commented] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Vladislav Glinskiy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251968#comment-17251968 ] Vladislav Glinskiy commented on SPARK-33841: Ok, thank you, [~dongjoon]! > Jobs disappear

[jira] [Commented] (SPARK-33599) Group exception messages in catalyst/analysis

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251953#comment-17251953 ] Apache Spark commented on SPARK-33599: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-33599) Group exception messages in catalyst/analysis

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251950#comment-17251950 ] Apache Spark commented on SPARK-33599: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251940#comment-17251940 ] Apache Spark commented on SPARK-33841: -- User 'vladhlinsky' has created a pull request for this

[jira] [Commented] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251932#comment-17251932 ] Dongjoon Hyun commented on SPARK-33841: --- Thank you for filing a JIRA, but I removed the target

[jira] [Updated] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33841: -- Target Version/s: (was: 3.0.2, 3.1.0, 3.2.0) > Jobs disappear intermittently from the SHS

[jira] [Commented] (SPARK-33833) Allow Spark Structured Streaming report Kafka Lag through Burrow

2020-12-18 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251926#comment-17251926 ] L. C. Hsieh commented on SPARK-33833: - I'm also in need of tracking the lag, but I maybe don't need

[jira] [Commented] (SPARK-33833) Allow Spark Structured Streaming report Kafka Lag through Burrow

2020-12-18 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251925#comment-17251925 ] L. C. Hsieh commented on SPARK-33833: - Hmm, as SS commits source offsets in external storage by SS

[jira] [Commented] (SPARK-33842) Add spark.shuffle.io.sessionTimeout to check a established connnection for being idled or dead

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251924#comment-17251924 ] Apache Spark commented on SPARK-33842: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33842) Add spark.shuffle.io.sessionTimeout to check a established connnection for being idled or dead

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33842: Assignee: Apache Spark > Add spark.shuffle.io.sessionTimeout to check a established

[jira] [Assigned] (SPARK-33842) Add spark.shuffle.io.sessionTimeout to check a established connnection for being idled or dead

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33842: Assignee: (was: Apache Spark) > Add spark.shuffle.io.sessionTimeout to check a

[jira] [Commented] (SPARK-33842) Add spark.shuffle.io.sessionTimeout to check a established connnection for being idled or dead

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251923#comment-17251923 ] Apache Spark commented on SPARK-33842: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Created] (SPARK-33842) Add spark.shuffle.io.sessionTimeout to check a established connnection for being idled or dead

2020-12-18 Thread Kent Yao (Jira)
Kent Yao created SPARK-33842: Summary: Add spark.shuffle.io.sessionTimeout to check a established connnection for being idled or dead Key: SPARK-33842 URL: https://issues.apache.org/jira/browse/SPARK-33842

[jira] [Commented] (SPARK-33635) Performance regression in Kafka read

2020-12-18 Thread David Wyles (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251911#comment-17251911 ] David Wyles commented on SPARK-33635: - [~gsomogyi] Just so you know, I'm still doing this. I've

[jira] [Commented] (SPARK-32976) Support column list in INSERT statement

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251847#comment-17251847 ] Apache Spark commented on SPARK-32976: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Resolved] (SPARK-33599) Group exception messages in catalyst/analysis

2020-12-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33599. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30717

[jira] [Assigned] (SPARK-33599) Group exception messages in catalyst/analysis

2020-12-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33599: --- Assignee: jiaan.geng > Group exception messages in catalyst/analysis >

[jira] [Resolved] (SPARK-33597) Support REGEXP_LIKE for consistent with mainstream databases

2020-12-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33597. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30543

[jira] [Assigned] (SPARK-33597) Support REGEXP_LIKE for consistent with mainstream databases

2020-12-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33597: --- Assignee: jiaan.geng > Support REGEXP_LIKE for consistent with mainstream databases >

[jira] [Resolved] (SPARK-33798) Simplify EqualTo(CaseWhen/If, Literal) always false

2020-12-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33798. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30790

[jira] [Assigned] (SPARK-33798) Simplify EqualTo(CaseWhen/If, Literal) always false

2020-12-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33798: --- Assignee: Yuming Wang > Simplify EqualTo(CaseWhen/If, Literal) always false >

[jira] [Commented] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251750#comment-17251750 ] Apache Spark commented on SPARK-33841: -- User 'vladhlinsky' has created a pull request for this

[jira] [Assigned] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33841: Assignee: (was: Apache Spark) > Jobs disappear intermittently from the SHS under

[jira] [Commented] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Vladislav Glinskiy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251751#comment-17251751 ] Vladislav Glinskiy commented on SPARK-33841: cc [~kabhwan] > Jobs disappear intermittently

[jira] [Assigned] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33841: Assignee: Apache Spark > Jobs disappear intermittently from the SHS under high load >

[jira] [Updated] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Vladislav Glinskiy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladislav Glinskiy updated SPARK-33841: --- Environment: SHS is running locally on Ubuntu 19.04   was: SHS is running

[jira] [Created] (SPARK-33841) Jobs disappear intermittently from the SHS under high load

2020-12-18 Thread Vladislav Glinskiy (Jira)
Vladislav Glinskiy created SPARK-33841: -- Summary: Jobs disappear intermittently from the SHS under high load Key: SPARK-33841 URL: https://issues.apache.org/jira/browse/SPARK-33841 Project: Spark

[jira] [Commented] (SPARK-28191) Data Source - State - Read side

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251727#comment-17251727 ] Apache Spark commented on SPARK-28191: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-28191) Data Source - State - Read side

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251728#comment-17251728 ] Apache Spark commented on SPARK-28191: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Resolved] (SPARK-33840) Add spark.sql.files.minPartitionNum to performence tuning doc

2020-12-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33840. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30838

[jira] [Assigned] (SPARK-33840) Add spark.sql.files.minPartitionNum to performence tuning doc

2020-12-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33840: Assignee: ulysses you > Add spark.sql.files.minPartitionNum to performence tuning doc >

[jira] [Commented] (SPARK-33593) Vector reader got incorrect data with binary partition value

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251678#comment-17251678 ] Apache Spark commented on SPARK-33593: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-33593) Vector reader got incorrect data with binary partition value

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251677#comment-17251677 ] Apache Spark commented on SPARK-33593: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-33593) Vector reader got incorrect data with binary partition value

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251655#comment-17251655 ] Apache Spark commented on SPARK-33593: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-33593) Vector reader got incorrect data with binary partition value

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251650#comment-17251650 ] Apache Spark commented on SPARK-33593: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-33840) Add spark.sql.files.minPartitionNum to performence tuning doc

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251646#comment-17251646 ] Apache Spark commented on SPARK-33840: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-33840) Add spark.sql.files.minPartitionNum to performence tuning doc

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251643#comment-17251643 ] Apache Spark commented on SPARK-33840: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-33840) Add spark.sql.files.minPartitionNum to performence tuning doc

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33840: Assignee: Apache Spark > Add spark.sql.files.minPartitionNum to performence tuning doc >

[jira] [Assigned] (SPARK-33840) Add spark.sql.files.minPartitionNum to performence tuning doc

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33840: Assignee: (was: Apache Spark) > Add spark.sql.files.minPartitionNum to performence

[jira] [Created] (SPARK-33840) Add spark.sql.files.minPartitionNum to performence tuning doc

2020-12-18 Thread ulysses you (Jira)
ulysses you created SPARK-33840: --- Summary: Add spark.sql.files.minPartitionNum to performence tuning doc Key: SPARK-33840 URL: https://issues.apache.org/jira/browse/SPARK-33840 Project: Spark

[jira] [Created] (SPARK-33839) Add updated partition path list interface into DataWritingCommand for dynamic partition insertion

2020-12-18 Thread Su Qilong (Jira)
Su Qilong created SPARK-33839: - Summary: Add updated partition path list interface into DataWritingCommand for dynamic partition insertion Key: SPARK-33839 URL: https://issues.apache.org/jira/browse/SPARK-33839

[jira] [Commented] (SPARK-33838) Add comments about `PURGE` in DropTable and in AlterTableDropPartition

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251613#comment-17251613 ] Apache Spark commented on SPARK-33838: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33838) Add comments about `PURGE` in DropTable and in AlterTableDropPartition

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251610#comment-17251610 ] Apache Spark commented on SPARK-33838: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33838) Add comments about `PURGE` in DropTable and in AlterTableDropPartition

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33838: Assignee: Apache Spark > Add comments about `PURGE` in DropTable and in

[jira] [Assigned] (SPARK-33838) Add comments about `PURGE` in DropTable and in AlterTableDropPartition

2020-12-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33838: Assignee: (was: Apache Spark) > Add comments about `PURGE` in DropTable and in

[jira] [Updated] (SPARK-33838) Add comments about `PURGE` in DropTable and in AlterTableDropPartition

2020-12-18 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33838: --- Summary: Add comments about `PURGE` in DropTable and in AlterTableDropPartition (was: Add comment

[jira] [Created] (SPARK-33838) Add comment about `PURGE` in DropTable and in AlterTableDropPartition

2020-12-18 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33838: -- Summary: Add comment about `PURGE` in DropTable and in AlterTableDropPartition Key: SPARK-33838 URL: https://issues.apache.org/jira/browse/SPARK-33838 Project: Spark

[jira] [Updated] (SPARK-33837) Correlated subquery field resolve bug when inner table has a field with the same name with outer table

2020-12-18 Thread Su Qilong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Su Qilong updated SPARK-33837: -- Description: For the following statements: {code:java} create table t1(id int, name string) create

[jira] [Created] (SPARK-33837) Correlated subquery field resolve bug when inner table has a field with the same name with outer table

2020-12-18 Thread Su Qilong (Jira)
Su Qilong created SPARK-33837: - Summary: Correlated subquery field resolve bug when inner table has a field with the same name with outer table Key: SPARK-33837 URL: https://issues.apache.org/jira/browse/SPARK-33837

[jira] [Resolved] (SPARK-33593) Vector reader got incorrect data with binary partition value

2020-12-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33593. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30824

[jira] [Assigned] (SPARK-33593) Vector reader got incorrect data with binary partition value

2020-12-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33593: - Assignee: angerszhu > Vector reader got incorrect data with binary partition value >