[jira] [Commented] (SPARK-31732) Disable some flaky tests temporarily

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250148#comment-17250148 ] Apache Spark commented on SPARK-31732: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-31732) Disable some flaky tests temporarily

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250147#comment-17250147 ] Apache Spark commented on SPARK-31732: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-33802) Recover PySpark coverage in spark-master-test-sbt-hadoop-3.2 Jenkins job

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250143#comment-17250143 ] Apache Spark commented on SPARK-33802: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-33802) Recover PySpark coverage in spark-master-test-sbt-hadoop-3.2 Jenkins job

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33802: Assignee: Apache Spark > Recover PySpark coverage in spark-master-test-sbt-hadoop-3.2

[jira] [Commented] (SPARK-33802) Recover PySpark coverage in spark-master-test-sbt-hadoop-3.2 Jenkins job

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250142#comment-17250142 ] Apache Spark commented on SPARK-33802: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-33802) Recover PySpark coverage in spark-master-test-sbt-hadoop-3.2 Jenkins job

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33802: Assignee: (was: Apache Spark) > Recover PySpark coverage in

[jira] [Updated] (SPARK-33802) Recover PySpark coverage in spark-master-test-sbt-hadoop-3.2 Jenkins job

2020-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33802: - Issue Type: Bug (was: Improvement) > Recover PySpark coverage in

[jira] [Created] (SPARK-33802) Recover PySpark coverage in spark-master-test-sbt-hadoop-3.2 Jenkins job

2020-12-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-33802: Summary: Recover PySpark coverage in spark-master-test-sbt-hadoop-3.2 Jenkins job Key: SPARK-33802 URL: https://issues.apache.org/jira/browse/SPARK-33802 Project:

[jira] [Commented] (SPARK-33799) ExecutorMonitor should handle SparkListenerExecutorExcluded/SparkListenerNodeExcluded

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250141#comment-17250141 ] Apache Spark commented on SPARK-33799: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Created] (SPARK-33801) Cleanup "Unicode escapes in triple quoted strings are deprecated" compilation warnings

2020-12-15 Thread Yang Jie (Jira)
Yang Jie created SPARK-33801: Summary: Cleanup "Unicode escapes in triple quoted strings are deprecated" compilation warnings Key: SPARK-33801 URL: https://issues.apache.org/jira/browse/SPARK-33801

[jira] [Assigned] (SPARK-33799) ExecutorMonitor should handle SparkListenerExecutorExcluded/SparkListenerNodeExcluded

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33799: Assignee: (was: Apache Spark) > ExecutorMonitor should handle >

[jira] [Assigned] (SPARK-33799) ExecutorMonitor should handle SparkListenerExecutorExcluded/SparkListenerNodeExcluded

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33799: Assignee: Apache Spark > ExecutorMonitor should handle >

[jira] [Assigned] (SPARK-33800) Remove command name in AnalysisException message when a relation is not resolved

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33800: Assignee: (was: Apache Spark) > Remove command name in AnalysisException message

[jira] [Commented] (SPARK-33800) Remove command name in AnalysisException message when a relation is not resolved

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250133#comment-17250133 ] Apache Spark commented on SPARK-33800: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33800) Remove command name in AnalysisException message when a relation is not resolved

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33800: Assignee: Apache Spark > Remove command name in AnalysisException message when a

[jira] [Created] (SPARK-33800) Remove command name in AnalysisException when a relation is not resolved

2020-12-15 Thread Terry Kim (Jira)
Terry Kim created SPARK-33800: - Summary: Remove command name in AnalysisException when a relation is not resolved Key: SPARK-33800 URL: https://issues.apache.org/jira/browse/SPARK-33800 Project: Spark

[jira] [Updated] (SPARK-33800) Remove command name in AnalysisException message when a relation is not resolved

2020-12-15 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-33800: -- Summary: Remove command name in AnalysisException message when a relation is not resolved (was:

[jira] [Commented] (SPARK-33786) Cache's storage level is not respected when a table name is altered.

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250128#comment-17250128 ] Apache Spark commented on SPARK-33786: -- User 'imback82' has created a pull request for this issue:

[jira] [Resolved] (SPARK-33786) Cache's storage level is not respected when a table name is altered.

2020-12-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33786. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30774

[jira] [Assigned] (SPARK-33786) Cache's storage level is not respected when a table name is altered.

2020-12-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33786: --- Assignee: Terry Kim > Cache's storage level is not respected when a table name is altered.

[jira] [Created] (SPARK-33799) ExecutorMonitor should handle SparkListenerExecutorExcluded/SparkListenerNodeExcluded

2020-12-15 Thread wuyi (Jira)
wuyi created SPARK-33799: Summary: ExecutorMonitor should handle SparkListenerExecutorExcluded/SparkListenerNodeExcluded Key: SPARK-33799 URL: https://issues.apache.org/jira/browse/SPARK-33799 Project: Spark

[jira] [Assigned] (SPARK-33765) Migrate UNCACHE TABLE to new resolution framework

2020-12-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33765: --- Assignee: Terry Kim > Migrate UNCACHE TABLE to new resolution framework >

[jira] [Resolved] (SPARK-33765) Migrate UNCACHE TABLE to new resolution framework

2020-12-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33765. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30743

[jira] [Commented] (SPARK-33752) Avoid the getSimpleMessage of AnalysisException adds semicolon repeatedly

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250063#comment-17250063 ] Apache Spark commented on SPARK-33752: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-33752) Avoid the getSimpleMessage of AnalysisException adds semicolon repeatedly

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250059#comment-17250059 ] Apache Spark commented on SPARK-33752: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-33752) Avoid the getSimpleMessage of AnalysisException adds semicolon repeatedly

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250058#comment-17250058 ] Apache Spark commented on SPARK-33752: -- User 'beliefer' has created a pull request for this issue:

[jira] [Resolved] (SPARK-33755) Allow creating orc table when row format separator is defined

2020-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33755. -- Resolution: Invalid > Allow creating orc table when row format separator is defined >

[jira] [Updated] (SPARK-33798) Simplify EqualTo(CaseWhen/If, Literal) always false

2020-12-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33798: Description: Simplify CaseWhen/If with EqualTo if all values are Literal and always false, this

[jira] [Commented] (SPARK-33798) Simplify EqualTo(CaseWhen/If, Literal) always false

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250047#comment-17250047 ] Apache Spark commented on SPARK-33798: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-33798) Simplify EqualTo(CaseWhen/If, Literal) always false

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250048#comment-17250048 ] Apache Spark commented on SPARK-33798: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33798) Simplify EqualTo(CaseWhen/If, Literal) always false

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33798: Assignee: (was: Apache Spark) > Simplify EqualTo(CaseWhen/If, Literal) always false

[jira] [Assigned] (SPARK-33798) Simplify EqualTo(CaseWhen/If, Literal) always false

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33798: Assignee: Apache Spark > Simplify EqualTo(CaseWhen/If, Literal) always false >

[jira] [Created] (SPARK-33798) Simplify EqualTo(CaseWhen/If, Literal) always false

2020-12-15 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33798: --- Summary: Simplify EqualTo(CaseWhen/If, Literal) always false Key: SPARK-33798 URL: https://issues.apache.org/jira/browse/SPARK-33798 Project: Spark Issue

[jira] [Commented] (SPARK-33791) grouping__id() result does not consistent with hive's version < 2.3

2020-12-15 Thread Su Qilong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250042#comment-17250042 ] Su Qilong commented on SPARK-33791: --- Hi [~yumwang] , I've read this migration guide carefully, but do

[jira] [Commented] (SPARK-22748) Error in query: grouping_id() can only be used with GroupingSets/Cube/Rollup;

2020-12-15 Thread Su Qilong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250038#comment-17250038 ] Su Qilong commented on SPARK-22748: --- [~yumwang],[~hyukjin.kwon] could u take a look of this issue? >

[jira] [Resolved] (SPARK-33796) Show hidden text from the left menu of Spark Doc

2020-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33796. -- Fix Version/s: 3.1.0 Resolution: Fixed Fixed in

[jira] [Resolved] (SPARK-33788) Throw NoSuchPartitionsException from HiveExternalCatalog.dropPartitions()

2020-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33788. -- Fix Version/s: (was: 3.0.2) (was: 2.4.8)

[jira] [Commented] (SPARK-33797) Update SS doc about State Store and task locality

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250032#comment-17250032 ] Apache Spark commented on SPARK-33797: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-33797) Update SS doc about State Store and task locality

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250031#comment-17250031 ] Apache Spark commented on SPARK-33797: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33797) Update SS doc about State Store and task locality

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33797: Assignee: Apache Spark (was: L. C. Hsieh) > Update SS doc about State Store and task

[jira] [Assigned] (SPARK-33797) Update SS doc about State Store and task locality

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33797: Assignee: L. C. Hsieh (was: Apache Spark) > Update SS doc about State Store and task

[jira] [Created] (SPARK-33797) Update SS doc about State Store and task locality

2020-12-15 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-33797: --- Summary: Update SS doc about State Store and task locality Key: SPARK-33797 URL: https://issues.apache.org/jira/browse/SPARK-33797 Project: Spark Issue Type:

[jira] [Updated] (SPARK-22256) Introduce spark.mesos.driver.memoryOverhead

2020-12-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22256: -- Affects Version/s: (was: 2.3.0) (was: 2.2.0)

[jira] [Assigned] (SPARK-22256) Introduce spark.mesos.driver.memoryOverhead

2020-12-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-22256: - Assignee: David McWhorter > Introduce spark.mesos.driver.memoryOverhead >

[jira] [Resolved] (SPARK-22256) Introduce spark.mesos.driver.memoryOverhead

2020-12-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-22256. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30739

[jira] [Updated] (SPARK-22256) Introduce spark.mesos.driver.memoryOverhead

2020-12-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22256: -- Docs Text: Since Apache Spark 3.2.0, `spark.mesos.driver.memoryOverhead` is added whose value

[jira] [Updated] (SPARK-22256) Introduce spark.mesos.driver.memoryOverhead

2020-12-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22256: -- Labels: releasenotes (was: docker memory mesos) > Introduce

[jira] [Resolved] (SPARK-33735) Handle UPDATE in ReplaceNullWithFalseInPredicate

2020-12-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33735. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30787

[jira] [Assigned] (SPARK-33735) Handle UPDATE in ReplaceNullWithFalseInPredicate

2020-12-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33735: - Assignee: Anton Okolnychyi > Handle UPDATE in ReplaceNullWithFalseInPredicate >

[jira] [Commented] (SPARK-33778) Allow typesafe join for LeftSemi and LeftAnti

2020-12-15 Thread Venkata krishnan Sowrirajan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249873#comment-17249873 ] Venkata krishnan Sowrirajan commented on SPARK-33778: - Thanks [~angerszhuuu] >

[jira] [Commented] (SPARK-33735) Handle UPDATE in ReplaceNullWithFalseInPredicate

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249861#comment-17249861 ] Apache Spark commented on SPARK-33735: -- User 'aokolnychyi' has created a pull request for this

[jira] [Assigned] (SPARK-33735) Handle UPDATE in ReplaceNullWithFalseInPredicate

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33735: Assignee: (was: Apache Spark) > Handle UPDATE in ReplaceNullWithFalseInPredicate >

[jira] [Assigned] (SPARK-33735) Handle UPDATE in ReplaceNullWithFalseInPredicate

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33735: Assignee: Apache Spark > Handle UPDATE in ReplaceNullWithFalseInPredicate >

[jira] [Commented] (SPARK-33735) Handle UPDATE in ReplaceNullWithFalseInPredicate

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249860#comment-17249860 ] Apache Spark commented on SPARK-33735: -- User 'aokolnychyi' has created a pull request for this

[jira] [Assigned] (SPARK-33726) Duplicate field names causes wrong answers during aggregation

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33726: Assignee: Apache Spark > Duplicate field names causes wrong answers during aggregation >

[jira] [Assigned] (SPARK-33726) Duplicate field names causes wrong answers during aggregation

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33726: Assignee: (was: Apache Spark) > Duplicate field names causes wrong answers during

[jira] [Commented] (SPARK-33726) Duplicate field names causes wrong answers during aggregation

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249858#comment-17249858 ] Apache Spark commented on SPARK-33726: -- User 'yliou' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-33726) Duplicate field names causes wrong answers during aggregation

2020-12-15 Thread Yian Liou (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246812#comment-17246812 ] Yian Liou edited comment on SPARK-33726 at 12/15/20, 6:27 PM: -- Will create

[jira] [Assigned] (SPARK-33796) Show hidden text from the left menu of Spark Doc

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33796: Assignee: Apache Spark (was: Gengliang Wang) > Show hidden text from the left menu of

[jira] [Commented] (SPARK-33796) Show hidden text from the left menu of Spark Doc

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249808#comment-17249808 ] Apache Spark commented on SPARK-33796: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-33796) Show hidden text from the left menu of Spark Doc

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33796: Assignee: Gengliang Wang (was: Apache Spark) > Show hidden text from the left menu of

[jira] [Created] (SPARK-33796) Show hidden text from the left menu of Spark Doc

2020-12-15 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-33796: -- Summary: Show hidden text from the left menu of Spark Doc Key: SPARK-33796 URL: https://issues.apache.org/jira/browse/SPARK-33796 Project: Spark Issue

[jira] [Moved] (SPARK-33795) gapply fails execution with rbind error

2020-12-15 Thread Neal Richardson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neal Richardson moved ARROW-10916 to SPARK-33795: - Component/s: (was: R) SparkR

[jira] [Commented] (SPARK-33755) Allow creating orc table when row format separator is defined

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249760#comment-17249760 ] Apache Spark commented on SPARK-33755: -- User 'StefanXiepj' has created a pull request for this

[jira] [Commented] (SPARK-33755) Allow creating orc table when row format separator is defined

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249759#comment-17249759 ] Apache Spark commented on SPARK-33755: -- User 'StefanXiepj' has created a pull request for this

[jira] [Commented] (SPARK-33560) Add "unused import" check to Maven compilation process

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249725#comment-17249725 ] Apache Spark commented on SPARK-33560: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-33560) Add "unused import" check to Maven compilation process

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33560: Assignee: Apache Spark > Add "unused import" check to Maven compilation process >

[jira] [Assigned] (SPARK-33560) Add "unused import" check to Maven compilation process

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33560: Assignee: (was: Apache Spark) > Add "unused import" check to Maven compilation

[jira] [Commented] (SPARK-33560) Add "unused import" check to Maven compilation process

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249724#comment-17249724 ] Apache Spark commented on SPARK-33560: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-33793) Refactor usage of Executor in ExecutorSuite to ensure proper cleanup

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33793: Assignee: Apache Spark > Refactor usage of Executor in ExecutorSuite to ensure proper

[jira] [Assigned] (SPARK-33793) Refactor usage of Executor in ExecutorSuite to ensure proper cleanup

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33793: Assignee: (was: Apache Spark) > Refactor usage of Executor in ExecutorSuite to

[jira] [Commented] (SPARK-33793) Refactor usage of Executor in ExecutorSuite to ensure proper cleanup

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249717#comment-17249717 ] Apache Spark commented on SPARK-33793: -- User 'sander-goos' has created a pull request for this

[jira] [Updated] (SPARK-33792) NullPointerException in HDFSBackedStateStoreProvider

2020-12-15 Thread Gabor Barna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Barna updated SPARK-33792: Environment: emr-5.28.0 > NullPointerException in HDFSBackedStateStoreProvider >

[jira] [Resolved] (SPARK-33758) Prune unnecessary output partitioning when the attribute is not part of output.

2020-12-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33758. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30762

[jira] [Assigned] (SPARK-33758) Prune unnecessary output partitioning when the attribute is not part of output.

2020-12-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33758: --- Assignee: Prakhar Jain > Prune unnecessary output partitioning when the attribute is not

[jira] [Updated] (SPARK-33794) [ANSI mode][SQL] next_day function should throw runtime exception when receiving invalid input under ANSI mode

2020-12-15 Thread Chongguang LIU (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chongguang LIU updated SPARK-33794: --- Description: Hello all, According to [ANSI

[jira] [Updated] (SPARK-33794) [ANSI mode][SQL] next_day function should throw runtime exception when receiving invalid input under ANSI mode

2020-12-15 Thread Chongguang LIU (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chongguang LIU updated SPARK-33794: --- Description: Hello all, According to [ANSI

[jira] [Created] (SPARK-33794) [ANSI mode][SQL] next_day function should throw runtime exception when receiving invalid input under ANSI mode

2020-12-15 Thread Chongguang LIU (Jira)
Chongguang LIU created SPARK-33794: -- Summary: [ANSI mode][SQL] next_day function should throw runtime exception when receiving invalid input under ANSI mode Key: SPARK-33794 URL:

[jira] [Assigned] (SPARK-22748) Error in query: grouping_id() can only be used with GroupingSets/Cube/Rollup;

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22748: Assignee: (was: Apache Spark) > Error in query: grouping_id() can only be used with

[jira] [Assigned] (SPARK-22748) Error in query: grouping_id() can only be used with GroupingSets/Cube/Rollup;

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22748: Assignee: Apache Spark > Error in query: grouping_id() can only be used with

[jira] [Commented] (SPARK-22748) Error in query: grouping_id() can only be used with GroupingSets/Cube/Rollup;

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249694#comment-17249694 ] Apache Spark commented on SPARK-22748: -- User 'sqlwindspeaker' has created a pull request for this

[jira] [Updated] (SPARK-33696) Upgrade built-in Hive to 2.3.8

2020-12-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33696: Description: Hive 2.3.8 changes: HIVE-19662: Upgrade Avro to 1.8.2 HIVE-24324: Remove

[jira] [Created] (SPARK-33793) Refactor usage of Executor in ExecutorSuite to ensure proper cleanup

2020-12-15 Thread Sander Goos (Jira)
Sander Goos created SPARK-33793: --- Summary: Refactor usage of Executor in ExecutorSuite to ensure proper cleanup Key: SPARK-33793 URL: https://issues.apache.org/jira/browse/SPARK-33793 Project: Spark

[jira] [Created] (SPARK-33792) NullPointerException in HDFSBackedStateStoreProvider

2020-12-15 Thread Gabor Barna (Jira)
Gabor Barna created SPARK-33792: --- Summary: NullPointerException in HDFSBackedStateStoreProvider Key: SPARK-33792 URL: https://issues.apache.org/jira/browse/SPARK-33792 Project: Spark Issue

[jira] [Reopened] (SPARK-22748) Error in query: grouping_id() can only be used with GroupingSets/Cube/Rollup;

2020-12-15 Thread Su Qilong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Su Qilong reopened SPARK-22748: --- This issue did not be fixed > Error in query: grouping_id() can only be used with

[jira] [Commented] (SPARK-33791) grouping__id() result does not consistent with hive's version < 2.3

2020-12-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249680#comment-17249680 ] Yuming Wang commented on SPARK-33791: -

[jira] [Created] (SPARK-33791) grouping__id() result does not consistent with hive's version < 2.3

2020-12-15 Thread Su Qilong (Jira)
Su Qilong created SPARK-33791: - Summary: grouping__id() result does not consistent with hive's version < 2.3 Key: SPARK-33791 URL: https://issues.apache.org/jira/browse/SPARK-33791 Project: Spark

[jira] [Updated] (SPARK-33790) Reduce the rpc call of getFileStatus in SingleFileEventLogFileReader

2020-12-15 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-33790: --- Description: FsHistoryProvider#checkForLogs already has FileStatus when constructing

[jira] [Commented] (SPARK-33790) Reduce the rpc call of getFileStatus in SingleFileEventLogFileReader

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249650#comment-17249650 ] Apache Spark commented on SPARK-33790: -- User 'cxzl25' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33790) Reduce the rpc call of getFileStatus in SingleFileEventLogFileReader

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33790: Assignee: (was: Apache Spark) > Reduce the rpc call of getFileStatus in

[jira] [Assigned] (SPARK-33790) Reduce the rpc call of getFileStatus in SingleFileEventLogFileReader

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33790: Assignee: Apache Spark > Reduce the rpc call of getFileStatus in

[jira] [Created] (SPARK-33790) Reduce the rpc call of getFileStatus in SingleFileEventLogFileReader

2020-12-15 Thread dzcxzl (Jira)
dzcxzl created SPARK-33790: -- Summary: Reduce the rpc call of getFileStatus in SingleFileEventLogFileReader Key: SPARK-33790 URL: https://issues.apache.org/jira/browse/SPARK-33790 Project: Spark

[jira] [Commented] (SPARK-33789) Refactor unified V1 and V2 datasource tests

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249642#comment-17249642 ] Apache Spark commented on SPARK-33789: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33789) Refactor unified V1 and V2 datasource tests

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33789: Assignee: Apache Spark > Refactor unified V1 and V2 datasource tests >

[jira] [Commented] (SPARK-33789) Refactor unified V1 and V2 datasource tests

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249641#comment-17249641 ] Apache Spark commented on SPARK-33789: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33789) Refactor unified V1 and V2 datasource tests

2020-12-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33789: Assignee: (was: Apache Spark) > Refactor unified V1 and V2 datasource tests >

[jira] [Created] (SPARK-33789) Refactor unified V1 and V2 datasource tests

2020-12-15 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33789: -- Summary: Refactor unified V1 and V2 datasource tests Key: SPARK-33789 URL: https://issues.apache.org/jira/browse/SPARK-33789 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-33349) ExecutorPodsWatchSnapshotSource: Kubernetes client has been closed

2020-12-15 Thread rameshkrishnan muthusamy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249620#comment-17249620 ] rameshkrishnan muthusamy commented on SPARK-33349: -- [~redsk] I have done the Kubernetes

[jira] [Assigned] (SPARK-33769) improve the next-day function of the sql component to deal with Column type

2020-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33769: Assignee: Chongguang LIU > improve the next-day function of the sql component to deal

[jira] [Resolved] (SPARK-33769) improve the next-day function of the sql component to deal with Column type

2020-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33769. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30761

  1   2   >