[jira] [Assigned] (SPARK-31957) cleanup hive scratch dir should work for the developer api startWithContext

[ https://issues.apache.org/jira/browse/SPARK-31957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31957: - Assignee: Kent Yao > cleanup hive scratch dir should work for the developer api

[jira] [Resolved] (SPARK-31957) cleanup hive scratch dir should work for the developer api startWithContext

[ https://issues.apache.org/jira/browse/SPARK-31957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31957. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28784

[jira] [Resolved] (SPARK-32021) make_interval does not accept seconds >100

[ https://issues.apache.org/jira/browse/SPARK-32021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32021. --- Fix Version/s: 3.1.0 Assignee: Maxim Gekk Resolution: Fixed This is

[jira] [Updated] (SPARK-31980) Spark sequence() fails if start and end of range are identical dates

[ https://issues.apache.org/jira/browse/SPARK-31980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31980: -- Affects Version/s: 2.4.0 2.4.1 2.4.2

[jira] [Comment Edited] (SPARK-30876) Optimizer cannot infer from inferred constraints with join

[ https://issues.apache.org/jira/browse/SPARK-30876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140898#comment-17140898 ] Navin Viswanath edited comment on SPARK-30876 at 6/20/20, 2:27 AM: ---

[jira] [Resolved] (SPARK-31980) Spark sequence() fails if start and end of range are identical dates

[ https://issues.apache.org/jira/browse/SPARK-31980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31980. --- Fix Version/s: 3.1.0 2.4.7 3.0.1 Resolution:

[jira] [Assigned] (SPARK-31980) Spark sequence() fails if start and end of range are identical dates

[ https://issues.apache.org/jira/browse/SPARK-31980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31980: - Assignee: JinxinTang > Spark sequence() fails if start and end of range are identical

[jira] [Assigned] (SPARK-32030) Support unlimited MATCHED and NOT MATCHED clauses in MERGE INTO

[ https://issues.apache.org/jira/browse/SPARK-32030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32030: Assignee: (was: Apache Spark) > Support unlimited MATCHED and NOT MATCHED clauses in

[jira] [Assigned] (SPARK-32030) Support unlimited MATCHED and NOT MATCHED clauses in MERGE INTO

[ https://issues.apache.org/jira/browse/SPARK-32030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32030: Assignee: Apache Spark > Support unlimited MATCHED and NOT MATCHED clauses in MERGE INTO

[jira] [Commented] (SPARK-32030) Support unlimited MATCHED and NOT MATCHED clauses in MERGE INTO

[ https://issues.apache.org/jira/browse/SPARK-32030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140908#comment-17140908 ] Apache Spark commented on SPARK-32030: -- User 'xianyinxin' has created a pull request for this

[jira] [Commented] (SPARK-32036) Remove references to "blacklist"/"whitelist" language (outside of blacklisting feature)

[ https://issues.apache.org/jira/browse/SPARK-32036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140900#comment-17140900 ] Apache Spark commented on SPARK-32036: -- User 'xkrogen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32036) Remove references to "blacklist"/"whitelist" language (outside of blacklisting feature)

[ https://issues.apache.org/jira/browse/SPARK-32036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32036: Assignee: Apache Spark > Remove references to "blacklist"/"whitelist" language (outside

[jira] [Commented] (SPARK-32036) Remove references to "blacklist"/"whitelist" language (outside of blacklisting feature)

[ https://issues.apache.org/jira/browse/SPARK-32036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140899#comment-17140899 ] Apache Spark commented on SPARK-32036: -- User 'xkrogen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32036) Remove references to "blacklist"/"whitelist" language (outside of blacklisting feature)

[ https://issues.apache.org/jira/browse/SPARK-32036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32036: Assignee: (was: Apache Spark) > Remove references to "blacklist"/"whitelist"

[jira] [Updated] (SPARK-32038) Regression in handling NaN values in COUNT(DISTINCT)

[ https://issues.apache.org/jira/browse/SPARK-32038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated SPARK-32038: - Description: There seems to be a regression in Spark 3.0.0, with regard to how

[jira] [Updated] (SPARK-32038) Regression in handling NaN values in COUNT(DISTINCT)

[ https://issues.apache.org/jira/browse/SPARK-32038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated SPARK-32038: - Description: There seems to be a regression in Spark 3.0.0, with regard to how

[jira] [Commented] (SPARK-30876) Optimizer cannot infer from inferred constraints with join

[ https://issues.apache.org/jira/browse/SPARK-30876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140898#comment-17140898 ] Navin Viswanath commented on SPARK-30876: - [~yumwang] would this be in the logical plan

[jira] [Created] (SPARK-32038) Regression in handling NaN values in COUNT(DISTINCT)

Mithun Radhakrishnan created SPARK-32038: Summary: Regression in handling NaN values in COUNT(DISTINCT) Key: SPARK-32038 URL: https://issues.apache.org/jira/browse/SPARK-32038 Project: Spark

[jira] [Resolved] (SPARK-31350) Coalesce bucketed tables for join if applicable

[ https://issues.apache.org/jira/browse/SPARK-31350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31350. -- Fix Version/s: 3.1.0 Assignee: Terry Kim Resolution: Fixed Resolved

[jira] [Updated] (SPARK-32037) Rename blacklisting feature to avoid language with racist connotation

[ https://issues.apache.org/jira/browse/SPARK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated SPARK-32037: Description: As per [discussion on the Spark dev

[jira] [Commented] (SPARK-32037) Rename blacklisting feature to avoid language with racist connotation

[ https://issues.apache.org/jira/browse/SPARK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140876#comment-17140876 ] Erik Krogen commented on SPARK-32037: - +1 from me, I agree that this feature is basically a health

[jira] [Commented] (SPARK-32031) Fix the wrong references of PartialMerge/Final AggregateExpression

[ https://issues.apache.org/jira/browse/SPARK-32031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140859#comment-17140859 ] Dongjoon Hyun commented on SPARK-32031: --- Hi, [~Ngone51]. This is filed as `Improvement`, but the

[jira] [Resolved] (SPARK-32033) Use new poll API in Kafka connector executor side to avoid infinite wait

[ https://issues.apache.org/jira/browse/SPARK-32033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32033. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28871

[jira] [Assigned] (SPARK-32033) Use new poll API in Kafka connector executor side to avoid infinite wait

[ https://issues.apache.org/jira/browse/SPARK-32033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32033: - Assignee: Gabor Somogyi > Use new poll API in Kafka connector executor side to avoid

[jira] [Commented] (SPARK-32037) Rename blacklisting feature to avoid language with racist connotation

[ https://issues.apache.org/jira/browse/SPARK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140825#comment-17140825 ] Ryan Blue commented on SPARK-32037: --- What about "healthy" and "unhealthy"? That's basically what we

[jira] [Created] (SPARK-32037) Rename blacklisting feature to avoid language with racist connotation

Erik Krogen created SPARK-32037: --- Summary: Rename blacklisting feature to avoid language with racist connotation Key: SPARK-32037 URL: https://issues.apache.org/jira/browse/SPARK-32037 Project: Spark

[jira] [Updated] (SPARK-32036) Remove references to "blacklist"/"whitelist" language (outside of blacklisting feature)

[ https://issues.apache.org/jira/browse/SPARK-32036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated SPARK-32036: Description: As per [discussion on the Spark dev

[jira] [Created] (SPARK-32036) Remove references to "blacklist"/"whitelist" language (outside of blacklisting feature)

Erik Krogen created SPARK-32036: --- Summary: Remove references to "blacklist"/"whitelist" language (outside of blacklisting feature) Key: SPARK-32036 URL: https://issues.apache.org/jira/browse/SPARK-32036

[jira] [Assigned] (SPARK-32021) make_interval does not accept seconds >100

[ https://issues.apache.org/jira/browse/SPARK-32021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32021: Assignee: Apache Spark > make_interval does not accept seconds >100 >

[jira] [Commented] (SPARK-32021) make_interval does not accept seconds >100

[ https://issues.apache.org/jira/browse/SPARK-32021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140775#comment-17140775 ] Apache Spark commented on SPARK-32021: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32021) make_interval does not accept seconds >100

[ https://issues.apache.org/jira/browse/SPARK-32021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32021: Assignee: (was: Apache Spark) > make_interval does not accept seconds >100 >

[jira] [Comment Edited] (SPARK-7101) Spark SQL should support java.sql.Time

[ https://issues.apache.org/jira/browse/SPARK-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132694#comment-17132694 ] YoungGyu Chun edited comment on SPARK-7101 at 6/19/20, 6:35 PM: I will

[jira] [Commented] (SPARK-29679) Make interval type camparable and orderable

[ https://issues.apache.org/jira/browse/SPARK-29679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140651#comment-17140651 ] Bart Samwel commented on SPARK-29679: - That's a good question. I think it would make sense to do it

[jira] [Resolved] (SPARK-31029) Occasional class not found error in user's Future code using global ExecutionContext

[ https://issues.apache.org/jira/browse/SPARK-31029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-31029. --- Fix Version/s: 3.1.0 Assignee: shanyu zhao Resolution: Fixed > Occasional

[jira] [Resolved] (SPARK-31826) Support composed type of case class for typed Scala UDF

[ https://issues.apache.org/jira/browse/SPARK-31826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31826. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28645

[jira] [Assigned] (SPARK-31826) Support composed type of case class for typed Scala UDF

[ https://issues.apache.org/jira/browse/SPARK-31826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31826: --- Assignee: wuyi > Support composed type of case class for typed Scala UDF >

[jira] [Resolved] (SPARK-31056) Add CalendarIntervals division

[ https://issues.apache.org/jira/browse/SPARK-31056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31056. -- Resolution: Won't Fix > Add CalendarIntervals division > -- > >

[jira] [Created] (SPARK-32035) Inconsistent AWS environment variables in documentation

Ondrej Kokes created SPARK-32035: Summary: Inconsistent AWS environment variables in documentation Key: SPARK-32035 URL: https://issues.apache.org/jira/browse/SPARK-32035 Project: Spark

[jira] [Commented] (SPARK-11150) Dynamic partition pruning

[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140378#comment-17140378 ] Apache Spark commented on SPARK-11150: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-11150) Dynamic partition pruning

[ https://issues.apache.org/jira/browse/SPARK-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140374#comment-17140374 ] Apache Spark commented on SPARK-11150: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-32033) Use new poll API in Kafka connector executor side to avoid infinite wait

[ https://issues.apache.org/jira/browse/SPARK-32033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140360#comment-17140360 ] Apache Spark commented on SPARK-32033: -- User 'gaborgsomogyi' has created a pull request for this

[jira] [Assigned] (SPARK-32033) Use new poll API in Kafka connector executor side to avoid infinite wait

[ https://issues.apache.org/jira/browse/SPARK-32033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32033: Assignee: Apache Spark > Use new poll API in Kafka connector executor side to avoid

[jira] [Assigned] (SPARK-32033) Use new poll API in Kafka connector executor side to avoid infinite wait

[ https://issues.apache.org/jira/browse/SPARK-32033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32033: Assignee: (was: Apache Spark) > Use new poll API in Kafka connector executor side to

[jira] [Commented] (SPARK-32033) Use new poll API in Kafka connector executor side to avoid infinite wait

[ https://issues.apache.org/jira/browse/SPARK-32033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140356#comment-17140356 ] Apache Spark commented on SPARK-32033: -- User 'gaborgsomogyi' has created a pull request for this

[jira] [Updated] (SPARK-16659) use Maven project to submit spark application via yarn-client

[ https://issues.apache.org/jira/browse/SPARK-16659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jack Jiang updated SPARK-16659: --- Description: (was: i want to use spark sql to execute hive sql in my maven project,here is the

[jira] [Commented] (SPARK-32034) Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

[ https://issues.apache.org/jira/browse/SPARK-32034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140344#comment-17140344 ] Apache Spark commented on SPARK-32034: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32034) Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

[ https://issues.apache.org/jira/browse/SPARK-32034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32034: Assignee: (was: Apache Spark) > Port HIVE-14817: Shutdown the SessionManager

[jira] [Commented] (SPARK-32034) Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

[ https://issues.apache.org/jira/browse/SPARK-32034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140343#comment-17140343 ] Apache Spark commented on SPARK-32034: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32034) Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

[ https://issues.apache.org/jira/browse/SPARK-32034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32034: Assignee: Apache Spark > Port HIVE-14817: Shutdown the SessionManager timeoutChecker

[jira] [Created] (SPARK-32034) Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

Kent Yao created SPARK-32034: Summary: Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown Key: SPARK-32034 URL: https://issues.apache.org/jira/browse/SPARK-32034

[jira] [Created] (SPARK-32033) Use new poll API in Kafka connector executor side to avoid infinite wait

Gabor Somogyi created SPARK-32033: - Summary: Use new poll API in Kafka connector executor side to avoid infinite wait Key: SPARK-32033 URL: https://issues.apache.org/jira/browse/SPARK-32033 Project:

[jira] [Created] (SPARK-32032) Use new poll API in Kafka connector diver side to avoid infinite wait

Gabor Somogyi created SPARK-32032: - Summary: Use new poll API in Kafka connector diver side to avoid infinite wait Key: SPARK-32032 URL: https://issues.apache.org/jira/browse/SPARK-32032 Project:

[jira] [Commented] (SPARK-28367) Kafka connector infinite wait because metadata never updated

[ https://issues.apache.org/jira/browse/SPARK-28367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140319#comment-17140319 ] Gabor Somogyi commented on SPARK-28367: --- I think we can split the problem into 2 pieces. Driver

[jira] [Commented] (SPARK-32031) Fix the wrong references of PartialMerge/Final AggregateExpression

[ https://issues.apache.org/jira/browse/SPARK-32031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140289#comment-17140289 ] Apache Spark commented on SPARK-32031: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32031) Fix the wrong references of PartialMerge/Final AggregateExpression

[ https://issues.apache.org/jira/browse/SPARK-32031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32031: Assignee: Apache Spark > Fix the wrong references of PartialMerge/Final

[jira] [Assigned] (SPARK-32031) Fix the wrong references of PartialMerge/Final AggregateExpression

[ https://issues.apache.org/jira/browse/SPARK-32031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32031: Assignee: (was: Apache Spark) > Fix the wrong references of PartialMerge/Final

[jira] [Created] (SPARK-32031) Fix the wrong references of PartialMerge/Final AggregateExpression

wuyi created SPARK-32031: Summary: Fix the wrong references of PartialMerge/Final AggregateExpression Key: SPARK-32031 URL: https://issues.apache.org/jira/browse/SPARK-32031 Project: Spark Issue

[jira] [Updated] (SPARK-32030) Support unlimited MATCHED and NOT MATCHED clauses in MERGE INTO

[ https://issues.apache.org/jira/browse/SPARK-32030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated SPARK-32030: Description: Now the {{MERGE INTO}} syntax is, {code:sql} MERGE INTO [db_name.]target_table [AS

[jira] [Created] (SPARK-32030) Support unlimited MATCHED and NOT MATCHED clauses in MERGE INTO

Xianyin Xin created SPARK-32030: --- Summary: Support unlimited MATCHED and NOT MATCHED clauses in MERGE INTO Key: SPARK-32030 URL: https://issues.apache.org/jira/browse/SPARK-32030 Project: Spark

[jira] [Resolved] (SPARK-31993) Generated code in 'concat_ws' fails to compile when splitting method is in effect

[ https://issues.apache.org/jira/browse/SPARK-31993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31993. - Fix Version/s: 3.1.0 Assignee: Jungtaek Lim Resolution: Fixed > Generated code

[jira] [Commented] (SPARK-32029) Make activeSession null when application end

[ https://issues.apache.org/jira/browse/SPARK-32029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140235#comment-17140235 ] Apache Spark commented on SPARK-32029: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-32029) Make activeSession null when application end

[ https://issues.apache.org/jira/browse/SPARK-32029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32029: Assignee: (was: Apache Spark) > Make activeSession null when application end >

[jira] [Assigned] (SPARK-32029) Make activeSession null when application end

[ https://issues.apache.org/jira/browse/SPARK-32029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32029: Assignee: Apache Spark > Make activeSession null when application end >

[jira] [Commented] (SPARK-32029) Make activeSession null when application end

[ https://issues.apache.org/jira/browse/SPARK-32029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140234#comment-17140234 ] Apache Spark commented on SPARK-32029: -- User 'ulysses-you' has created a pull request for this