[jira] [Commented] (SPARK-32045) Upgrade to Apache Commons Lang 3.10.

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141686#comment-17141686 ] Apache Spark commented on SPARK-32045: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-32045) Upgrade to Apache Commons Lang 3.10.

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32045: Assignee: (was: Apache Spark) > Upgrade to Apache Commons Lang 3.10. >

[jira] [Assigned] (SPARK-32045) Upgrade to Apache Commons Lang 3.10.

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32045: Assignee: Apache Spark > Upgrade to Apache Commons Lang 3.10. >

[jira] [Commented] (SPARK-32045) Upgrade to Apache Commons Lang 3.10.

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141685#comment-17141685 ] Apache Spark commented on SPARK-32045: -- User 'williamhyun' has created a pull request for this

[jira] [Created] (SPARK-32045) Upgrade to Apache Commons Lang 3.10.

2020-06-21 Thread William Hyun (Jira)
William Hyun created SPARK-32045: Summary: Upgrade to Apache Commons Lang 3.10. Key: SPARK-32045 URL: https://issues.apache.org/jira/browse/SPARK-32045 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32034) Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141666#comment-17141666 ] Apache Spark commented on SPARK-32034: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-32034) Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141663#comment-17141663 ] Apache Spark commented on SPARK-32034: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Resolved] (SPARK-32041) Exchange reuse won't work in cases when DPP, subqueries are involved

2020-06-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32041. -- Resolution: Duplicate > Exchange reuse won't work in cases when DPP, subqueries are involved

[jira] [Assigned] (SPARK-31798) Return map output metadata from shuffle writers

2020-06-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31798: - Assignee: Matt Cheah > Return map output metadata from shuffle writers >

[jira] [Resolved] (SPARK-31798) Return map output metadata from shuffle writers

2020-06-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31798. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28616

[jira] [Commented] (SPARK-32044) [SS] Kakfa continuous processing print mislead initial offsets log

2020-06-21 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141622#comment-17141622 ] Jungtaek Lim commented on SPARK-32044: -- Fix version is reserved to mark the versions where the

[jira] [Updated] (SPARK-32044) [SS] Kakfa continuous processing print mislead initial offsets log

2020-06-21 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-32044: - Fix Version/s: (was: 2.4.7) > [SS] Kakfa continuous processing print mislead initial

[jira] [Updated] (SPARK-29465) Unable to configure SPARK UI (spark.ui.port) in spark yarn cluster mode.

2020-06-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29465: -- Affects Version/s: (was: 3.0.0) 3.1.0 > Unable to configure SPARK

[jira] [Commented] (SPARK-29465) Unable to configure SPARK UI (spark.ui.port) in spark yarn cluster mode.

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141603#comment-17141603 ] Apache Spark commented on SPARK-29465: -- User 'rajatahujaatinmobi' has created a pull request for

[jira] [Assigned] (SPARK-29465) Unable to configure SPARK UI (spark.ui.port) in spark yarn cluster mode.

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29465: Assignee: (was: Apache Spark) > Unable to configure SPARK UI (spark.ui.port) in

[jira] [Assigned] (SPARK-29465) Unable to configure SPARK UI (spark.ui.port) in spark yarn cluster mode.

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29465: Assignee: Apache Spark > Unable to configure SPARK UI (spark.ui.port) in spark yarn

[jira] [Resolved] (SPARK-32039) Unable to Set `spark.ui.port` configuration in Yarn Cluster Mode

2020-06-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32039. --- Resolution: Duplicate > Unable to Set `spark.ui.port` configuration in Yarn Cluster Mode >

[jira] [Closed] (SPARK-32039) Unable to Set `spark.ui.port` configuration in Yarn Cluster Mode

2020-06-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-32039. - > Unable to Set `spark.ui.port` configuration in Yarn Cluster Mode >

[jira] [Assigned] (SPARK-32034) Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

2020-06-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32034: - Assignee: Kent Yao > Port HIVE-14817: Shutdown the SessionManager timeoutChecker

[jira] [Resolved] (SPARK-32034) Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

2020-06-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32034. --- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-32044) [SS] Kakfa continuous processing print mislead initial offsets log

2020-06-21 Thread Zhongwei Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongwei Zhu updated SPARK-32044: - Description: When using structured streaming in continuous processing mode, after restart

[jira] [Assigned] (SPARK-32044) [SS] Kakfa continuous processing print mislead initial offsets log

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32044: Assignee: Apache Spark > [SS] Kakfa continuous processing print mislead initial offsets

[jira] [Commented] (SPARK-32044) [SS] Kakfa continuous processing print mislead initial offsets log

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141555#comment-17141555 ] Apache Spark commented on SPARK-32044: -- User 'warrenzhu25' has created a pull request for this

[jira] [Assigned] (SPARK-32044) [SS] Kakfa continuous processing print mislead initial offsets log

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32044: Assignee: (was: Apache Spark) > [SS] Kakfa continuous processing print mislead

[jira] [Updated] (SPARK-32044) [SS] Kakfa continuous processing print mislead initial offsets log

2020-06-21 Thread Zhongwei Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongwei Zhu updated SPARK-32044: - Summary: [SS] Kakfa continuous processing print mislead initial offsets log (was: Kakfa

[jira] [Created] (SPARK-32044) Kakfa continuous processing print mislead initial offsets log

2020-06-21 Thread Zhongwei Zhu (Jira)
Zhongwei Zhu created SPARK-32044: Summary: Kakfa continuous processing print mislead initial offsets log Key: SPARK-32044 URL: https://issues.apache.org/jira/browse/SPARK-32044 Project: Spark

[jira] [Assigned] (SPARK-32043) Replace decimal by int op in `make_interval` and `make_timestamp`

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32043: Assignee: Apache Spark > Replace decimal by int op in `make_interval` and

[jira] [Commented] (SPARK-32043) Replace decimal by int op in `make_interval` and `make_timestamp`

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141476#comment-17141476 ] Apache Spark commented on SPARK-32043: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32043) Replace decimal by int op in `make_interval` and `make_timestamp`

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32043: Assignee: (was: Apache Spark) > Replace decimal by int op in `make_interval` and

[jira] [Created] (SPARK-32043) Replace decimal by int op in `make_interval` and `make_timestamp`

2020-06-21 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32043: -- Summary: Replace decimal by int op in `make_interval` and `make_timestamp` Key: SPARK-32043 URL: https://issues.apache.org/jira/browse/SPARK-32043 Project: Spark

[jira] [Assigned] (SPARK-28940) Subquery reuse across all subquery levels

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28940: Assignee: (was: Apache Spark) > Subquery reuse across all subquery levels >

[jira] [Commented] (SPARK-28940) Subquery reuse across all subquery levels

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141344#comment-17141344 ] Apache Spark commented on SPARK-28940: -- User 'peter-toth' has created a pull request for this

[jira] [Commented] (SPARK-28940) Subquery reuse across all subquery levels

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141343#comment-17141343 ] Apache Spark commented on SPARK-28940: -- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-28940) Subquery reuse across all subquery levels

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-28940: Assignee: Apache Spark > Subquery reuse across all subquery levels >

[jira] [Assigned] (SPARK-29375) Exchange reuse across all subquery levels

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29375: Assignee: (was: Apache Spark) > Exchange reuse across all subquery levels >

[jira] [Assigned] (SPARK-29375) Exchange reuse across all subquery levels

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29375: Assignee: Apache Spark > Exchange reuse across all subquery levels >

[jira] [Commented] (SPARK-29375) Exchange reuse across all subquery levels

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141342#comment-17141342 ] Apache Spark commented on SPARK-29375: -- User 'peter-toth' has created a pull request for this

[jira] [Commented] (SPARK-31887) Date casting to string is giving wrong value

2020-06-21 Thread Amit Gupta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141335#comment-17141335 ] Amit Gupta commented on SPARK-31887: [~hyukjin.kwon] I had the typo in last message. TheĀ  issue

[jira] [Comment Edited] (SPARK-31887) Date casting to string is giving wrong value

2020-06-21 Thread Amit Gupta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140127#comment-17140127 ] Amit Gupta edited comment on SPARK-31887 at 6/21/20, 7:34 AM: -- This issue

[jira] [Commented] (SPARK-20249) Add summary for LinearSVCModel

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141334#comment-17141334 ] Apache Spark commented on SPARK-20249: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-20249) Add summary for LinearSVCModel

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141333#comment-17141333 ] Apache Spark commented on SPARK-20249: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-32042) Support UTF8String literals

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141327#comment-17141327 ] Apache Spark commented on SPARK-32042: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32042) Support UTF8String literals

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32042: Assignee: Apache Spark > Support UTF8String literals > --- > >

[jira] [Assigned] (SPARK-32042) Support UTF8String literals

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32042: Assignee: (was: Apache Spark) > Support UTF8String literals >

[jira] [Commented] (SPARK-32042) Support UTF8String literals

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141325#comment-17141325 ] Apache Spark commented on SPARK-32042: -- User 'wangyum' has created a pull request for this issue:

[jira] [Updated] (SPARK-32042) Support UTF8String literals

2020-06-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32042: Issue Type: Improvement (was: Bug) > Support UTF8String literals > --- >

[jira] [Commented] (SPARK-31751) spark serde property path overwrites table property location

2020-06-21 Thread JinxinTang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141320#comment-17141320 ] JinxinTang commented on SPARK-31751: Thank you for your issue, In order to compatible with

[jira] [Created] (SPARK-32042) Support UTF8String literals

2020-06-21 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-32042: --- Summary: Support UTF8String literals Key: SPARK-32042 URL: https://issues.apache.org/jira/browse/SPARK-32042 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-31751) spark serde property path overwrites table property location

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141317#comment-17141317 ] Apache Spark commented on SPARK-31751: -- User 'TJX2014' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31751) spark serde property path overwrites table property location

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31751: Assignee: (was: Apache Spark) > spark serde property path overwrites table property

[jira] [Assigned] (SPARK-31751) spark serde property path overwrites table property location

2020-06-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31751: Assignee: Apache Spark > spark serde property path overwrites table property location >