[jira] [Assigned] (SPARK-32982) Remove hive-1.2 profiles in PIP installation option

2020-09-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32982: Assignee: Hyukjin Kwon > Remove hive-1.2 profiles in PIP installation option >

[jira] [Resolved] (SPARK-32982) Remove hive-1.2 profiles in PIP installation option

2020-09-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32982. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29858

[jira] [Resolved] (SPARK-32714) Port pyspark-stubs

2020-09-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32714. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29591

[jira] [Commented] (SPARK-32971) Support dynamic PVC creation/deletion for K8s executors

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201257#comment-17201257 ] Apache Spark commented on SPARK-32971: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-32971) Support dynamic PVC creation/deletion for K8s executors

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201256#comment-17201256 ] Apache Spark commented on SPARK-32971: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-32984) Improve showing the differences between approved and actual plans

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32984: Assignee: (was: Apache Spark) > Improve showing the differences between approved and

[jira] [Assigned] (SPARK-32984) Improve showing the differences between approved and actual plans

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32984: Assignee: Apache Spark > Improve showing the differences between approved and actual

[jira] [Assigned] (SPARK-32984) Improve showing the differences between approved and actual plans

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32984: Assignee: (was: Apache Spark) > Improve showing the differences between approved and

[jira] [Commented] (SPARK-32984) Improve showing the differences between approved and actual plans

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201245#comment-17201245 ] Apache Spark commented on SPARK-32984: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Created] (SPARK-32984) Improve showing the differences between approved and actual plans

2020-09-23 Thread wuyi (Jira)
wuyi created SPARK-32984: Summary: Improve showing the differences between approved and actual plans Key: SPARK-32984 URL: https://issues.apache.org/jira/browse/SPARK-32984 Project: Spark Issue

[jira] [Created] (SPARK-32983) Spark SQL INTERSECT ALL does not keep all rows.

2020-09-23 Thread Will Du (Jira)
Will Du created SPARK-32983: --- Summary: Spark SQL INTERSECT ALL does not keep all rows. Key: SPARK-32983 URL: https://issues.apache.org/jira/browse/SPARK-32983 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-32977) [SQL] JavaDoc on Default Save mode Incorrect

2020-09-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32977: - Assignee: Russell Spitzer > [SQL] JavaDoc on Default Save mode Incorrect >

[jira] [Resolved] (SPARK-32977) [SQL] JavaDoc on Default Save mode Incorrect

2020-09-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32977. --- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by

[jira] [Commented] (SPARK-32982) Remove hive-1.2 profiles in PIP installation option

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201230#comment-17201230 ] Apache Spark commented on SPARK-32982: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-32982) Remove hive-1.2 profiles in PIP installation option

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201232#comment-17201232 ] Apache Spark commented on SPARK-32982: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-32982) Remove hive-1.2 profiles in PIP installation option

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32982: Assignee: (was: Apache Spark) > Remove hive-1.2 profiles in PIP installation option

[jira] [Assigned] (SPARK-32982) Remove hive-1.2 profiles in PIP installation option

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32982: Assignee: Apache Spark > Remove hive-1.2 profiles in PIP installation option >

[jira] [Updated] (SPARK-32982) Remove hive-1.2 profiles in PIP installation option

2020-09-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32982: - Issue Type: Improvement (was: Bug) > Remove hive-1.2 profiles in PIP installation option >

[jira] [Created] (SPARK-32982) Remove hive-1.2 profiles in PIP installation option

2020-09-23 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32982: Summary: Remove hive-1.2 profiles in PIP installation option Key: SPARK-32982 URL: https://issues.apache.org/jira/browse/SPARK-32982 Project: Spark Issue

[jira] [Commented] (SPARK-32971) Support dynamic PVC creation/deletion for K8s executors

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201225#comment-17201225 ] Apache Spark commented on SPARK-32971: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-32981) Remove hive-1.2/hadoop-2.7 from Apache Spark 3.1 distribution

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201222#comment-17201222 ] Apache Spark commented on SPARK-32981: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-32981) Remove hive-1.2/hadoop-2.7 from Apache Spark 3.1 distribution

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201219#comment-17201219 ] Apache Spark commented on SPARK-32981: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-32972) Pass all `mllib` module UTs in Scala 2.13

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201217#comment-17201217 ] Apache Spark commented on SPARK-32972: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-32972) Pass all `mllib` module UTs in Scala 2.13

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32972: Assignee: Apache Spark > Pass all `mllib` module UTs in Scala 2.13 >

[jira] [Assigned] (SPARK-32972) Pass all `mllib` module UTs in Scala 2.13

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32972: Assignee: (was: Apache Spark) > Pass all `mllib` module UTs in Scala 2.13 >

[jira] [Commented] (SPARK-32972) Pass all `mllib` module UTs in Scala 2.13

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201216#comment-17201216 ] Apache Spark commented on SPARK-32972: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-32975) [K8S] - executor fails to be restarted after it goes to ERROR/Failure state

2020-09-23 Thread Tibor Fasanga (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201207#comment-17201207 ] Tibor Fasanga commented on SPARK-32975: --- Note that the main problem is that the executor POD quits

[jira] [Assigned] (SPARK-32971) Support dynamic PVC creation/deletion for K8s executors

2020-09-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32971: - Assignee: Dongjoon Hyun > Support dynamic PVC creation/deletion for K8s executors >

[jira] [Resolved] (SPARK-32971) Support dynamic PVC creation/deletion for K8s executors

2020-09-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32971. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29846

[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.10.0

2020-09-23 Thread Michael Heuer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201156#comment-17201156 ] Michael Heuer commented on SPARK-27733: --- I can also participate in the Parquet sync meeting. 

[jira] [Commented] (SPARK-12312) JDBC connection to Kerberos secured databases fails on remote executors

2020-09-23 Thread John Lonergan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201154#comment-17201154 ] John Lonergan commented on SPARK-12312: --- Yes - the driver wrapper I wrote accepted both a KT or a

[jira] [Resolved] (SPARK-32980) Launcher Client tests flake with minikube

2020-09-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32980. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29854

[jira] [Assigned] (SPARK-32937) DecomissionSuite in k8s integration tests is failing.

2020-09-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32937: - Assignee: Holden Karau > DecomissionSuite in k8s integration tests is failing. >

[jira] [Assigned] (SPARK-32980) Launcher Client tests flake with minikube

2020-09-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32980: - Assignee: Holden Karau > Launcher Client tests flake with minikube >

[jira] [Resolved] (SPARK-32937) DecomissionSuite in k8s integration tests is failing.

2020-09-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32937. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29854

[jira] [Resolved] (SPARK-32981) Remove hive-1.2/hadoop-2.7 from Apache Spark 3.1 distribution

2020-09-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32981. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29856

[jira] [Commented] (SPARK-32981) Remove hive-1.2/hadoop-2.7 from Apache Spark 3.1 distribution

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201141#comment-17201141 ] Apache Spark commented on SPARK-32981: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-32981) Remove hive-1.2/hadoop-2.7 from Apache Spark 3.1 distribution

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201138#comment-17201138 ] Apache Spark commented on SPARK-32981: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-32981) Remove hive-1.2/hadoop-2.7 from Apache Spark 3.1 distribution

2020-09-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32981: - Assignee: Dongjoon Hyun > Remove hive-1.2/hadoop-2.7 from Apache Spark 3.1

[jira] [Created] (SPARK-32981) Remove hive-1.2/hadoop-2.7 from Apache Spark 3.1 distribution

2020-09-23 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-32981: - Summary: Remove hive-1.2/hadoop-2.7 from Apache Spark 3.1 distribution Key: SPARK-32981 URL: https://issues.apache.org/jira/browse/SPARK-32981 Project: Spark

[jira] [Updated] (SPARK-32067) [K8S] Executor pod template ConfigMap of ongoing submission got inadvertently altered by subsequent submission

2020-09-23 Thread James Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Yu updated SPARK-32067: - Affects Version/s: (was: 2.4.6) (was: 3.0.0) 2.4.7

[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.10.0

2020-09-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201109#comment-17201109 ] Dongjoon Hyun commented on SPARK-27733: --- [~smilegator]. Shall we discuss dropping Hive 1.2.1 then?

[jira] [Comment Edited] (SPARK-12312) JDBC connection to Kerberos secured databases fails on remote executors

2020-09-23 Thread Prakash Rajendran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201101#comment-17201101 ] Prakash Rajendran edited comment on SPARK-12312 at 9/23/20, 9:16 PM: -

[jira] [Commented] (SPARK-12312) JDBC connection to Kerberos secured databases fails on remote executors

2020-09-23 Thread Prakash Rajendran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201101#comment-17201101 ] Prakash Rajendran commented on SPARK-12312: --- [~johnlon] the above references use keytab and

[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.10.0

2020-09-23 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201094#comment-17201094 ] Chao Sun commented on SPARK-27733: -- [~sha...@uber.com] sure, I can join in the next sync meeting. >

[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.10.0

2020-09-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201091#comment-17201091 ] Dongjoon Hyun commented on SPARK-27733: --- Thank you for pinging me, [~sha...@uber.com]. Sorry, I

[jira] [Commented] (SPARK-32980) Launcher Client tests flake with minikube

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201076#comment-17201076 ] Apache Spark commented on SPARK-32980: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32980) Launcher Client tests flake with minikube

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32980: Assignee: Apache Spark > Launcher Client tests flake with minikube >

[jira] [Assigned] (SPARK-32980) Launcher Client tests flake with minikube

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32980: Assignee: (was: Apache Spark) > Launcher Client tests flake with minikube >

[jira] [Commented] (SPARK-32980) Launcher Client tests flake with minikube

2020-09-23 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201073#comment-17201073 ] Holden Karau commented on SPARK-32980: -- Our method of getting the service assumes the service is on

[jira] [Created] (SPARK-32980) Launcher Client tests flake with minikube

2020-09-23 Thread Holden Karau (Jira)
Holden Karau created SPARK-32980: Summary: Launcher Client tests flake with minikube Key: SPARK-32980 URL: https://issues.apache.org/jira/browse/SPARK-32980 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-32915) RPC implementation to support pushing and merging shuffle blocks

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32915: Assignee: (was: Apache Spark) > RPC implementation to support pushing and merging

[jira] [Assigned] (SPARK-32915) RPC implementation to support pushing and merging shuffle blocks

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32915: Assignee: Apache Spark > RPC implementation to support pushing and merging shuffle

[jira] [Commented] (SPARK-32915) RPC implementation to support pushing and merging shuffle blocks

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201053#comment-17201053 ] Apache Spark commented on SPARK-32915: -- User 'Victsm' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32937) DecomissionSuite in k8s integration tests is failing.

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32937: Assignee: Apache Spark > DecomissionSuite in k8s integration tests is failing. >

[jira] [Assigned] (SPARK-32937) DecomissionSuite in k8s integration tests is failing.

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32937: Assignee: (was: Apache Spark) > DecomissionSuite in k8s integration tests is

[jira] [Commented] (SPARK-32937) DecomissionSuite in k8s integration tests is failing.

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201045#comment-17201045 ] Apache Spark commented on SPARK-32937: -- User 'holdenk' has created a pull request for this issue:

[jira] [Resolved] (SPARK-32979) Spark K8s decom test is broken

2020-09-23 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-32979. -- Resolution: Duplicate Duplicate of SPARK-32937 > Spark K8s decom test is broken >

[jira] [Commented] (SPARK-32933) Use keyword-only syntax for keyword_only methods

2020-09-23 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201017#comment-17201017 ] Maciej Szymkiewicz commented on SPARK-32933: Not a problem [~hyukjin.kwon]. My only concern

[jira] [Assigned] (SPARK-32979) Spark K8s decom test is broken

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32979: Assignee: Holden Karau (was: Apache Spark) > Spark K8s decom test is broken >

[jira] [Assigned] (SPARK-32979) Spark K8s decom test is broken

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32979: Assignee: Holden Karau (was: Apache Spark) > Spark K8s decom test is broken >

[jira] [Assigned] (SPARK-32979) Spark K8s decom test is broken

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32979: Assignee: Apache Spark (was: Holden Karau) > Spark K8s decom test is broken >

[jira] [Commented] (SPARK-32979) Spark K8s decom test is broken

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200999#comment-17200999 ] Apache Spark commented on SPARK-32979: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32979) Spark K8s decom test is broken

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32979: Assignee: Apache Spark (was: Holden Karau) > Spark K8s decom test is broken >

[jira] [Assigned] (SPARK-32950) No need for some big-endian specific code paths in {On,Off}HeapColumnVector

2020-09-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-32950: Assignee: Michael Munday > No need for some big-endian specific code paths in

[jira] [Resolved] (SPARK-32950) No need for some big-endian specific code paths in {On,Off}HeapColumnVector

2020-09-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32950. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29815

[jira] [Resolved] (SPARK-32892) Murmur3 and xxHash64 implementations do not produce the correct results on big-endian platforms

2020-09-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-32892. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29762

[jira] [Assigned] (SPARK-32892) Murmur3 and xxHash64 implementations do not produce the correct results on big-endian platforms

2020-09-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-32892: Assignee: Michael Munday > Murmur3 and xxHash64 implementations do not produce the

[jira] [Created] (SPARK-32979) Spark K8s decom test is broken

2020-09-23 Thread Holden Karau (Jira)
Holden Karau created SPARK-32979: Summary: Spark K8s decom test is broken Key: SPARK-32979 URL: https://issues.apache.org/jira/browse/SPARK-32979 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-32972) Pass all `mllib` module UTs in Scala 2.13

2020-09-23 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-32972: - Description: There are 51 Scala test and 3 java test Failed of `mllib` module, the failed case as

[jira] [Commented] (SPARK-32977) [SQL] JavaDoc on Default Save mode Incorrect

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200935#comment-17200935 ] Apache Spark commented on SPARK-32977: -- User 'RussellSpitzer' has created a pull request for this

[jira] [Assigned] (SPARK-32977) [SQL] JavaDoc on Default Save mode Incorrect

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32977: Assignee: (was: Apache Spark) > [SQL] JavaDoc on Default Save mode Incorrect >

[jira] [Assigned] (SPARK-32977) [SQL] JavaDoc on Default Save mode Incorrect

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32977: Assignee: Apache Spark > [SQL] JavaDoc on Default Save mode Incorrect >

[jira] [Commented] (SPARK-32977) [SQL] JavaDoc on Default Save mode Incorrect

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200932#comment-17200932 ] Apache Spark commented on SPARK-32977: -- User 'RussellSpitzer' has created a pull request for this

[jira] [Commented] (SPARK-32977) [SQL] JavaDoc on Default Save mode Incorrect

2020-09-23 Thread Russell Spitzer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200930#comment-17200930 ] Russell Spitzer commented on SPARK-32977: - [~brkyvz] We talked about this a while back, just

[jira] [Updated] (SPARK-32978) Incorrect number of dynamic part metric

2020-09-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32978: Description: How to reproduce this issue: {code:sql} create table dynamic_partition(i bigint,

[jira] [Created] (SPARK-32978) Incorrect number of dynamic part metric

2020-09-23 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-32978: --- Summary: Incorrect number of dynamic part metric Key: SPARK-32978 URL: https://issues.apache.org/jira/browse/SPARK-32978 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-32978) Incorrect number of dynamic part metric

2020-09-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32978: Attachment: screenshot-1.png > Incorrect number of dynamic part metric >

[jira] [Updated] (SPARK-32977) [SQL] JavaDoc on Default Save mode Incorrect

2020-09-23 Thread Russell Spitzer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Spitzer updated SPARK-32977: Description: The JavaDoc says that the default save mode is dependent on DataSource

[jira] [Created] (SPARK-32977) [SQL] JavaDoc on Default Save mode Incorrect

2020-09-23 Thread Russell Spitzer (Jira)
Russell Spitzer created SPARK-32977: --- Summary: [SQL] JavaDoc on Default Save mode Incorrect Key: SPARK-32977 URL: https://issues.apache.org/jira/browse/SPARK-32977 Project: Spark Issue

[jira] [Commented] (SPARK-32976) Support column list in INSERT statement

2020-09-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200888#comment-17200888 ] Kent Yao commented on SPARK-32976: -- thanks for pinging me,looking into this > Support column list in

[jira] [Updated] (SPARK-32976) Support column list in INSERT statement

2020-09-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32976: Description: INSERT currently does not support named column lists.   {{INSERT INTO (col1, col2,…)

[jira] [Updated] (SPARK-32976) Support column list in INSERT statement

2020-09-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32976: Description: INSERT currently does not support named column lists.   {{INSERT INTO (col1, col2,…)

[jira] [Commented] (SPARK-32976) Support column list in INSERT statement

2020-09-23 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200877#comment-17200877 ] Xiao Li commented on SPARK-32976: - [~Qin Yao] Are you interested in this? > Support column list in

[jira] [Created] (SPARK-32976) Support column list in INSERT statement

2020-09-23 Thread Xiao Li (Jira)
Xiao Li created SPARK-32976: --- Summary: Support column list in INSERT statement Key: SPARK-32976 URL: https://issues.apache.org/jira/browse/SPARK-32976 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32973) FeatureHasher does not check categoricalCols in inputCols

2020-09-23 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200846#comment-17200846 ] Sean R. Owen commented on SPARK-32973: -- It looks like "real" is ignored here? I only see two

[jira] [Commented] (SPARK-32852) spark.sql.hive.metastore.jars support HDFS location

2020-09-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200798#comment-17200798 ] Yuming Wang commented on SPARK-32852: - Workaround: {code:sh} bin/spark-submit --deploy-mode cluster

[jira] [Commented] (SPARK-32975) [K8S] - executor fails to be restarted after it goes to ERROR/Failure state

2020-09-23 Thread Shenson Joseph (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200771#comment-17200771 ] Shenson Joseph commented on SPARK-32975: [~anirudh] [~eje] [~liyinan926] > [K8S] - executor

[jira] [Created] (SPARK-32975) [K8S] - executor fails to be restarted after it goes to ERROR/Failure state

2020-09-23 Thread Shenson Joseph (Jira)
Shenson Joseph created SPARK-32975: -- Summary: [K8S] - executor fails to be restarted after it goes to ERROR/Failure state Key: SPARK-32975 URL: https://issues.apache.org/jira/browse/SPARK-32975

[jira] [Commented] (SPARK-21481) Add indexOf method in ml.feature.HashingTF similar to mllib.feature.HashingTF

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200757#comment-17200757 ] Apache Spark commented on SPARK-21481: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-22674) PySpark breaks serialization of namedtuple subclasses

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-22674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200747#comment-17200747 ] Apache Spark commented on SPARK-22674: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-32965) pyspark reading csv files with utf_16le encoding

2020-09-23 Thread Punit Shah (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200743#comment-17200743 ] Punit Shah commented on SPARK-32965: It looks similar.  I've attached a utf-16le file to this

[jira] [Updated] (SPARK-32965) pyspark reading csv files with utf_16le encoding

2020-09-23 Thread Punit Shah (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Punit Shah updated SPARK-32965: --- Attachment: 32965.png > pyspark reading csv files with utf_16le encoding >

[jira] [Updated] (SPARK-32306) `approx_percentile` in Spark SQL gives incorrect results

2020-09-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32306: - Fix Version/s: 3.0.2 2.4.8 > `approx_percentile` in Spark SQL gives

[jira] [Updated] (SPARK-32965) pyspark reading csv files with utf_16le encoding

2020-09-23 Thread Punit Shah (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Punit Shah updated SPARK-32965: --- Attachment: 16le.csv > pyspark reading csv files with utf_16le encoding >

[jira] [Commented] (SPARK-32972) Pass all `mllib` module UTs in Scala 2.13

2020-09-23 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200732#comment-17200732 ] Yang Jie commented on SPARK-32972: -- There is only "training with sample weights"  in

[jira] [Commented] (SPARK-32974) FeatureHasher transform optimization

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200721#comment-17200721 ] Apache Spark commented on SPARK-32974: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-32974) FeatureHasher transform optimization

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200719#comment-17200719 ] Apache Spark commented on SPARK-32974: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-32974) FeatureHasher transform optimization

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32974: Assignee: (was: Apache Spark) > FeatureHasher transform optimization >

[jira] [Assigned] (SPARK-32974) FeatureHasher transform optimization

2020-09-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32974: Assignee: Apache Spark > FeatureHasher transform optimization >

  1   2   >