[jira] [Commented] (SPARK-32526) Let sql/catalyst module compile for Scala 2.13

2020-08-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170640#comment-17170640 ] Yang Jie commented on SPARK-32526: -- There are 97 test caseFAILED and 3 test case ABORTED in

[jira] [Comment Edited] (SPARK-32526) Let sql/catalyst module compile for Scala 2.13

2020-08-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170640#comment-17170640 ] Yang Jie edited comment on SPARK-32526 at 8/4/20, 8:01 AM: --- There are 97 test

[jira] [Commented] (SPARK-32526) Let sql/catalyst module compile for Scala 2.13

2020-08-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170626#comment-17170626 ] Yang Jie commented on SPARK-32526: -- [~srowen] Can this issue be a sub-task of

[jira] [Assigned] (SPARK-32526) Let sql/catalyst module compile for Scala 2.13

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32526: Assignee: (was: Apache Spark) > Let sql/catalyst module compile for Scala 2.13 >

[jira] [Commented] (SPARK-32526) Let sql/catalyst module compile for Scala 2.13

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170625#comment-17170625 ] Apache Spark commented on SPARK-32526: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-32526) Let sql/catalyst module compile for Scala 2.13

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32526: Assignee: Apache Spark > Let sql/catalyst module compile for Scala 2.13 >

[jira] [Commented] (SPARK-32526) Let sql/catalyst module compile for Scala 2.13

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170624#comment-17170624 ] Apache Spark commented on SPARK-32526: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-32524) SharedSparkSession should clean up InMemoryRelation.ser

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170576#comment-17170576 ] Apache Spark commented on SPARK-32524: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-32492) Fulfill missing column meta information for thrift server client tools

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170618#comment-17170618 ] Apache Spark commented on SPARK-32492: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Created] (SPARK-32526) Let sql/catalyst module compile for Scala 2.13

2020-08-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-32526: Summary: Let sql/catalyst module compile for Scala 2.13 Key: SPARK-32526 URL: https://issues.apache.org/jira/browse/SPARK-32526 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-32492) Fulfill missing column meta information for thrift server client tools

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170619#comment-17170619 ] Apache Spark commented on SPARK-32492: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-32519) test of org.apache.spark.sql.kafka010.KafkaSourceStressSuite failed for aarch64

2020-08-04 Thread huangtianhua (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170581#comment-17170581 ] huangtianhua commented on SPARK-32519: -- Thanks all. I will test this on aarch64 platform. > test

[jira] [Updated] (SPARK-32526) Let sql/catalyst module compile for Scala 2.13

2020-08-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-32526: - Attachment: catalyst-failed-cases > Let sql/catalyst module compile for Scala 2.13 >

[jira] [Updated] (SPARK-32527) How to disable port 8080 in Spark?

2020-08-04 Thread Fakrul Razi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fakrul Razi updated SPARK-32527: Description: I am running Apache Spark 2.3.3 in Standalone Mode with client deploy mode. By

[jira] [Resolved] (SPARK-32524) SharedSparkSession should clean up InMemoryRelation.ser

2020-08-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32524. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29346

[jira] [Assigned] (SPARK-32524) SharedSparkSession should clean up InMemoryRelation.ser

2020-08-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32524: Assignee: Dongjoon Hyun > SharedSparkSession should clean up InMemoryRelation.ser >

[jira] [Created] (SPARK-32527) How to disable port 8080 in Spark?

2020-08-04 Thread Fakrul Razi (Jira)
Fakrul Razi created SPARK-32527: --- Summary: How to disable port 8080 in Spark? Key: SPARK-32527 URL: https://issues.apache.org/jira/browse/SPARK-32527 Project: Spark Issue Type: Question

[jira] [Commented] (SPARK-32531) Add benchmarks for nested structs and arrays for different file formats

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171108#comment-17171108 ] Apache Spark commented on SPARK-32531: -- User 'msamirkhan' has created a pull request for this

[jira] [Assigned] (SPARK-32531) Add benchmarks for nested structs and arrays for different file formats

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32531: Assignee: (was: Apache Spark) > Add benchmarks for nested structs and arrays for

[jira] [Commented] (SPARK-32531) Add benchmarks for nested structs and arrays for different file formats

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171106#comment-17171106 ] Apache Spark commented on SPARK-32531: -- User 'msamirkhan' has created a pull request for this

[jira] [Assigned] (SPARK-32531) Add benchmarks for nested structs and arrays for different file formats

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32531: Assignee: Apache Spark > Add benchmarks for nested structs and arrays for different file

[jira] [Created] (SPARK-32535) Query with broadcast hints fail when query has a WITH clause

2020-08-04 Thread Arvind Krishnan (Jira)
Arvind Krishnan created SPARK-32535: --- Summary: Query with broadcast hints fail when query has a WITH clause Key: SPARK-32535 URL: https://issues.apache.org/jira/browse/SPARK-32535 Project: Spark

[jira] [Updated] (SPARK-32528) The analyze method should make sure the plan is analyzed

2020-08-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32528: Description: In tests, we usually call `plan.analyze` to get the analyzed plan and test

[jira] [Updated] (SPARK-32531) Add benchmarks for nested structs and arrays for different file formats

2020-08-04 Thread Muhammad Samir Khan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated SPARK-32531: Summary: Add benchmarks for nested structs and arrays for different file formats

[jira] [Updated] (SPARK-32531) Add benchmarks for nested structs and arrays for different file formats

2020-08-04 Thread Muhammad Samir Khan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated SPARK-32531: Description: We had found that Spark performance was slow as compared to PIG on

[jira] [Commented] (SPARK-32502) Please fix CVE related to Guava 14.0.1

2020-08-04 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171197#comment-17171197 ] L. C. Hsieh commented on SPARK-32502: - I did some testings in the PRs. Few changes are required to

[jira] [Assigned] (SPARK-32532) Improve ORC read/write performance on nested structs and array of structs

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32532: Assignee: Apache Spark > Improve ORC read/write performance on nested structs and array

[jira] [Commented] (SPARK-32532) Improve ORC read/write performance on nested structs and array of structs

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171117#comment-17171117 ] Apache Spark commented on SPARK-32532: -- User 'msamirkhan' has created a pull request for this

[jira] [Assigned] (SPARK-32532) Improve ORC read/write performance on nested structs and array of structs

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32532: Assignee: (was: Apache Spark) > Improve ORC read/write performance on nested structs

[jira] [Commented] (SPARK-32532) Improve ORC read/write performance on nested structs and array of structs

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171118#comment-17171118 ] Apache Spark commented on SPARK-32532: -- User 'msamirkhan' has created a pull request for this

[jira] [Created] (SPARK-32534) Cannot load a Pipeline Model on a stopped Spark Context

2020-08-04 Thread Kevin Van Lieshout (Jira)
Kevin Van Lieshout created SPARK-32534: -- Summary: Cannot load a Pipeline Model on a stopped Spark Context Key: SPARK-32534 URL: https://issues.apache.org/jira/browse/SPARK-32534 Project: Spark

[jira] [Commented] (SPARK-31419) Document Table-valued Function and Inline Table

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171187#comment-17171187 ] Apache Spark commented on SPARK-31419: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-31419) Document Table-valued Function and Inline Table

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171185#comment-17171185 ] Apache Spark commented on SPARK-31419: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-32533) Improve Avro read/write performance on nested structs and array of structs

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171184#comment-17171184 ] Apache Spark commented on SPARK-32533: -- User 'msamirkhan' has created a pull request for this

[jira] [Assigned] (SPARK-32533) Improve Avro read/write performance on nested structs and array of structs

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32533: Assignee: (was: Apache Spark) > Improve Avro read/write performance on nested

[jira] [Commented] (SPARK-32533) Improve Avro read/write performance on nested structs and array of structs

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171183#comment-17171183 ] Apache Spark commented on SPARK-32533: -- User 'msamirkhan' has created a pull request for this

[jira] [Assigned] (SPARK-32533) Improve Avro read/write performance on nested structs and array of structs

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32533: Assignee: Apache Spark > Improve Avro read/write performance on nested structs and array

[jira] [Resolved] (SPARK-32507) Main Page

2020-08-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32507. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29320

[jira] [Resolved] (SPARK-32525) The layout of monitoring.html is broken

2020-08-04 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-32525. Resolution: Fixed This issue is resolved in https://github.com/apache/spark/pull/29345 >

[jira] [Comment Edited] (SPARK-32527) How to disable port 8080 in Spark?

2020-08-04 Thread Rohit Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171069#comment-17171069 ] Rohit Mishra edited comment on SPARK-32527 at 8/4/20, 7:16 PM: ---

[jira] [Commented] (SPARK-32527) How to disable port 8080 in Spark?

2020-08-04 Thread Rohit Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171069#comment-17171069 ] Rohit Mishra commented on SPARK-32527: -- [~shinudin], * Please use stack overflow for any question.

[jira] [Created] (SPARK-32530) SPIP: Kotlin support for Apache Spark

2020-08-04 Thread Pasha Finkeshteyn (Jira)
Pasha Finkeshteyn created SPARK-32530: - Summary: SPIP: Kotlin support for Apache Spark Key: SPARK-32530 URL: https://issues.apache.org/jira/browse/SPARK-32530 Project: Spark Issue Type:

[jira] [Created] (SPARK-32531) Add benchmarks for nested structs and arrays for different data types

2020-08-04 Thread Muhammad Samir Khan (Jira)
Muhammad Samir Khan created SPARK-32531: --- Summary: Add benchmarks for nested structs and arrays for different data types Key: SPARK-32531 URL: https://issues.apache.org/jira/browse/SPARK-32531

[jira] [Updated] (SPARK-32532) Improve ORC read/write performance on nested structs and array of structs

2020-08-04 Thread Muhammad Samir Khan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated SPARK-32532: Description: Have some improvements for ORC file format to reduce time taken when

[jira] [Created] (SPARK-32533) Improve Avro read/write performance on nested structs and array of structs

2020-08-04 Thread Muhammad Samir Khan (Jira)
Muhammad Samir Khan created SPARK-32533: --- Summary: Improve Avro read/write performance on nested structs and array of structs Key: SPARK-32533 URL: https://issues.apache.org/jira/browse/SPARK-32533

[jira] [Created] (SPARK-32532) Improve ORC read/write performance on nested structs and array of structs

2020-08-04 Thread Muhammad Samir Khan (Jira)
Muhammad Samir Khan created SPARK-32532: --- Summary: Improve ORC read/write performance on nested structs and array of structs Key: SPARK-32532 URL: https://issues.apache.org/jira/browse/SPARK-32532

[jira] [Commented] (SPARK-32427) Omit USING in CREATE TABLE via JDBC Table Catalog

2020-08-04 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171020#comment-17171020 ] Huaxin Gao commented on SPARK-32427: [~maxgekk] I made the tableProvider to be optional to omit

[jira] [Updated] (SPARK-32530) SPIP: Kotlin support for Apache Spark

2020-08-04 Thread Pasha Finkeshteyn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pasha Finkeshteyn updated SPARK-32530: -- Issue Type: Improvement (was: Bug) > SPIP: Kotlin support for Apache Spark >

[jira] [Updated] (SPARK-32532) Improve ORC read/write performance on nested structs and array of structs

2020-08-04 Thread Muhammad Samir Khan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated SPARK-32532: Description: Have some improvements for ORC file format to reduce time taken when

[jira] [Updated] (SPARK-32003) Shuffle files for lost executor are not unregistered if fetch failure occurs after executor is lost

2020-08-04 Thread Imran Rashid (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-32003: - Fix Version/s: 3.0.1 > Shuffle files for lost executor are not unregistered if fetch failure

[jira] [Updated] (SPARK-32527) How to disable port 8080 in Spark?

2020-08-04 Thread Rohit Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Mishra updated SPARK-32527: - Priority: Minor (was: Critical) > How to disable port 8080 in Spark? >

[jira] [Resolved] (SPARK-32527) How to disable port 8080 in Spark?

2020-08-04 Thread Rohit Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Mishra resolved SPARK-32527. -- Resolution: Not A Problem > How to disable port 8080 in Spark? >

[jira] [Commented] (SPARK-32528) The analyze method should make sure the plan is analyzed

2020-08-04 Thread Rohit Mishra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171062#comment-17171062 ] Rohit Mishra commented on SPARK-32528: -- [~cloud_fan], Can you please populate the description

[jira] [Commented] (SPARK-32529) Spark 3.0 History Server May Never Finish One Round Log Dir Scan

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170926#comment-17170926 ] Apache Spark commented on SPARK-32529: -- User 'yanxiaole' has created a pull request for this issue:

[jira] [Commented] (SPARK-32529) Spark 3.0 History Server May Never Finish One Round Log Dir Scan

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170925#comment-17170925 ] Apache Spark commented on SPARK-32529: -- User 'yanxiaole' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32529) Spark 3.0 History Server May Never Finish One Round Log Dir Scan

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32529: Assignee: Apache Spark > Spark 3.0 History Server May Never Finish One Round Log Dir

[jira] [Assigned] (SPARK-32529) Spark 3.0 History Server May Never Finish One Round Log Dir Scan

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32529: Assignee: (was: Apache Spark) > Spark 3.0 History Server May Never Finish One Round

[jira] [Commented] (SPARK-32003) Shuffle files for lost executor are not unregistered if fetch failure occurs after executor is lost

2020-08-04 Thread Imran Rashid (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170945#comment-17170945 ] Imran Rashid commented on SPARK-32003: -- Fixed in 3.0.1 by

[jira] [Updated] (SPARK-32003) Shuffle files for lost executor are not unregistered if fetch failure occurs after executor is lost

2020-08-04 Thread Imran Rashid (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-32003: - Fix Version/s: 2.4.7 > Shuffle files for lost executor are not unregistered if fetch failure

[jira] [Commented] (SPARK-32003) Shuffle files for lost executor are not unregistered if fetch failure occurs after executor is lost

2020-08-04 Thread Imran Rashid (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171083#comment-17171083 ] Imran Rashid commented on SPARK-32003: -- Fixed in 2.4.7 by

[jira] [Commented] (SPARK-32527) How to disable port 8080 in Spark?

2020-08-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171080#comment-17171080 ] Sean R. Owen commented on SPARK-32527: -- Yep, SO is a better place for questions. That said I think

[jira] [Created] (SPARK-32528) The analyze method make sure the plan is analyzed

2020-08-04 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-32528: --- Summary: The analyze method make sure the plan is analyzed Key: SPARK-32528 URL: https://issues.apache.org/jira/browse/SPARK-32528 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32528) The analyze method should make sure the plan is analyzed

2020-08-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32528: Summary: The analyze method should make sure the plan is analyzed (was: The analyze method make

[jira] [Assigned] (SPARK-32528) The analyze method make sure the plan is analyzed

2020-08-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32528: --- Assignee: Wenchen Fan > The analyze method make sure the plan is analyzed >

[jira] [Assigned] (SPARK-32528) The analyze method should make sure the plan is analyzed

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32528: Assignee: Wenchen Fan (was: Apache Spark) > The analyze method should make sure the

[jira] [Commented] (SPARK-32528) The analyze method should make sure the plan is analyzed

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170842#comment-17170842 ] Apache Spark commented on SPARK-32528: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32528) The analyze method should make sure the plan is analyzed

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32528: Assignee: Apache Spark (was: Wenchen Fan) > The analyze method should make sure the

[jira] [Commented] (SPARK-32528) The analyze method should make sure the plan is analyzed

2020-08-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170843#comment-17170843 ] Apache Spark commented on SPARK-32528: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32499) Use {} for structs and maps in show()

2020-08-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32499: --- Assignee: Maxim Gekk > Use {} for structs and maps in show() >

[jira] [Resolved] (SPARK-32499) Use {} for structs and maps in show()

2020-08-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32499. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29308

[jira] [Updated] (SPARK-32526) Let sql/catalyst module tests pass for Scala 2.13

2020-08-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-32526: - Summary: Let sql/catalyst module tests pass for Scala 2.13 (was: Let sql/catalyst module

[jira] [Created] (SPARK-32529) Spark 3.0 History Server May Never Finish One Round Log Dir Scan

2020-08-04 Thread Yan Xiaole (Jira)
Yan Xiaole created SPARK-32529: -- Summary: Spark 3.0 History Server May Never Finish One Round Log Dir Scan Key: SPARK-32529 URL: https://issues.apache.org/jira/browse/SPARK-32529 Project: Spark

[jira] [Commented] (SPARK-32526) Let sql/catalyst module compile for Scala 2.13

2020-08-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170754#comment-17170754 ] Sean R. Owen commented on SPARK-32526: -- Yes, I know [~dongjoon] has also been working on tests and

[jira] [Updated] (SPARK-32526) Let sql/catalyst module compile for Scala 2.13

2020-08-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-32526: - Parent: SPARK-25075 Issue Type: Sub-task (was: Task) > Let sql/catalyst module compile

[jira] [Assigned] (SPARK-23431) Expose the new executor memory metrics at the stage level

2020-08-04 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-23431: -- Assignee: Terry Kim > Expose the new executor memory metrics at the stage level >

[jira] [Resolved] (SPARK-23431) Expose the new executor memory metrics at the stage level

2020-08-04 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-23431. Resolution: Fixed The issue is resolved in https://github.com/apache/spark/pull/29020 >

[jira] [Commented] (SPARK-32037) Rename blacklisting feature to avoid language with racist connotation

2020-08-04 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17170817#comment-17170817 ] Thomas Graves commented on SPARK-32037: --- allowlist and blocklist have been used by others. Seems