[jira] [Updated] (SPARK-36473) Add non-unified memory metrics

2021-08-11 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-36473: -- Description: Spark split memory to managed memory (storage + execution) and un-managed memory. And

[jira] [Commented] (SPARK-36476) cloudpickle: ValueError: Cell is empty

2021-08-11 Thread Oliver Mannion (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397126#comment-17397126 ] Oliver Mannion commented on SPARK-36476: Looks like a similar issue raised hereĀ 

[jira] [Updated] (SPARK-36476) cloudpickle: ValueError: Cell is empty

2021-08-11 Thread Oliver Mannion (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oliver Mannion updated SPARK-36476: --- Description: {code:java} File

[jira] [Updated] (SPARK-36476) cloudpickle: ValueError: Cell is empty

2021-08-11 Thread Oliver Mannion (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oliver Mannion updated SPARK-36476: --- Description: {code:java} File

[jira] [Created] (SPARK-36476) cloudpickle: ValueError: Cell is empty

2021-08-11 Thread Oliver Mannion (Jira)
Oliver Mannion created SPARK-36476: -- Summary: cloudpickle: ValueError: Cell is empty Key: SPARK-36476 URL: https://issues.apache.org/jira/browse/SPARK-36476 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-36475) Add doc about spark.shuffle.service.fetch.rdd.enabled

2021-08-11 Thread angerszhu (Jira)
angerszhu created SPARK-36475: - Summary: Add doc about spark.shuffle.service.fetch.rdd.enabled Key: SPARK-36475 URL: https://issues.apache.org/jira/browse/SPARK-36475 Project: Spark Issue Type:

[jira] [Commented] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

2021-08-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397105#comment-17397105 ] Apache Spark commented on SPARK-35881: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-25888) Service requests for persist() blocks via external service after dynamic deallocation

2021-08-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397102#comment-17397102 ] Apache Spark commented on SPARK-25888: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-34827) Support fetching shuffle blocks in batch with i/o encryption

2021-08-11 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397100#comment-17397100 ] Wenchen Fan commented on SPARK-34827: - Marking as a known issue LGTM. This is not a blocker to me as

[jira] [Resolved] (SPARK-36456) Clean up the depredation usage of o.a.c.io.IOUtils.closeQuietly

2021-08-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36456. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33682

[jira] [Assigned] (SPARK-36456) Clean up the depredation usage of o.a.c.io.IOUtils.closeQuietly

2021-08-11 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36456: - Assignee: Yang Jie > Clean up the depredation usage of o.a.c.io.IOUtils.closeQuietly

[jira] [Commented] (SPARK-36474) Mention pandas API on Spark in Spark overview pages

2021-08-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397082#comment-17397082 ] Apache Spark commented on SPARK-36474: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-36474) Mention pandas API on Spark in Spark overview pages

2021-08-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36474: Assignee: Apache Spark > Mention pandas API on Spark in Spark overview pages >

[jira] [Assigned] (SPARK-36474) Mention pandas API on Spark in Spark overview pages

2021-08-11 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36474: Assignee: (was: Apache Spark) > Mention pandas API on Spark in Spark overview pages

<    1   2