[jira] [Resolved] (SPARK-33740) hadoop configs in hive-site.xml can overrides pre-existing hadoop ones

[ https://issues.apache.org/jira/browse/SPARK-33740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33740. --- Fix Version/s: 3.1.0 3.0.2 Assignee: Kent Yao Resolution:

[jira] [Created] (SPARK-33756) BytesToBytesMap's iterator hasNext method should be idempotent.

Xianjin YE created SPARK-33756: -- Summary: BytesToBytesMap's iterator hasNext method should be idempotent. Key: SPARK-33756 URL: https://issues.apache.org/jira/browse/SPARK-33756 Project: Spark

[jira] [Created] (SPARK-33755) Allow creating orc table when row format separator is defined

xiepengjie created SPARK-33755: -- Summary: Allow creating orc table when row format separator is defined Key: SPARK-33755 URL: https://issues.apache.org/jira/browse/SPARK-33755 Project: Spark

[jira] [Commented] (SPARK-33730) Standardize warning types

[ https://issues.apache.org/jira/browse/SPARK-33730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247788#comment-17247788 ] Shril Kumar commented on SPARK-33730: - [~hyukjin.kwon], [~zero323] can I pick this up? >

[jira] [Commented] (SPARK-33527) Extend the function of decode so as consistent with mainstream databases

[ https://issues.apache.org/jira/browse/SPARK-33527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247786#comment-17247786 ] Apache Spark commented on SPARK-33527: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-33754) Update kubernetes/integration-tests/README.md to follow the default Hadoop profile updated

[ https://issues.apache.org/jira/browse/SPARK-33754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247776#comment-17247776 ] Apache Spark commented on SPARK-33754: -- User 'sarutak' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-33731) Standardize exception types

[ https://issues.apache.org/jira/browse/SPARK-33731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1724#comment-1724 ] Shril Kumar edited comment on SPARK-33731 at 12/11/20, 9:20 AM:

[jira] [Assigned] (SPARK-33754) Update kubernetes/integration-tests/README.md to follow the default Hadoop profile updated

[ https://issues.apache.org/jira/browse/SPARK-33754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33754: Assignee: Kousuke Saruta (was: Apache Spark) > Update

[jira] [Assigned] (SPARK-33754) Update kubernetes/integration-tests/README.md to follow the default Hadoop profile updated

[ https://issues.apache.org/jira/browse/SPARK-33754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33754: Assignee: Apache Spark (was: Kousuke Saruta) > Update

[jira] [Commented] (SPARK-33731) Standardize exception types

[ https://issues.apache.org/jira/browse/SPARK-33731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1724#comment-1724 ] Shril Kumar commented on SPARK-33731: - [~hyukjin.kwon] can you help me pick up this issue? >

[jira] [Created] (SPARK-33754) Update kubernetes/integration-tests/README.md to follow the default Hadoop profile updated

Kousuke Saruta created SPARK-33754: -- Summary: Update kubernetes/integration-tests/README.md to follow the default Hadoop profile updated Key: SPARK-33754 URL: https://issues.apache.org/jira/browse/SPARK-33754

[jira] [Commented] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247759#comment-17247759 ] Stavros Kontopoulos commented on SPARK-33737: - In addition current implementation has been

[jira] [Updated] (SPARK-33753) Reduce the memory footprint and gc of the cache (hadoopJobMetadata)

[ https://issues.apache.org/jira/browse/SPARK-33753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-33753: --- Description:   HadoopRDD uses soft-reference map to cache jobconf (rdd_id -> jobconf). When the number of

[jira] [Commented] (SPARK-33753) Reduce the memory footprint and gc of the cache (hadoopJobMetadata)

[ https://issues.apache.org/jira/browse/SPARK-33753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247755#comment-17247755 ] Apache Spark commented on SPARK-33753: -- User 'cxzl25' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33753) Reduce the memory footprint and gc of the cache (hadoopJobMetadata)

[ https://issues.apache.org/jira/browse/SPARK-33753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33753: Assignee: (was: Apache Spark) > Reduce the memory footprint and gc of the cache

[jira] [Assigned] (SPARK-33753) Reduce the memory footprint and gc of the cache (hadoopJobMetadata)

[ https://issues.apache.org/jira/browse/SPARK-33753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33753: Assignee: Apache Spark > Reduce the memory footprint and gc of the cache

[jira] [Commented] (SPARK-33753) Reduce the memory footprint and gc of the cache (hadoopJobMetadata)

[ https://issues.apache.org/jira/browse/SPARK-33753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247754#comment-17247754 ] Apache Spark commented on SPARK-33753: -- User 'cxzl25' has created a pull request for this issue:

[jira] [Updated] (SPARK-33753) Reduce the memory footprint and gc of the cache (hadoopJobMetadata)

[ https://issues.apache.org/jira/browse/SPARK-33753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-33753: --- Description:   HadoopRDD uses soft-reference map to cache jobconf (rdd_id -> jobconf). When the number of

[jira] [Updated] (SPARK-33753) Reduce the memory footprint and gc of the cache (hadoopJobMetadata)

[ https://issues.apache.org/jira/browse/SPARK-33753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-33753: --- Attachment: jobconf.png > Reduce the memory footprint and gc of the cache (hadoopJobMetadata) >

[jira] [Updated] (SPARK-33753) Reduce the memory footprint and gc of the cache (hadoopJobMetadata)

[ https://issues.apache.org/jira/browse/SPARK-33753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-33753: --- Description:   HadoopRDD uses soft-reference map to cache jobconf (rdd_id -> jobconf). When the number of

[jira] [Updated] (SPARK-33753) Reduce the memory footprint and gc of the cache (hadoopJobMetadata)

[ https://issues.apache.org/jira/browse/SPARK-33753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-33753: --- Attachment: fix_visual_gc.png fix_job_finish_time.png fix_gcutil.png >

[jira] [Updated] (SPARK-33753) Reduce the memory footprint and gc of the cache (hadoopJobMetadata)

[ https://issues.apache.org/jira/browse/SPARK-33753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-33753: --- Attachment: current_gcutil.png > Reduce the memory footprint and gc of the cache (hadoopJobMetadata) >

[jira] [Updated] (SPARK-33753) Reduce the memory footprint and gc of the cache (hadoopJobMetadata)

[ https://issues.apache.org/jira/browse/SPARK-33753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-33753: --- Attachment: current_visual_gc.png > Reduce the memory footprint and gc of the cache (hadoopJobMetadata) >

[jira] [Updated] (SPARK-33753) Reduce the memory footprint and gc of the cache (hadoopJobMetadata)

[ https://issues.apache.org/jira/browse/SPARK-33753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-33753: --- Attachment: current_job_finish_time.png > Reduce the memory footprint and gc of the cache

[jira] [Updated] (SPARK-33753) Reduce the memory footprint and gc of the cache (hadoopJobMetadata)

[ https://issues.apache.org/jira/browse/SPARK-33753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-33753: --- Description: HadoopRDD uses soft-reference map to cache jobconf (rdd_id -> jobconf). When the number of

[jira] [Created] (SPARK-33753) Reduce the memory footprint and gc of the cache (hadoopJobMetadata)

dzcxzl created SPARK-33753: -- Summary: Reduce the memory footprint and gc of the cache (hadoopJobMetadata) Key: SPARK-33753 URL: https://issues.apache.org/jira/browse/SPARK-33753 Project: Spark

<    1   2