[jira] [Commented] (SPARK-29593) Enhance Cluster Managers to be Pluggable

2019-10-24 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959078#comment-16959078 ] Marcelo Masiero Vanzin commented on SPARK-29593: bq. Is there any plans

[jira] [Commented] (SPARK-29593) Enhance Cluster Managers to be Pluggable

2019-10-24 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959063#comment-16959063 ] Marcelo Masiero Vanzin commented on SPARK-29593: This already exists: {{

[jira] [Created] (SPARK-29562) SQLAppStatusListener metrics aggregation is slow and memory hungry

2019-10-22 Thread Marcelo Masiero Vanzin (Jira)
Marcelo Masiero Vanzin created SPARK-29562: -- Summary: SQLAppStatusListener metrics aggregation is slow and memory hungry Key: SPARK-29562 URL: https://issues.apache.org/jira/browse/SPARK-29562

[jira] [Assigned] (SPARK-28762) Read JAR main class if JAR is not located in local file system

2019-10-17 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-28762: -- Assignee: Ivan Gozali > Read JAR main class if JAR is not located in

[jira] [Resolved] (SPARK-28762) Read JAR main class if JAR is not located in local file system

2019-10-17 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-28762. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull reque

[jira] [Commented] (SPARK-29396) Extend Spark plugin interface to driver

2019-10-17 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954053#comment-16954053 ] Marcelo Masiero Vanzin commented on SPARK-29396: Wow, sorry, I missed al

[jira] [Resolved] (SPARK-28869) Roll over event log files

2019-10-17 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-28869. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull reque

[jira] [Assigned] (SPARK-28869) Roll over event log files

2019-10-17 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-28869: -- Assignee: Jungtaek Lim > Roll over event log files >

[jira] [Assigned] (SPARK-28947) Status logging occurs on every state change but not at an interval for liveness.

2019-10-15 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-28947: -- Assignee: Kent Yao > Status logging occurs on every state change but

[jira] [Resolved] (SPARK-28947) Status logging occurs on every state change but not at an interval for liveness.

2019-10-15 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-28947. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull reque

[jira] [Commented] (SPARK-29435) Spark 3 doesnt work with older shuffle service

2019-10-10 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948987#comment-16948987 ] Marcelo Masiero Vanzin commented on SPARK-29435: I think you have to set

[jira] [Created] (SPARK-29399) Remove old ExecutorPlugin API (or wrap it using new API)

2019-10-08 Thread Marcelo Masiero Vanzin (Jira)
Marcelo Masiero Vanzin created SPARK-29399: -- Summary: Remove old ExecutorPlugin API (or wrap it using new API) Key: SPARK-29399 URL: https://issues.apache.org/jira/browse/SPARK-29399 Project:

[jira] [Created] (SPARK-29398) Allow RPC endpoints to use dedicated thread pools

2019-10-08 Thread Marcelo Masiero Vanzin (Jira)
Marcelo Masiero Vanzin created SPARK-29398: -- Summary: Allow RPC endpoints to use dedicated thread pools Key: SPARK-29398 URL: https://issues.apache.org/jira/browse/SPARK-29398 Project: Spark

[jira] [Created] (SPARK-29397) Create new plugin interface for driver and executor plugins

2019-10-08 Thread Marcelo Masiero Vanzin (Jira)
Marcelo Masiero Vanzin created SPARK-29397: -- Summary: Create new plugin interface for driver and executor plugins Key: SPARK-29397 URL: https://issues.apache.org/jira/browse/SPARK-29397 Proje

[jira] [Created] (SPARK-29396) Extend Spark plugin interface to driver

2019-10-08 Thread Marcelo Masiero Vanzin (Jira)
Marcelo Masiero Vanzin created SPARK-29396: -- Summary: Extend Spark plugin interface to driver Key: SPARK-29396 URL: https://issues.apache.org/jira/browse/SPARK-29396 Project: Spark I

[jira] [Assigned] (SPARK-28917) Jobs can hang because of race of RDD.dependencies

2019-10-08 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-28917: -- Assignee: Imran Rashid > Jobs can hang because of race of RDD.depende

[jira] [Resolved] (SPARK-28917) Jobs can hang because of race of RDD.dependencies

2019-10-08 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-28917. Fix Version/s: 3.0.0 2.4.5 Resolution: Fixed Iss

[jira] [Resolved] (SPARK-29054) Invalidate Kafka consumer when new delegation token available

2019-10-03 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-29054. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull reque

[jira] [Assigned] (SPARK-29054) Invalidate Kafka consumer when new delegation token available

2019-10-03 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-29054: -- Assignee: Gabor Somogyi > Invalidate Kafka consumer when new delegati

[jira] [Resolved] (SPARK-29273) Spark peakExecutionMemory metrics is zero

2019-10-02 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-29273. Fix Version/s: 3.0.0 Assignee: huangweiyi Resolution: Fixed

[jira] [Assigned] (SPARK-29321) Possible memory leak in Spark

2019-10-01 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin reassigned SPARK-29321: -- Assignee: (was: Jungtaek Lim) > Possible memory leak in Spark > -

[jira] [Resolved] (SPARK-29055) Memory leak in Spark

2019-10-01 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-29055. Fix Version/s: 3.0.0 2.4.5 Assignee: Jungtaek L

[jira] [Created] (SPARK-29319) Memory and disk usage not accurate when blocks are evicted and re-loaded in memory

2019-10-01 Thread Marcelo Masiero Vanzin (Jira)
Marcelo Masiero Vanzin created SPARK-29319: -- Summary: Memory and disk usage not accurate when blocks are evicted and re-loaded in memory Key: SPARK-29319 URL: https://issues.apache.org/jira/browse/SPARK-2

[jira] [Resolved] (SPARK-29070) Make SparkLauncher log full spark-submit command line

2019-09-27 Thread Marcelo Masiero Vanzin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Masiero Vanzin resolved SPARK-29070. Fix Version/s: 3.0.0 Assignee: Jeff Evans Resolution: Fixed

<    1   2