[jira] [Commented] (SPARK-21219) Task retry occurs on same executor due to race condition with blacklisting

[ https://issues.apache.org/jira/browse/SPARK-21219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083082#comment-16083082 ] Jose Soltren commented on SPARK-21219: -- I think it would be good to backport this to 2.2 and 2.1.

[jira] [Commented] (SPARK-21157) Report Total Memory Used by Spark Executors

[ https://issues.apache.org/jira/browse/SPARK-21157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061582#comment-16061582 ] Jose Soltren commented on SPARK-21157: -- Hello Marcelo - It's true, the design doc doesn't discuss

[jira] [Commented] (SPARK-20391) Properly rename the memory related fields in ExecutorSummary REST API

[ https://issues.apache.org/jira/browse/SPARK-20391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060097#comment-16060097 ] Jose Soltren commented on SPARK-20391: -- So, this is months old now and irrelevant, but since you

[jira] [Updated] (SPARK-21157) Report Total Memory Used by Spark Executors

[ https://issues.apache.org/jira/browse/SPARK-21157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Soltren updated SPARK-21157: - Attachment: TotalMemoryReportingDesignDoc.pdf > Report Total Memory Used by Spark Executors >

[jira] [Created] (SPARK-21157) Report Total Memory Used by Spark Executors

Jose Soltren created SPARK-21157: Summary: Report Total Memory Used by Spark Executors Key: SPARK-21157 URL: https://issues.apache.org/jira/browse/SPARK-21157 Project: Spark Issue Type:

[jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16051942#comment-16051942 ] Jose Soltren commented on SPARK-20760: -- Hello Ravi - current thinking is that this issue is a

[jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042177#comment-16042177 ] Jose Soltren commented on SPARK-20760: -- Hi Binzi: 1. If this is so then there is some error in my

[jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041027#comment-16041027 ] Jose Soltren commented on SPARK-20760: -- Hi - I've been researching this issue, and I agree with

[jira] [Reopened] (SPARK-9103) Tracking spark's memory usage

[ https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Soltren reopened SPARK-9103: - Work in progress. > Tracking spark's memory usage > - > >

[jira] [Commented] (SPARK-7200) Tungsten test suites should fail if memory leak is detected

[ https://issues.apache.org/jira/browse/SPARK-7200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15940604#comment-15940604 ] Jose Soltren commented on SPARK-7200: - [~joshrosen] please have a look at my PR. Is this what you had

[jira] [Commented] (SPARK-19982) JavaDatasetSuite.testJavaBeanEncoder sometimes fails with "Unable to generate an encoder for inner class"

[ https://issues.apache.org/jira/browse/SPARK-19982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930094#comment-15930094 ] Jose Soltren commented on SPARK-19982: -- Pasting in the exception from the link in case the link

[jira] [Commented] (SPARK-19982) JavaDatasetSuite.testJavaBeanEncoder sometimes fails with "Unable to generate an encoder for inner class"

[ https://issues.apache.org/jira/browse/SPARK-19982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928660#comment-15928660 ] Jose Soltren commented on SPARK-19982: -- [~cloud_fan] added this test as some work related to

[jira] [Created] (SPARK-19982) JavaDatasetSuite.testJavaBeanEncoder sometimes fails with "Unable to generate an encoder for inner class"

Jose Soltren created SPARK-19982: Summary: JavaDatasetSuite.testJavaBeanEncoder sometimes fails with "Unable to generate an encoder for inner class" Key: SPARK-19982 URL:

[jira] [Commented] (SPARK-18091) Deep if expressions cause Generated SpecificUnsafeProjection code to exceed JVM code size limit

[ https://issues.apache.org/jira/browse/SPARK-18091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15871702#comment-15871702 ] Jose Soltren commented on SPARK-18091: -- FWIW, anyone pulling this fix in the future will also want

[jira] [Commented] (SPARK-19181) SparkListenerSuite.local metrics fails when average executorDeserializeTime is too short.

[ https://issues.apache.org/jira/browse/SPARK-19181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15850408#comment-15850408 ] Jose Soltren commented on SPARK-19181: -- https://github.com/apache/spark/pull/16586 made some changes

[jira] [Commented] (SPARK-16554) Spark should kill executors when they are blacklisted

[ https://issues.apache.org/jira/browse/SPARK-16554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15828522#comment-15828522 ] Jose Soltren commented on SPARK-16554: -- Builds on some BlacklistTracker changes that should land

[jira] [Updated] (SPARK-16554) Spark should kill executors when they are blacklisted

[ https://issues.apache.org/jira/browse/SPARK-16554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Soltren updated SPARK-16554: - Shepherd: Imran Rashid > Spark should kill executors when they are blacklisted >

[jira] [Commented] (SPARK-16554) Spark should kill executors when they are blacklisted

[ https://issues.apache.org/jira/browse/SPARK-16554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15828520#comment-15828520 ] Jose Soltren commented on SPARK-16554: -- I have some changes ready, but I'm going to wait for

[jira] [Commented] (SPARK-19181) SparkListenerSuite.local metrics fails when average executorDeserializeTime is too short.

[ https://issues.apache.org/jira/browse/SPARK-19181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819186#comment-15819186 ] Jose Soltren commented on SPARK-19181: -- SPARK-2208 disabled a similar metric previously. >

[jira] [Created] (SPARK-19181) SparkListenerSuite.local metrics fails when average executorDeserializeTime is too short.

Jose Soltren created SPARK-19181: Summary: SparkListenerSuite.local metrics fails when average executorDeserializeTime is too short. Key: SPARK-19181 URL: https://issues.apache.org/jira/browse/SPARK-19181

[jira] [Commented] (SPARK-16654) UI Should show blacklisted executors & nodes

[ https://issues.apache.org/jira/browse/SPARK-16654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762067#comment-15762067 ] Jose Soltren commented on SPARK-16654: -- SPARK-8425 is resolved so I'll be working to get this

[jira] [Commented] (SPARK-16554) Spark should kill executors when they are blacklisted

[ https://issues.apache.org/jira/browse/SPARK-16554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709080#comment-15709080 ] Jose Soltren commented on SPARK-16554: -- This is a nice idea but I'm not sure how feasible it is. If

[jira] [Commented] (SPARK-16654) UI Should show blacklisted executors & nodes

[ https://issues.apache.org/jira/browse/SPARK-16654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15422721#comment-15422721 ] Jose Soltren commented on SPARK-16654: -- Alex, I'm trying to understand your July 20th comment. Are