[jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012161#comment-16012161 ] Binzi Cao commented on SPARK-20760: --- [~srowen] Thank you for the update. Some more informations 1. The

[jira] [Comment Edited] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012161#comment-16012161 ] Binzi Cao edited comment on SPARK-20760 at 5/16/17 11:19 AM: - [~srowen] Thank

[jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012176#comment-16012176 ] Binzi Cao commented on SPARK-20760: --- Ah, I see. I did something like rdd.count to trigger the cache

[jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012191#comment-16012191 ] Binzi Cao commented on SPARK-20760: --- More information, just did a quick test by removing the

[jira] [Created] (SPARK-20760) Memory Leak of RDD blocks

Binzi Cao created SPARK-20760: - Summary: Memory Leak of RDD blocks Key: SPARK-20760 URL: https://issues.apache.org/jira/browse/SPARK-20760 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Description: Memory leak for RDD blocks for a long time running rdd process. I have a long term

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Description: Memory leak for RDD blocks for a long time running rdd process. I have a long term

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Attachment: Screen Shot 2017-05-16 at 1.47.06 pm.png RDD blocks are growing crazily after running for

[jira] [Issue Comment Deleted] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Comment: was deleted (was: RDD blocks are growing crazily after running for a couple of hours) >

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Attachment: (was: Screen Shot 2017-05-16 at 1.47.06 pm.png) > Memory Leak of RDD blocks >

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Attachment: RDD Blocks .png RDD blocks are increasing crazily after running the app for a couple of

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Description: Memory leak for RDD blocks for a long time running rdd process. I have a long term

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Description: Memory leak for RDD blocks for a long time running rdd process. We have a long term

[jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16012213#comment-16012213 ] Binzi Cao commented on SPARK-20760: --- You might need to wait for a bit more time to reproduce it. This

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Attachment: Storage in spark 2.1.1.png RDD blocks in spark 2.1.1.png Spark 2.1.1 Test

[jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16042009#comment-16042009 ] Binzi Cao commented on SPARK-20760: --- Hi Jose, Thanks very much for your detailed explanation. I got

[jira] [Comment Edited] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040112#comment-16040112 ] Binzi Cao edited comment on SPARK-20760 at 6/7/17 3:47 AM: --- Hi David, Thanks

[jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040112#comment-16040112 ] Binzi Cao commented on SPARK-20760: --- Hi David, Thanks very much for the message, I did a test with

[jira] [Comment Edited] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602889#comment-16602889 ] Binzi Cao edited comment on SPARK-24189 at 9/4/18 10:49 AM: It seems I'm

[jira] [Commented] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602889#comment-16602889 ] Binzi Cao commented on SPARK-24189: --- It seems I'm hitting a similar issuel. I managed to set the kafka

[jira] [Comment Edited] (SPARK-24189) Spark Strcutured Streaming not working with the Kafka Transactions

[ https://issues.apache.org/jira/browse/SPARK-24189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16602889#comment-16602889 ] Binzi Cao edited comment on SPARK-24189 at 9/4/18 10:49 AM: It seems I'm