[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-05-31 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15308673#comment-15308673 ] Davies Liu commented on SPARK-11293: I think your patch is not related to this bug, right? >

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-05-10 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278148#comment-15278148 ] Apache Spark commented on SPARK-11293: -- User 'lianhuiwang' has created a pull request for this

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-05-09 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276723#comment-15276723 ] Miles Crawford commented on SPARK-11293: Also biting us in 1.6.1 - we have to repartition our

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-04-20 Thread Nipun Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15249679#comment-15249679 ] Nipun Agarwal commented on SPARK-11293: --- I was using Apache spark 1.6 in EMR with spark streaming

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-04-12 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15237239#comment-15237239 ] Imran Rashid commented on SPARK-11293: -- For users that are hitting *real* OOMs from similar error

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-03-25 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212497#comment-15212497 ] Imran Rashid commented on SPARK-11293: -- I've seen a few people misled by the error msg, so I'd like

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-03-23 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15208772#comment-15208772 ] Josh Rosen commented on SPARK-11293: I suspect that most of these cases are caused by a

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-03-23 Thread William Dee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15208203#comment-15208203 ] William Dee commented on SPARK-11293: - I don't have such verbose logging as above but can confirm

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-03-22 Thread Yi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15206635#comment-15206635 ] Yi Zhou commented on SPARK-11293: - seem to hit the issue with Spark 1.6.1 not sure if this is relative to

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-03-21 Thread Damian Momot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204064#comment-15204064 ] Damian Momot commented on SPARK-11293: -- It looks we are getting same errors on 1.6.0 too >

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-03-19 Thread Nezih Yigitbasi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200543#comment-15200543 ] Nezih Yigitbasi commented on SPARK-11293: - [~joshrosen] any plans to fix this? I believe we are

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-02-25 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168168#comment-15168168 ] Russell Alexander Spitzer commented on SPARK-11293: --- Saw a similar issue loading the

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-02-18 Thread Ovidiu Marcu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152042#comment-15152042 ] Ovidiu Marcu commented on SPARK-11293: -- Whyle trying to execute Analytics Triangle Count with

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-02-02 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128935#comment-15128935 ] Mridul Muralidharan commented on SPARK-11293: - Not iterating to the end has a bunch of issues

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-01-14 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15097987#comment-15097987 ] Daniel Darabos commented on SPARK-11293: > so should be reopened or not? is there still a memory

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-01-14 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098011#comment-15098011 ] Daniel Darabos commented on SPARK-11293: > so add 1.6.0 as affected version... Done. >

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-01-14 Thread Romi Kuntsman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098008#comment-15098008 ] Romi Kuntsman commented on SPARK-11293: --- so add 1.6.0 as affected version... > Spillable

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-01-13 Thread Romi Kuntsman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15096375#comment-15096375 ] Romi Kuntsman commented on SPARK-11293: --- so should be reopened or not? is there still a memory

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-01-05 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083311#comment-15083311 ] Daniel Darabos commented on SPARK-11293: I have a somewhat contrived example that still leaks in

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-01-05 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083326#comment-15083326 ] Daniel Darabos commented on SPARK-11293: Sorry, my example was overly complicated. This one

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2015-11-17 Thread Romi Kuntsman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008738#comment-15008738 ] Romi Kuntsman commented on SPARK-11293: --- The memory manager was rewritten there? Could it have

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2015-11-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986413#comment-14986413 ] Apache Spark commented on SPARK-11293: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2015-10-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972261#comment-14972261 ] Apache Spark commented on SPARK-11293: -- User 'JoshRosen' has created a pull request for this issue: