[jira] [Commented] (SPARK-13198) sc.stop() does not clean up on driver, causes Java heap OOM.

2017-01-11 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818594#comment-15818594 ] Sean Owen commented on SPARK-13198: --- I think that's up to you if you're interested in this? it's not

[jira] [Commented] (SPARK-13198) sc.stop() does not clean up on driver, causes Java heap OOM.

2017-01-11 Thread Dmytro Bielievtsov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818498#comment-15818498 ] Dmytro Bielievtsov commented on SPARK-13198: [~srowen] Looks like a growing number of people

[jira] [Commented] (SPARK-13198) sc.stop() does not clean up on driver, causes Java heap OOM.

2016-02-08 Thread Herman Schistad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136774#comment-15136774 ] Herman Schistad commented on SPARK-13198: - Digging more into the dumped heap and running a memory

[jira] [Commented] (SPARK-13198) sc.stop() does not clean up on driver, causes Java heap OOM.

2016-02-08 Thread Herman Schistad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136757#comment-15136757 ] Herman Schistad commented on SPARK-13198: - Hi [~srowen], thanks for your reply. I have indeed

[jira] [Commented] (SPARK-13198) sc.stop() does not clean up on driver, causes Java heap OOM.

2016-02-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136773#comment-15136773 ] Sean Owen commented on SPARK-13198: --- I don't think stop() is relevant here. There's not an active

[jira] [Commented] (SPARK-13198) sc.stop() does not clean up on driver, causes Java heap OOM.

2016-02-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15135889#comment-15135889 ] Sean Owen commented on SPARK-13198: --- You've described a different problem, which you opened a duplicate

[jira] [Commented] (SPARK-13198) sc.stop() does not clean up on driver, causes Java heap OOM.

2016-02-05 Thread leo wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15135036#comment-15135036 ] leo wu commented on SPARK-13198: Hi, Sean I am trying to do this similar in an IPython/Jupyter

[jira] [Commented] (SPARK-13198) sc.stop() does not clean up on driver, causes Java heap OOM.

2016-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134028#comment-15134028 ] Sean Owen commented on SPARK-13198: --- I don't see evidence of a problem here yet. Stuff stays on heap