[jira] [Commented] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144360#comment-16144360 ] Jason Lowe commented on YARN-7110: -- Looks like Varun was driving that effort but may be busy with other

[jira] [Commented] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143954#comment-16143954 ] YunFan Zhou commented on YARN-7110: --- Thank [~jlowe]. Is there a plan for this issue? It seems like it

[jira] [Commented] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143945#comment-16143945 ] Jason Lowe commented on YARN-7110: -- OK, if that's why this was filed in YARN instead of SPARK then this is

[jira] [Commented] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143894#comment-16143894 ] YunFan Zhou commented on YARN-7110: --- [~jlowe] Thank Jason. I think this is more than just the spark

[jira] [Commented] (YARN-7110) NodeManager always crash for spark shuffle service out of memory

2017-08-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143834#comment-16143834 ] Jason Lowe commented on YARN-7110: -- The Spark shuffle service is not part of Hadoop but rather the Spark