[
https://issues.apache.org/jira/browse/YARN-2041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14000602#comment-14000602
]
Karthik Kambatla commented on YARN-2041:
----------------------------------------
Also, the Fix Version is to track what versions the fix has gone into, usually
set by the committer committing the patch. Please use Target Version to express
intended target the fix should make it to.
> Hard to co-locate MR2 and Spark jobs on the same cluster in YARN
> ----------------------------------------------------------------
>
> Key: YARN-2041
> URL: https://issues.apache.org/jira/browse/YARN-2041
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: nodemanager
> Affects Versions: 2.3.0
> Reporter: Nishkam Ravi
>
> Performance of MR2 jobs falls drastically as YARN config parameter
> yarn.nodemanager.resource.memory-mb is increased beyond a certain value.
> Performance of Spark falls drastically as the value of
> yarn.nodemanager.resource.memory-mb is decreased beyond a certain value for a
> large data set.
> This makes it hard to co-locate MR2 and Spark jobs in YARN.
> The experiments are being conducted on a 6-node cluster. The following
> workloads are being run: TeraGen, TeraSort, TeraValidate, WordCount,
> ShuffleText and PageRank.
> Will add more details to this JIRA over time.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
