[
https://issues.apache.org/jira/browse/YARN-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16178851#comment-16178851
]
Peter Bacsko edited comment on YARN-6504 at 9/25/17 11:07 AM:
--------------------------------------------------------------
Just my 2 cents: there could be Hadoop users out there who spent significant
amount of time optimizing their MR/Hive/Pig jobs to have the best memory/vcore
utilization but they're also interested in resource profiles. And these users
might not want to change their existing configuration where mem/vcores are
defined, because they're fine with it. But they want this feature to be enabled
for new jobs.
We could introduce a flag which tells whether we should go for profiles or
apply the mem/vcore settings that are already in the code - we can call it like
{{mapreduce.job.profiles.enabled}}.
So selective override might not be necessary, but being able to fall back to
the original behavior can be useful.
was (Author: pbacsko):
Just my 2 cents: there could be Hadoop users out there who spent significant
amount of time optimizing their MR/Hive/Pig jobs to have the best memory/vcore
utilization but they're also interested in resource profiles. And these users
might not want to change their existing configuration where mem/vcores are
defined, because they're fine with it. But they want this feature to be enabled
for new jobs.
We could introduce a flag which tells whether we should go for profiles or
apply the mem/vcore settings that are already in the code - like
{{mapreduce.job.profiles.enabled}}.
So selective override might not be necessary, but being able to fall back to
the original behavior can be useful.
> Add support for resource profiles in MapReduce
> ----------------------------------------------
>
> Key: YARN-6504
> URL: https://issues.apache.org/jira/browse/YARN-6504
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: nodemanager, resourcemanager
> Reporter: Varun Vasudev
> Assignee: Varun Vasudev
> Attachments: YARN-6504-YARN-3926.001.patch,
> YARN-6504.YARN-3926.002.patch, YARN-6504.YARN-3926.003.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
