[
https://issues.apache.org/jira/browse/TEZ-704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14983781#comment-14983781
]
Hitesh Shah commented on TEZ-704:
---------------------------------
Sorry for the delay in looking into this.
Looks like this effectively stems from a bug in AMRMClient in YARN which does
not do the correct matching depending on what resources are supported i.e. in
AMRMClient::getMatchingRequests. Will file a bug for that - YARN-4323
> Tez MapReduce job hangs if setting mapreduce.reduce.cpu.vcores to be 2
> ----------------------------------------------------------------------
>
> Key: TEZ-704
> URL: https://issues.apache.org/jira/browse/TEZ-704
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Zhenxiao Luo
> Assignee: Hitesh Shah
>
> When running Hive on Tez in EMR hadoop districution, which set
> mapreduce.reduce.cpu.vcores to be 2 in mapred-site.xml, all MapReduce jobs
> get hang, without any progress.
> The problem seems like,
> Hive On Tez sets mapreduce.reduce.cpu.vcores to 2, so its application
> manager asks for a 2 cpu container, but the resource manager could not
> allocate a node for it, since all it has are 1 cpu containers.
> I saw the same problem when running MapReduce Job on Tez when setting
> mapreduce.reduce.cpu.vcores to be 2.
> This could be a bug in Tez MapReduce code.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
