[
https://issues.apache.org/jira/browse/PIG-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14389469#comment-14389469
]
Daniel Dai commented on PIG-4488:
---------------------------------
Yes, you are right. The actual code cause the problem is:
{code}
for (Entry<String, String> entry : mrParamToDAGParamMap.entrySet()) {
if (dagAMConf.get(entry.getKey()) != null) {
dagAMConf.set(entry.getValue(), dagAMConf.get(entry.getKey()));
dagAMConf.unset(entry.getKey());
if (LOG.isDebugEnabled()) {
LOG.debug("MR->DAG Translating MR key: " + entry.getKey()
+ " to Tez key: " + entry.getValue()
+ " with value " + dagAMConf.get(entry.getValue()));
}
}
}
{code}
dagAMConf contains "mapreduce.job.queuename=default" when
mapreduce.job.queuename is not set , thus override "tez.queue.name".
> Pig on tez mask tez.queue.name
> ------------------------------
>
> Key: PIG-4488
> URL: https://issues.apache.org/jira/browse/PIG-4488
> Project: Pig
> Issue Type: Bug
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.15.0
>
>
> Set "tez.queue.name" does not work, however, set "mapreduce.job.queuename"
> works on tez. The reason is we mask tez.queue.name with
> mapreduce.job.queuename in MRToTezHelper:
> {code}
> String queueName = tezConf.get(JobContext.QUEUE_NAME,
> YarnConfiguration.DEFAULT_QUEUE_NAME);
> dagAMConf.setIfUnset(TezConfiguration.TEZ_QUEUE_NAME, queueName);
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
