[
https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szilard Nemeth updated YARN-8248:
---------------------------------
Description:
Job hangs when mapreduce.job.queuename is specified and the queue has 0 of any
resource (vcores / memory / other)
In this scenario, the job should be immediately rejected upon submission since
the specified queue cannot server the resource needs of the submitted job.
Command to run:
{code:java}
bin/yarn jar
"./share/hadoop/mapreduce/hadoop-mapreduce-examples-$MY_HADOOP_VERSION.jar" pi
-Dmapreduce.job.queuename=sample_queue 1 1000;{code}
fair-scheduler.xml queue config (excerpt):
{code:java}
<queue name="sample_queue">
<minResources>10000 mb,0vcores</minResources>
<maxResources>90000 mb,0vcores</maxResources>
<maxRunningApps>50</maxRunningApps>
<maxAMShare>-1.0f</maxAMShare>
<weight>2.0</weight>
<schedulingPolicy>fair</schedulingPolicy>
</queue>
{code}
Diagnostic message from the web UI:
{code:java}
Wed May 02 06:35:57 -0700 2018] Application is added to the scheduler and is
not yet activated. (Resource request: <memory:1536, vCores:1> exceeds current
queue or its parents maximum resource allowed).{code}
was:
Job hangs when mapreduce.job.queuename is specified and the queue has 0 of any
resource (vcores / memory / other)
In this scenario, the job should be immediately rejected upon submission since
the specified queue cannot server the resource needs of the submitted job.
{code:java}
bin/yarn jar
"./share/hadoop/mapreduce/hadoop-mapreduce-examples-$MY_HADOOP_VERSION.jar" pi
-Dmapreduce.job.queuename=sample_queue 1 1000;{code}
fair-scheduler.xml queue config (excerpt):
{code:java}
<minResources>10000 mb,0vcores</minResources>
<maxResources>90000 mb,0vcores</maxResources>
{code}
Diagnostic message from the web UI:
{code:java}
Wed May 02 06:35:57 -0700 2018] Application is added to the scheduler and is
not yet activated. (Resource request: <memory:1536, vCores:1> exceeds current
queue or its parents maximum resource allowed).{code}
> Job hangs when queue is specified and that queue has 0 capability of a
> resource
> -------------------------------------------------------------------------------
>
> Key: YARN-8248
> URL: https://issues.apache.org/jira/browse/YARN-8248
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Szilard Nemeth
> Assignee: Szilard Nemeth
> Priority: Major
>
> Job hangs when mapreduce.job.queuename is specified and the queue has 0 of
> any resource (vcores / memory / other)
> In this scenario, the job should be immediately rejected upon submission
> since the specified queue cannot server the resource needs of the submitted
> job.
>
> Command to run:
> {code:java}
> bin/yarn jar
> "./share/hadoop/mapreduce/hadoop-mapreduce-examples-$MY_HADOOP_VERSION.jar"
> pi -Dmapreduce.job.queuename=sample_queue 1 1000;{code}
> fair-scheduler.xml queue config (excerpt):
>
> {code:java}
> <queue name="sample_queue">
> <minResources>10000 mb,0vcores</minResources>
> <maxResources>90000 mb,0vcores</maxResources>
> <maxRunningApps>50</maxRunningApps>
> <maxAMShare>-1.0f</maxAMShare>
> <weight>2.0</weight>
> <schedulingPolicy>fair</schedulingPolicy>
> </queue>
> {code}
> Diagnostic message from the web UI:
> {code:java}
> Wed May 02 06:35:57 -0700 2018] Application is added to the scheduler and is
> not yet activated. (Resource request: <memory:1536, vCores:1> exceeds current
> queue or its parents maximum resource allowed).{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
