Wilfred Spiegelenburg created YARN-5722:
-------------------------------------------
Summary: FairScheduler hides group resolution exceptions when
assigning queue
Key: YARN-5722
URL: https://issues.apache.org/jira/browse/YARN-5722
Project: Hadoop YARN
Issue Type: Bug
Components: fairscheduler
Affects Versions: 3.0.0-alpha1, 2.6.5
Reporter: Wilfred Spiegelenburg
Assignee: Wilfred Spiegelenburg
When a group based placement rule is used and the user does not have any groups
the reason for rejecting the application is hidden. An assignment will fail as
follows:
{code}
<rule name="primaryGroup" create="true" />
<rule name="reject" />
{code}
The error logged on the client side:
{code}
09/30 15:59:27 INFO mapreduce.JobSubmitter: Cleaning up the staging area
/user/test_user/.staging/job_1475223610304_6043
16/09/30 15:59:27 WARN security.UserGroupInformation:
PriviledgedActionException as:test_user (auth:SIMPLE)
cause:java.io.IOException: Failed to run job : Error assigning app to queue
default
java.io.IOException: Failed to run job : Error assigning app to queue default
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:301)
at
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:244)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1307)
{code}
The {{default}} queue name is passed in as part of the application submission
and not really the queue that is tried.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
