[
https://issues.apache.org/jira/browse/YARN-9991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982575#comment-16982575
]
Prabhu Joseph commented on YARN-9991:
-------------------------------------
[~snemeth] Thanks for the patch. The patch looks good to me. Few minor comments
related to the old patch.
1. The two configs introduced *application-tag-based-placement.enable* and
*application-tag-based-placement.username.whitelist* are not consistent with
other yarn configs. Can we add the prefix "*yarn.resourcemanager."*
2. There are few logs in RMAppManager which points to userId which may mislead
to user.
{code:java}
User '{}' is not allowed to do placement based
Found userId '{}' in application tag
userId was not found in application tags
{code}
3. If possible, Can you also share the reference to userid in hive for
validation.
Thanks.
> Queue mapping based on userid passed through application tag: Change prefix
> to 'userid'
> ---------------------------------------------------------------------------------------
>
> Key: YARN-9991
> URL: https://issues.apache.org/jira/browse/YARN-9991
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: scheduler
> Reporter: Szilard Nemeth
> Assignee: Szilard Nemeth
> Priority: Major
> Fix For: 3.3.0
>
> Attachments: YARN-9991.001.patch
>
>
> There are situations when the real submitting user differs from the user what
> arrives to YARN. For example in case of a Hive application when Hive
> impersonation is turned off, the hive queries will run as Hive user and the
> mapping is done based on this username. Unfortunately in this case YARN
> doesn't have any information about the real user and there are cases when the
> customer may want to map these applications to the real submitting user's
> queue instead of the Hive queue.
> For these cases, if they would pass the username in the application tag we
> may read it and use it during the queue mapping, if that user has rights to
> run on the real user's queue.
> UPDATE REQUIRED: Hive jobs are using "userid=" instead of "u=" for the
> application tags.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
