[
https://issues.apache.org/jira/browse/MAPREDUCE-5132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13636875#comment-13636875
]
Sandy Ryza commented on MAPREDUCE-5132:
---------------------------------------
Definitely seems like a useful feature. This is likely to be the first of many
policies that automatically map submitted jobs to queues. It's possible that
we would want to choose a queue based on the amount of resources a job is
asking for, or even perhaps the name of the mapper class. Before handling this
case in particular, I think we should have a more unified approach for where we
want this job classification to happen. As the resource manager will only have
access to a limited subset of information about a job, I'm wondering whether it
might make more sense to implement on the client side?
> Enhance FairScheduler queue selection with Unix-SubGroups
> ---------------------------------------------------------
>
> Key: MAPREDUCE-5132
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5132
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: Ted Malaska
> Priority: Minor
> Attachments: FairSchedulerPlusCode.zip, MAPREDUCE-5132.NotTested.patch
>
>
> I have clients that use the primary group for other reasons and would like to
> select the fairScheduler queue by subgroup.
> Currently the fairscheduler can only link a job config property to a
> fairscheduler queue and subgroups are not in the job config.
> Now thankfully we can get this data from UserGroupInformation.createProxyUser
> which is cool because this is how TT currently see if it can copy data when
> kerberos is enabled. Once we have the sub-groups we just connect the first
> sub-group that matches a queue.
> I'll put up some code that I used to solve the problem in the short term.
> Note that there is an issue with this code. It doesn't populate the TT Web
> UI drop down menu correctly. I think I have a solution for that, but before
> I implement that I was wondering if the community has any feedback first.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
