[
https://issues.apache.org/jira/browse/MAPREDUCE-532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy updated MAPREDUCE-532:
------------------------------------
Component/s: contrib/capacity-sched
Summary: Allow admins of the Capacity Scheduler to set a hard-limit on
the capacity of a queue (was: Option to limit max tasks started per job/queue )
After discussions I'm changing the direction of this jira to simply allow for a
configured hard-limit on the capacity of queues.
With this feature the consumers of the 'external service' will have to submit
to a special queue for the service/resource, there-by limiting the fan-in for
the service.
> Allow admins of the Capacity Scheduler to set a hard-limit on the capacity of
> a queue
> -------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-532
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-532
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/capacity-sched
> Reporter: Rajiv Chittajallu
> Attachments: MAPREDUCE-532-1.patch, MAPREDUCE-532-2.patch,
> MAPREDUCE-532-3.patch
>
>
> For jobs which call external services, (eg: distcp, crawlers) user/admin
> should be able to control max parallel tasks spawned. There should be a
> mechanism to cap the capacity available for a queue/job.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.