[
https://issues.apache.org/jira/browse/YARN-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Srikanth Kandula updated YARN-4056:
-----------------------------------
Description:
More than one container is allocated on many NM heartbeats. Yet, the current
scheduler allocates exactly one container per iteration over {{queues,
applications, priorities}}. When there are many queues, applications, or
priorities allocating only one container per iteration can needlessly increase
the duration of the NM heartbeat.
In this JIRA, we propose bundling. That is, allow arbitrarily many containers
to be allocated in a single iteration over {queues, applications and
priorities}.
was:
More than one container is allocated on many NM heartbeats. Yet, the current
scheduler allocates exactly one container per iteration over {queues,
applications, priorities}. When there are many queues, applications, or
priorities allocating only one container per iteration can needlessly increase
the duration of the NM heartbeat.
In this JIRA, we propose bundling. That is, allow arbitrarily many containers
to be allocated in a single iteration over {queues, applications and
priorities}.
> Bundling: Searching for multiple containers in a single pass over {queues,
> applications, priorities}
> ----------------------------------------------------------------------------------------------------
>
> Key: YARN-4056
> URL: https://issues.apache.org/jira/browse/YARN-4056
> Project: Hadoop YARN
> Issue Type: New Feature
> Components: capacityscheduler, resourcemanager, scheduler
> Reporter: Srikanth Kandula
> Attachments: bundling.docx
>
>
> More than one container is allocated on many NM heartbeats. Yet, the current
> scheduler allocates exactly one container per iteration over {{queues,
> applications, priorities}}. When there are many queues, applications, or
> priorities allocating only one container per iteration can needlessly
> increase the duration of the NM heartbeat.
>
> In this JIRA, we propose bundling. That is, allow arbitrarily many containers
> to be allocated in a single iteration over {queues, applications and
> priorities}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
