[
https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14215604#comment-14215604
]
Wangda Tan commented on YARN-2745:
----------------------------------
Read through the paper as well. Thanks for great works from [~rgrandl], Ganesh
Ananthanarayanan, [~srikanthkandula], [~sriramsrao] and Aditya Akella!
What I can see is some idea of this can add to existing capacity framework
quite well. The proposal has the same way to allocate resource when NM is doing
heartbeat as same as fair/capacity schduler. And using a distance-based method
to select resource request which can best fit-in a new free resource reported
by NMs. Upon the changes of YARN-314, we can have multiple resource available
with same priority of a give application, the distance-based mechanism could be
a good way to decide which resource request will go first.
Any thoughts?
Thanks,
Wangda
> YARN new pluggable scheduler which does multi-resource packing
> --------------------------------------------------------------
>
> Key: YARN-2745
> URL: https://issues.apache.org/jira/browse/YARN-2745
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: resourcemanager, scheduler
> Reporter: Robert Grandl
> Attachments: sigcomm_14_tetris_talk.pptx, tetris_paper.pdf
>
>
> In this umbrella JIRA we propose a new pluggable scheduler, which accounts
> for all resources used by a task (CPU, memory, disk, network) and it is able
> to achieve three competing objectives: fairness, improve cluster utilization
> and reduces average job completion time.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
