[
https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14215274#comment-14215274
]
Karthik Kambatla commented on YARN-2745:
----------------------------------------
Read the paper and synced up with Srikanth, Robert and Ganesh offline.
The work is indeed something we should definitely get into YARN - preferably
into both capacity and fair schedulers, instead of a completely new scheduler.
Srikanth and Robert have offered to post a design document, that summarizes the
changes (more concise than in the paper). AFAICT, bulk of the work is
scheduler-agnostic and the scheduler-specific parts could be implemented
separately for the two schedulers.
> YARN new pluggable scheduler which does multi-resource packing
> --------------------------------------------------------------
>
> Key: YARN-2745
> URL: https://issues.apache.org/jira/browse/YARN-2745
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: resourcemanager, scheduler
> Reporter: Robert Grandl
> Attachments: sigcomm_14_tetris_talk.pptx, tetris_paper.pdf
>
>
> In this umbrella JIRA we propose a new pluggable scheduler, which accounts
> for all resources used by a task (CPU, memory, disk, network) and it is able
> to achieve three competing objectives: fairness, improve cluster utilization
> and reduces average job completion time.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
