Allen Wittenauer commented on YARN-2745:

Personally, I'd prefer that what is built now get moved before adding more 
stuff to it.  The ACL disaster (where we have completely different systems to 
manage what are effectively the same resoruce) is a great example of what 
happens if the one side doesn't think the other side is ready.    

Please please please, push this into common (and as a HADOOP JIRA instead of 
hiding it in YARN) sooner rather than later so that we don't have the same 
mistake made over and over over again.

> Extend YARN to support multi-resource packing of tasks
> ------------------------------------------------------
>                 Key: YARN-2745
>                 URL: https://issues.apache.org/jira/browse/YARN-2745
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager, resourcemanager, scheduler
>            Reporter: Robert Grandl
>            Assignee: Robert Grandl
>         Attachments: sigcomm_14_tetris_talk.pptx, tetris_design_doc.docx, 
> tetris_paper.pdf
> In this umbrella JIRA we propose an extension to existing scheduling 
> techniques, which accounts for all resources used by a task (CPU, memory, 
> disk, network) and it is able to achieve three competing objectives: 
> fairness, improve cluster utilization and reduces average job completion time.

This message was sent by Atlassian JIRA

Reply via email to