[ https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605974#comment-14605974 ]
Allen Wittenauer commented on YARN-2745: ---------------------------------------- Personally, I'd prefer that what is built now get moved before adding more stuff to it. The ACL disaster (where we have completely different systems to manage what are effectively the same resoruce) is a great example of what happens if the one side doesn't think the other side is ready. Please please please, push this into common (and as a HADOOP JIRA instead of hiding it in YARN) sooner rather than later so that we don't have the same mistake made over and over over again. > Extend YARN to support multi-resource packing of tasks > ------------------------------------------------------ > > Key: YARN-2745 > URL: https://issues.apache.org/jira/browse/YARN-2745 > Project: Hadoop YARN > Issue Type: Improvement > Components: nodemanager, resourcemanager, scheduler > Reporter: Robert Grandl > Assignee: Robert Grandl > Attachments: sigcomm_14_tetris_talk.pptx, tetris_design_doc.docx, > tetris_paper.pdf > > > In this umbrella JIRA we propose an extension to existing scheduling > techniques, which accounts for all resources used by a task (CPU, memory, > disk, network) and it is able to achieve three competing objectives: > fairness, improve cluster utilization and reduces average job completion time. -- This message was sent by Atlassian JIRA (v6.3.4#6332)