[ https://issues.apache.org/jira/browse/MYRIAD-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
DarinJ updated MYRIAD-103: -------------------------- Assignee: (was: Kannan Rajah) Priority: Minor Component/s: Scheduler Executor Issue Type: New Feature (was: Bug) > Optimization: Reuse Mesos offer across YARN containers > ------------------------------------------------------ > > Key: MYRIAD-103 > URL: https://issues.apache.org/jira/browse/MYRIAD-103 > Project: Myriad > Issue Type: New Feature > Components: Executor, Scheduler > Reporter: Kannan Rajah > Priority: Minor > > In the fine grained scheduling implementation, when YARN scheduler allocates > a container, Myriad launches a pseudo Mesos task for it by specifying its > resource allocation. When the container completes, a task finished update is > sent to Mesos so that the pseudo task is stopped and its resources reclaimed. > When there are pending tasks in the YARN scheduler’s pipeline, it would be > beneficial to hold on to these resources and see if it can be used again. > This avoids the overhead of giving away resources and waiting for Mesos to > offer it back. -- This message was sent by Atlassian JIRA (v6.3.4#6332)