Krisztian Horvath commented on YARN-2248:

Can anyone take a look at the patch? I've some concerns regarding the live 

Movement steps:

1, Check if the target queue has enough capacity and some more validation, 
exception otherwise (same as with FairScheduler)
2, Remove the app attempt from the current queue
3, Release resources used by live containers on this queue 
4, Remove application upwards root (--numApplications)
5, QueueMetrics update 
6, Set new queue in application
7, Allocate resources consumed by the live containers (basically the resource 
usage moved here from the original queue)
8, Submit new app attempt
9, Add application (++numApplications)

> Capacity Scheduler changes for moving apps between queues
> ---------------------------------------------------------
>                 Key: YARN-2248
>                 URL: https://issues.apache.org/jira/browse/YARN-2248
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: capacityscheduler
>            Reporter: Janos Matyas
>            Assignee: Janos Matyas
>         Attachments: YARN-2248-1.patch, YARN-2248-2.patch
> We would like to have the capability (same as the Fair Scheduler has) to move 
> applications between queues. 
> We have made a baseline implementation and tests to start with - and we would 
> like the community to review, come up with suggestions and finally have this 
> contributed. 
> The current implementation is available for 2.4.1 - so the first thing is 
> that we'd need to identify the target version as there are differences 
> between 2.4.* and 3.* interfaces.
> The story behind is available at 
> http://blog.sequenceiq.com/blog/2014/07/02/move-applications-between-queues/ 
> and the baseline implementation and test at:
> https://github.com/sequenceiq/hadoop-common/blob/branch-2.4.1/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/a/ExtendedCapacityScheduler.java#L924
> https://github.com/sequenceiq/hadoop-common/blob/branch-2.4.1/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/a/TestExtendedCapacitySchedulerAppMove.java

This message was sent by Atlassian JIRA

Reply via email to