[jira] [Updated] (YARN-2378) Adding support for moving apps between queues in Capacity Scheduler
[ https://issues.apache.org/jira/browse/YARN-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2378: - Target Version/s: (was: 2.6.0) > Adding support for moving apps between queues in Capacity Scheduler > --- > > Key: YARN-2378 > URL: https://issues.apache.org/jira/browse/YARN-2378 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacityscheduler >Reporter: Subru Krishnan >Assignee: Subru Krishnan > Labels: capacity-scheduler > Fix For: 2.6.0 > > Attachments: YARN-2378-1.patch, YARN-2378.patch, YARN-2378.patch, > YARN-2378.patch, YARN-2378.patch > > > As discussed with [~leftnoteasy] and [~jianhe], we are breaking up YARN-1707 > to smaller patches for manageability. This JIRA will address adding support > for moving apps between queues in Capacity Scheduler. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (YARN-2378) Adding support for moving apps between queues in Capacity Scheduler
[ https://issues.apache.org/jira/browse/YARN-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subramaniam Venkatraman Krishnan updated YARN-2378: --- Attachment: (was: YARN-2378.patch) > Adding support for moving apps between queues in Capacity Scheduler > --- > > Key: YARN-2378 > URL: https://issues.apache.org/jira/browse/YARN-2378 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacityscheduler >Reporter: Subramaniam Venkatraman Krishnan >Assignee: Subramaniam Venkatraman Krishnan > Labels: capacity-scheduler > Attachments: YARN-2378-1.patch, YARN-2378.patch, YARN-2378.patch, > YARN-2378.patch, YARN-2378.patch > > > As discussed with [~leftnoteasy] and [~jianhe], we are breaking up YARN-1707 > to smaller patches for manageability. This JIRA will address adding support > for moving apps between queues in Capacity Scheduler. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (YARN-2378) Adding support for moving apps between queues in Capacity Scheduler
[ https://issues.apache.org/jira/browse/YARN-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subramaniam Venkatraman Krishnan updated YARN-2378: --- Attachment: YARN-2378-1.patch > Adding support for moving apps between queues in Capacity Scheduler > --- > > Key: YARN-2378 > URL: https://issues.apache.org/jira/browse/YARN-2378 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacityscheduler >Reporter: Subramaniam Venkatraman Krishnan >Assignee: Subramaniam Venkatraman Krishnan > Labels: capacity-scheduler > Attachments: YARN-2378-1.patch, YARN-2378.patch, YARN-2378.patch, > YARN-2378.patch, YARN-2378.patch, YARN-2378.patch > > > As discussed with [~leftnoteasy] and [~jianhe], we are breaking up YARN-1707 > to smaller patches for manageability. This JIRA will address adding support > for moving apps between queues in Capacity Scheduler. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (YARN-2378) Adding support for moving apps between queues in Capacity Scheduler
[ https://issues.apache.org/jira/browse/YARN-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subramaniam Venkatraman Krishnan updated YARN-2378: --- Attachment: YARN-2378.patch Good suggestion [~jianhe]. Uploading an updated pitch that has the fix. > Adding support for moving apps between queues in Capacity Scheduler > --- > > Key: YARN-2378 > URL: https://issues.apache.org/jira/browse/YARN-2378 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacityscheduler >Reporter: Subramaniam Venkatraman Krishnan >Assignee: Subramaniam Venkatraman Krishnan > Labels: capacity-scheduler > Attachments: YARN-2378.patch, YARN-2378.patch, YARN-2378.patch, > YARN-2378.patch, YARN-2378.patch > > > As discussed with [~leftnoteasy] and [~jianhe], we are breaking up YARN-1707 > to smaller patches for manageability. This JIRA will address adding support > for moving apps between queues in Capacity Scheduler. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (YARN-2378) Adding support for moving apps between queues in Capacity Scheduler
[ https://issues.apache.org/jira/browse/YARN-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subramaniam Venkatraman Krishnan updated YARN-2378: --- Attachment: YARN-2378.patch > Adding support for moving apps between queues in Capacity Scheduler > --- > > Key: YARN-2378 > URL: https://issues.apache.org/jira/browse/YARN-2378 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacityscheduler >Reporter: Subramaniam Venkatraman Krishnan >Assignee: Subramaniam Venkatraman Krishnan > Labels: capacity-scheduler > Attachments: YARN-2378.patch, YARN-2378.patch, YARN-2378.patch, > YARN-2378.patch > > > As discussed with [~leftnoteasy] and [~jianhe], we are breaking up YARN-1707 > to smaller patches for manageability. This JIRA will address adding support > for moving apps between queues in Capacity Scheduler. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (YARN-2378) Adding support for moving apps between queues in Capacity Scheduler
[ https://issues.apache.org/jira/browse/YARN-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subramaniam Venkatraman Krishnan updated YARN-2378: --- Attachment: YARN-2378.patch > Adding support for moving apps between queues in Capacity Scheduler > --- > > Key: YARN-2378 > URL: https://issues.apache.org/jira/browse/YARN-2378 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacityscheduler >Reporter: Subramaniam Venkatraman Krishnan >Assignee: Subramaniam Venkatraman Krishnan > Labels: capacity-scheduler > Attachments: YARN-2378.patch, YARN-2378.patch, YARN-2378.patch > > > As discussed with [~leftnoteasy] and [~jianhe], we are breaking up YARN-1707 > to smaller patches for manageability. This JIRA will address adding support > for moving apps between queues in Capacity Scheduler. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (YARN-2378) Adding support for moving apps between queues in Capacity Scheduler
[ https://issues.apache.org/jira/browse/YARN-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subramaniam Venkatraman Krishnan updated YARN-2378: --- Attachment: YARN-2378.patch I am uploading an updated patch that merges all the test cases that [~keyki] wrote as part of YARN-2248. Thanks for the test cases especially the queue metrics one makes this a more robust patch. [~leftnoteasy] All the test cases run for me. I looked at the report and they all fail with a single exception: "java.net.UnknownHostException: asf901.ygridcore.net: asf901.ygridcore.net" which is unrelated to this patch. Only TestClientRMTokens fails for me but with "can't access Kerberos realm" which I assume is due to incomplete local kerb setup/configuration and I do not see that issue in Jenkins. Implementing state store for move is being tracked separately by YARN-1558. I'll be glad to help with that post YARN-1051. > Adding support for moving apps between queues in Capacity Scheduler > --- > > Key: YARN-2378 > URL: https://issues.apache.org/jira/browse/YARN-2378 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacityscheduler >Reporter: Subramaniam Venkatraman Krishnan >Assignee: Subramaniam Venkatraman Krishnan > Labels: capacity-scheduler > Attachments: YARN-2378.patch, YARN-2378.patch > > > As discussed with [~leftnoteasy] and [~jianhe], we are breaking up YARN-1707 > to smaller patches for manageability. This JIRA will address adding support > for moving apps between queues in Capacity Scheduler. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (YARN-2378) Adding support for moving apps between queues in Capacity Scheduler
[ https://issues.apache.org/jira/browse/YARN-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subramaniam Venkatraman Krishnan updated YARN-2378: --- Attachment: YARN-2378.patch > Adding support for moving apps between queues in Capacity Scheduler > --- > > Key: YARN-2378 > URL: https://issues.apache.org/jira/browse/YARN-2378 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacityscheduler >Reporter: Subramaniam Venkatraman Krishnan >Assignee: Subramaniam Venkatraman Krishnan > Labels: capacity-scheduler > Attachments: YARN-2378.patch > > > As discussed with [~leftnoteasy] and [~jianhe], we are breaking up YARN-1707 > to smaller patches for manageability. This JIRA will address adding support > for moving apps between queues in Capacity Scheduler. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (YARN-2378) Adding support for moving apps between queues in Capacity Scheduler
[ https://issues.apache.org/jira/browse/YARN-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subramaniam Venkatraman Krishnan updated YARN-2378: --- Description: As discussed with [~leftnoteasy] and [~jianhe], we are breaking up YARN-1707 to smaller patches for manageability. This JIRA will address adding support for moving apps between queues in Capacity Scheduler. (was: The CapacityScheduler is a rather static at the moment, and refreshqueue provides a rather heavy-handed way to reconfigure it. Moving towards long-running services (tracked in YARN-896) and to enable more advanced admission control and resource parcelling we need to make the CapacityScheduler more dynamic. This is instrumental to the umbrella jira YARN-1051. Concretely this require the following changes: * create queues dynamically * destroy queues dynamically * dynamically change queue parameters (e.g., capacity) * modify refreshqueue validation to enforce sum(child.getCapacity())<= 100% instead of ==100% We limit this to LeafQueues. ) Assignee: Subramaniam Venkatraman Krishnan (was: Carlo Curino) > Adding support for moving apps between queues in Capacity Scheduler > --- > > Key: YARN-2378 > URL: https://issues.apache.org/jira/browse/YARN-2378 > Project: Hadoop YARN > Issue Type: Sub-task > Components: capacityscheduler >Reporter: Subramaniam Venkatraman Krishnan >Assignee: Subramaniam Venkatraman Krishnan > Labels: capacity-scheduler > > As discussed with [~leftnoteasy] and [~jianhe], we are breaking up YARN-1707 > to smaller patches for manageability. This JIRA will address adding support > for moving apps between queues in Capacity Scheduler. -- This message was sent by Atlassian JIRA (v6.2#6252)