[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14233644#comment-14233644 ] Wangda Tan commented on YARN-2495: -- [~Naganarasimha], Since size of the patch grows, and

[jira] [Created] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

Wangda Tan created YARN-2920: Summary: CapacityScheduler should be notified when labels on nodes changed Key: YARN-2920 URL: https://issues.apache.org/jira/browse/YARN-2920 Project: Hadoop YARN

[jira] [Updated] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2920: - Issue Type: Sub-task (was: Bug) Parent: YARN-2492 CapacityScheduler should be notified when

[jira] [Updated] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2920: - Target Version/s: 2.7.0 CapacityScheduler should be notified when labels on nodes changed

[jira] [Updated] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2920: - Attachment: YARN-2920.1.patch Attached ver.1 patch for this CapacityScheduler should be notified when

[jira] [Updated] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2800: - Attachment: YARN-2800-20141203-1.patch [~ozawa], thanks for your comment, make sense to me, updated.

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14233812#comment-14233812 ] Wangda Tan commented on YARN-2762: -- Hi [~rohithsharma], Thanks for working on this, the

[jira] [Updated] (YARN-2869) CapacityScheduler should trim sub queue names when parse configuration

[ https://issues.apache.org/jira/browse/YARN-2869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2869: - Attachment: YARN-2869-3.patch Attached ver.3 patch to re-kick Jenkins, not sure which change causes

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14234499#comment-14234499 ] Wangda Tan commented on YARN-2762: -- [~rohithsharma], I thought you uploaded a wrong patch

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14234506#comment-14234506 ] Wangda Tan commented on YARN-2495: -- Hi [~Naganarasimha], What I meant is completely remove

[jira] [Created] (YARN-2924) Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI

Wangda Tan created YARN-2924: Summary: Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI Key: YARN-2924 URL: https://issues.apache.org/jira/browse/YARN-2924 Project:

[jira] [Updated] (YARN-2924) Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI

[ https://issues.apache.org/jira/browse/YARN-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2924: - Attachment: YARN-2924.1.patch Attached a fix for this, without this fix, modified test will fail. Node

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14234526#comment-14234526 ] Wangda Tan commented on YARN-2762: -- [~rohithsharma], The Jenkins should have some issues,

[jira] [Created] (YARN-2925) Internal fields in LeafQueue access should be protected when accessed from FiCaSchedulerApp to calculate Headroom

Wangda Tan created YARN-2925: Summary: Internal fields in LeafQueue access should be protected when accessed from FiCaSchedulerApp to calculate Headroom Key: YARN-2925 URL:

[jira] [Commented] (YARN-2925) Internal fields in LeafQueue access should be protected when accessed from FiCaSchedulerApp to calculate Headroom

[ https://issues.apache.org/jira/browse/YARN-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14234898#comment-14234898 ] Wangda Tan commented on YARN-2925: -- We cannot simply add a synchronized modifier to

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14235891#comment-14235891 ] Wangda Tan commented on YARN-2495: -- [~Naganarasimha], You don't have to specify the

[jira] [Commented] (YARN-2925) Internal fields in LeafQueue access should be protected when accessed from FiCaSchedulerApp to calculate Headroom

[ https://issues.apache.org/jira/browse/YARN-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14235901#comment-14235901 ] Wangda Tan commented on YARN-2925: -- Hi [~sunilg], No, I didn't intent to remove the CS

[jira] [Commented] (YARN-2925) Internal fields in LeafQueue access should be protected when accessed from FiCaSchedulerApp to calculate Headroom

[ https://issues.apache.org/jira/browse/YARN-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14235941#comment-14235941 ] Wangda Tan commented on YARN-2925: -- Hi Craig, It is what I anticipated when reviewing of

[jira] [Updated] (YARN-2925) Internal fields in LeafQueue access should be protected when accessed from FiCaSchedulerApp to calculate Headroom

[ https://issues.apache.org/jira/browse/YARN-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2925: - Attachment: YARN-2925.1.patch Attached a fix of the method described above Internal fields in LeafQueue

[jira] [Updated] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2800: - Attachment: YARN-2800-20141205-1.patch Fixed UT failures. Remove MemoryNodeLabelsStore and add a way to

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14236384#comment-14236384 ] Wangda Tan commented on YARN-2762: -- [~sunilg], Thanks for comment, #1, #3 makes sense to

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238130#comment-14238130 ] Wangda Tan commented on YARN-2762: -- [~rohithsharma], Thanks for update, Last two minor

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238157#comment-14238157 ] Wangda Tan commented on YARN-2495: -- [~Naganarasimha], I meant you can leave it empty in

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238357#comment-14238357 ] Wangda Tan commented on YARN-2762: -- Looks good, thanks for update, test failure shouldn't

[jira] [Commented] (YARN-2925) Internal fields in LeafQueue access should be protected when accessed from FiCaSchedulerApp to calculate Headroom

[ https://issues.apache.org/jira/browse/YARN-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238365#comment-14238365 ] Wangda Tan commented on YARN-2925: -- [~cwelch], Thanks for your comments, your suggestion

[jira] [Commented] (YARN-2932) Add entry for preemption setting to queue status screen and startup/refresh logging

[ https://issues.apache.org/jira/browse/YARN-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238582#comment-14238582 ] Wangda Tan commented on YARN-2932: -- Thanks for raising this up [~eepayne], it is a good

[jira] [Updated] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2920: - Attachment: YARN-2920.2.patch Updated patch, dropped some unnecessary refactoring code which will cause

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238704#comment-14238704 ] Wangda Tan commented on YARN-2618: -- [~ywskycn], Capacity Scheduler already support

[jira] [Assigned] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 8

[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2930: Assignee: Wangda Tan (was: Rohith) TestRMRestart#testRMRestartRecoveringNodeLabelManager

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 8

[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238818#comment-14238818 ] Wangda Tan commented on YARN-2930: -- [~rohithsharma], I've looked into this, found the root

[jira] [Updated] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 8

[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2930: - Attachment: YARN-2930.1.patch TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239052#comment-14239052 ] Wangda Tan commented on YARN-2762: -- bq. I believe these findbug errors are ocuring due to

[jira] [Commented] (YARN-2917) Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook

[ https://issues.apache.org/jira/browse/YARN-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239107#comment-14239107 ] Wangda Tan commented on YARN-2917: -- [~rohithsharma], Good catch! Thanks for thinking about

[jira] [Updated] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 8

[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2930: - Attachment: YARN-2930.2.patch Updated patch according to [~ste...@apache.org]'s suggestion. And moved

[jira] [Updated] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2920: - Attachment: YARN-2920.3.patch Updated patch, fixed release audit warnings and javac warnings. Test failure

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239872#comment-14239872 ] Wangda Tan commented on YARN-2800: -- The test failure is tracked by YARN-2930. Remove

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 8

[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239934#comment-14239934 ] Wangda Tan commented on YARN-2930: -- Failed tests seems not related:

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240214#comment-14240214 ] Wangda Tan commented on YARN-2618: -- Hi [~kasha], bq. I haven't looked at the CS code much,

[jira] [Created] (YARN-2943) Add a node-labels page in RM web UI

Wangda Tan created YARN-2943: Summary: Add a node-labels page in RM web UI Key: YARN-2943 URL: https://issues.apache.org/jira/browse/YARN-2943 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-2924) Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI

[ https://issues.apache.org/jira/browse/YARN-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240526#comment-14240526 ] Wangda Tan commented on YARN-2924: -- Thanks for [~jianhe]'s review commit. Node to

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241352#comment-14241352 ] Wangda Tan commented on YARN-1197: -- I'm glad if anybody can continue this work. Since

[jira] [Commented] (YARN-2637) maximum-am-resource-percent could be violated when resource of AM is minimumAllocation

[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242846#comment-14242846 ] Wangda Tan commented on YARN-2637: -- [~cwelch], I will take a look at this patch today as

[jira] [Updated] (YARN-2943) Add a node-labels page in RM web UI

[ https://issues.apache.org/jira/browse/YARN-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2943: - Attachment: YARN-2943.1.patch And also patch. Add a node-labels page in RM web UI

[jira] [Updated] (YARN-2943) Add a node-labels page in RM web UI

[ https://issues.apache.org/jira/browse/YARN-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2943: - Attachment: Nodes-page-with-label-filter.png Node-labels-page.png Attached screenshots for

[jira] [Commented] (YARN-2932) Add entry for preemption setting to queue status screen and startup/refresh logging

[ https://issues.apache.org/jira/browse/YARN-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242909#comment-14242909 ] Wangda Tan commented on YARN-2932: -- bq. Actually, rather than getting the queue's

[jira] [Updated] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2920: - Attachment: YARN-2920.4.patch [~jianhe], Thanks for your comments, I've updated patch addressed all your

[jira] [Updated] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2920: - Attachment: YARN-2920.5.patch bq. getUsedResources- getUsedResourcesByLabel And bq. RMNodeLabelsManager

[jira] [Updated] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2920: - Attachment: YARN-2920.6.patch Fixed test failure (TestResourceTracker is related, but

[jira] [Updated] (YARN-2943) Add a node-labels page in RM web UI

[ https://issues.apache.org/jira/browse/YARN-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2943: - Attachment: YARN-2943.2.patch Hi [~jianhe], Thanks for your comments, bq. If I restart NM, “num of active

[jira] [Commented] (YARN-2637) maximum-am-resource-percent could be violated when resource of AM is minimumAllocation

[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243832#comment-14243832 ] Wangda Tan commented on YARN-2637: -- Hi Craig, First is a major comment, I'm not quite sure

[jira] [Commented] (YARN-2637) maximum-am-resource-percent could be violated when resource of AM is minimumAllocation

[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14253048#comment-14253048 ] Wangda Tan commented on YARN-2637: -- Hi [~cwelch], bq. Regarding FiCaSchedulerApp

[jira] [Commented] (YARN-2933) Capacity Scheduler preemption policy should only consider capacity without labels temporarily

[ https://issues.apache.org/jira/browse/YARN-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14253068#comment-14253068 ] Wangda Tan commented on YARN-2933: -- Hi [~mayank_bansal], Thanks for working on this, I

[jira] [Updated] (YARN-2943) Add a node-labels page in RM web UI

[ https://issues.apache.org/jira/browse/YARN-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2943: - Attachment: YARN-2943.3.patch The patch didn't apply on latest trunk, updated patch. Add a node-labels

[jira] [Commented] (YARN-2933) Capacity Scheduler preemption policy should only consider capacity without labels temporarily

[ https://issues.apache.org/jira/browse/YARN-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260594#comment-14260594 ] Wangda Tan commented on YARN-2933: -- Hi [~mayank_bansal], Overall method looks good to me,

[jira] [Updated] (YARN-2943) Add a node-labels page in RM web UI

[ https://issues.apache.org/jira/browse/YARN-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2943: - Attachment: YARN-2943.4.patch Thanks comments from [~jianhe], all addressed in the new patch, please

[jira] [Updated] (YARN-2943) Add a node-labels page in RM web UI

[ https://issues.apache.org/jira/browse/YARN-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2943: - Attachment: YARN-2943.5.patch Added missing apache license to new file. Add a node-labels page in RM web

[jira] [Updated] (YARN-2943) Add a node-labels page in RM web UI

[ https://issues.apache.org/jira/browse/YARN-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2943: - Attachment: YARN-2943.6.patch Addressed findbugs warning. Failed test seems not related to this patch.

[jira] [Commented] (YARN-2943) Add a node-labels page in RM web UI

[ https://issues.apache.org/jira/browse/YARN-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261669#comment-14261669 ] Wangda Tan commented on YARN-2943: -- Verified in a local 3-nodes cluster, both nodes page

[jira] [Commented] (YARN-2932) Add entry for preemption setting to queue status screen and startup/refresh logging

[ https://issues.apache.org/jira/browse/YARN-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261719#comment-14261719 ] Wangda Tan commented on YARN-2932: -- Hi [~eepayne], Thanks for working on this patch, sorry

[jira] [Commented] (YARN-2922) Concurrent Modification Exception in LeafQueue when collecting applications

[ https://issues.apache.org/jira/browse/YARN-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14261745#comment-14261745 ] Wangda Tan commented on YARN-2922: -- Patch LGTM also, +1. Thanks, Wangda Concurrent

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263247#comment-14263247 ] Wangda Tan commented on YARN-796: - [~rkannan82], Did you mean capacity scheduler? Since

[jira] [Commented] (YARN-2978) ResourceManager crashes with NPE while getting queue info

[ https://issues.apache.org/jira/browse/YARN-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263347#comment-14263347 ] Wangda Tan commented on YARN-2978: -- Hi [~varun_saxena], I prefer to create a new QueueInfo

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263332#comment-14263332 ] Wangda Tan commented on YARN-796: - I'm not sure what's the purpose of adding a new API to

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1426#comment-1426 ] Wangda Tan commented on YARN-796: - I'm not sure what's the purpose of adding a new API to

[jira] [Commented] (YARN-2922) Concurrent Modification Exception in LeafQueue when collecting applications

[ https://issues.apache.org/jira/browse/YARN-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263137#comment-14263137 ] Wangda Tan commented on YARN-2922: -- +1 for the latest patch. Concurrent Modification

[jira] [Updated] (YARN-3091) [Umbrella] Improve and fix locks of RM scheduler

[ https://issues.apache.org/jira/browse/YARN-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3091: - Issue Type: Task (was: Improvement) [Umbrella] Improve and fix locks of RM scheduler

[jira] [Updated] (YARN-3091) [Umbrella] Improve and fix locks of RM scheduler

[ https://issues.apache.org/jira/browse/YARN-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3091: - Summary: [Umbrella] Improve and fix locks of RM scheduler (was: [Umbrella] Improve locks of RM scheduler)

[jira] [Commented] (YARN-3091) [Umbrella] Improve and fix locks of RM scheduler

[ https://issues.apache.org/jira/browse/YARN-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289552#comment-14289552 ] Wangda Tan commented on YARN-3091: -- Thanks for jumping in and provide your thoughts.

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289603#comment-14289603 ] Wangda Tan commented on YARN-2800: -- Thanks review from [~vinodkv] and commit by [~ozawa].

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289832#comment-14289832 ] Wangda Tan commented on YARN-1963: -- Thanks for summary from [~sunilg], I think priority

[jira] [Commented] (YARN-3028) Better syntax for replace label CLI

[ https://issues.apache.org/jira/browse/YARN-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289846#comment-14289846 ] Wangda Tan commented on YARN-3028: -- Patch LGTM, will commit this week. Thanks, Better

[jira] [Commented] (YARN-3028) Better syntax for replace label CLI

[ https://issues.apache.org/jira/browse/YARN-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292257#comment-14292257 ] Wangda Tan commented on YARN-3028: -- [~rohithsharma], could you take a look at the latest

[jira] [Updated] (YARN-3092) Create common ResourceUsage class to track labeled resource usages in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3092: - Summary: Create common ResourceUsage class to track labeled resource usages in Capacity Scheduler (was:

[jira] [Updated] (YARN-3028) Better syntax for replace label CLI

[ https://issues.apache.org/jira/browse/YARN-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3028: - Attachment: 0003-YARN-3028.patch After YARN-2800, test will fail for this patch. Rebased patch a little

[jira] [Commented] (YARN-1743) Decorate event transitions and the event-types with their behaviour

[ https://issues.apache.org/jira/browse/YARN-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292277#comment-14292277 ] Wangda Tan commented on YARN-1743: -- [~zjffdu], could you add license to these files and

[jira] [Created] (YARN-3098) Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues

Wangda Tan created YARN-3098: Summary: Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues Key: YARN-3098 URL: https://issues.apache.org/jira/browse/YARN-3098

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292159#comment-14292159 ] Wangda Tan commented on YARN-3075: -- bq. Right now, when we getLabelsToNodes we simply

[jira] [Commented] (YARN-3092) Create common resource usage class to track labeled resource/capacity in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292160#comment-14292160 ] Wangda Tan commented on YARN-3092: -- Failed tests are unrelated to this change. Create

[jira] [Commented] (YARN-2932) Add entry for preemptable status to scheduler web UI and queue initialize/refresh logging

[ https://issues.apache.org/jira/browse/YARN-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292202#comment-14292202 ] Wangda Tan commented on YARN-2932: -- Thanks for updating, [~eepayne]. New patch screenshot

[jira] [Updated] (YARN-3092) Create common resource usage class to track labeled resource/capacity in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3092: - Attachment: YARN-3092.1.patch Updated ver.1 patch. Create common resource usage class to track labeled

[jira] [Created] (YARN-3099) Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track resources-by-label.

Wangda Tan created YARN-3099: Summary: Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track resources-by-label. Key: YARN-3099 URL: https://issues.apache.org/jira/browse/YARN-3099

[jira] [Updated] (YARN-3099) Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track resources-by-label.

[ https://issues.apache.org/jira/browse/YARN-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3099: - Description: After YARN-3092, resource-by-label (include

[jira] [Updated] (YARN-2694) Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANY

[ https://issues.apache.org/jira/browse/YARN-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2694: - Attachment: YARN-2694-20150204-1.patch Ensure only single node labels specified in resource request /

[jira] [Commented] (YARN-3137) CapacityScheduler.checkAccess unnecessarily grabs the scheduler lock

[ https://issues.apache.org/jira/browse/YARN-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305763#comment-14305763 ] Wangda Tan commented on YARN-3137: -- Agree, I have noticed similar issues around this as

[jira] [Created] (YARN-3142) Improve locks in AppSchedulingInfo

Wangda Tan created YARN-3142: Summary: Improve locks in AppSchedulingInfo Key: YARN-3142 URL: https://issues.apache.org/jira/browse/YARN-3142 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

Wangda Tan created YARN-3139: Summary: Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler Key: YARN-3139 URL: https://issues.apache.org/jira/browse/YARN-3139 Project: Hadoop YARN

[jira] [Created] (YARN-3141) Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp

Wangda Tan created YARN-3141: Summary: Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp Key: YARN-3141 URL: https://issues.apache.org/jira/browse/YARN-3141 Project: Hadoop YARN

[jira] [Created] (YARN-3140) Improve locks in AbstractCSQueue/LeafQueue/ParentQueue

Wangda Tan created YARN-3140: Summary: Improve locks in AbstractCSQueue/LeafQueue/ParentQueue Key: YARN-3140 URL: https://issues.apache.org/jira/browse/YARN-3140 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301923#comment-14301923 ] Wangda Tan commented on YARN-3075: -- Hi [~varun_saxena], Overall looks good to me, minor

[jira] [Commented] (YARN-2868) Add metric for initial container launch time to FairScheduler

[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301910#comment-14301910 ] Wangda Tan commented on YARN-2868: -- That makes sense, but I think we still need to address

[jira] [Updated] (YARN-3124) Capacity Scheduler LeafQueue/ParentQueue should use QueueCapacities to track capacities-by-label

[ https://issues.apache.org/jira/browse/YARN-3124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3124: - Description: After YARN-3098, capacities-by-label (include

[jira] [Created] (YARN-3124) Capacity Scheduler LeafQueue/ParentQueue should use QueueCapacities to track capacities-by-label

Wangda Tan created YARN-3124: Summary: Capacity Scheduler LeafQueue/ParentQueue should use QueueCapacities to track capacities-by-label Key: YARN-3124 URL: https://issues.apache.org/jira/browse/YARN-3124

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302615#comment-14302615 ] Wangda Tan commented on YARN-3075: -- Rekicked Jenkins. NodeLabelsManager implementation

[jira] [Updated] (YARN-2694) Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANY

[ https://issues.apache.org/jira/browse/YARN-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2694: - Attachment: YARN-2694-20150202-1.patch Rebased against trunk Ensure only single node labels specified in

[jira] [Resolved] (YARN-281) Add a test for YARN Schedulers' MAXIMUM_ALLOCATION limits

[ https://issues.apache.org/jira/browse/YARN-281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-281. - Resolution: Won't Fix Release Note: I think this may not need since we already have tests in

[jira] [Created] (YARN-3153) Capacity Scheduler max AM resource percentage is mis-used as ratio

Wangda Tan created YARN-3153: Summary: Capacity Scheduler max AM resource percentage is mis-used as ratio Key: YARN-3153 URL: https://issues.apache.org/jira/browse/YARN-3153 Project: Hadoop YARN

[jira] [Commented] (YARN-3153) Capacity Scheduler max AM resource limit for queues is defined as percentage but used as ratio

[ https://issues.apache.org/jira/browse/YARN-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309974#comment-14309974 ] Wangda Tan commented on YARN-3153: -- We have 3 options basically, 1) Keep the config name

[jira] [Commented] (YARN-3153) Capacity Scheduler max AM resource limit for queues is defined as percentage but used as ratio

[ https://issues.apache.org/jira/browse/YARN-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310032#comment-14310032 ] Wangda Tan commented on YARN-3153: -- Thanks for your feedbacks, I agree to do 1) first. I

[jira] [Commented] (YARN-3153) Capacity Scheduler max AM resource limit for queues is defined as percentage but used as ratio

[ https://issues.apache.org/jira/browse/YARN-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310049#comment-14310049 ] Wangda Tan commented on YARN-3153: -- Good suggestion, I think we can deprecate the precent

[jira] [Updated] (YARN-281) Add a test for YARN Schedulers' MAXIMUM_ALLOCATION limits

[ https://issues.apache.org/jira/browse/YARN-281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-281: Release Note: (was: I think this may not need since we already have tests in TestSchedulerUitls, it will

<    5   6   7   8   9   10   11   12   13   14   >