[jira] [Updated] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2014-11-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2786: - Attachment: YARN-2786-20141104-1-full.patch [~vinodkv], thanks for your comments, updated patch. Create

[jira] [Updated] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2014-11-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2786: - Attachment: YARN-2786-20141104-1-without-yarn.cmd.patch Again, attach a patch without yarn.cmd Create

[jira] [Created] (YARN-2807) Option --forceactive not works as described in usage of yarn rmadmin -transitionToActive

2014-11-04 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-2807: Summary: Option --forceactive not works as described in usage of yarn rmadmin -transitionToActive Key: YARN-2807 URL: https://issues.apache.org/jira/browse/YARN-2807

[jira] [Updated] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2014-11-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2786: - Attachment: YARN-2786-20141104-2-full.patch Create yarn cluster CLI to enable list node labels collection

[jira] [Updated] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2014-11-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2786: - Attachment: YARN-2786-20141104-2-without-yarn.cmd.patch Create yarn cluster CLI to enable list node

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14197206#comment-14197206 ] Wangda Tan commented on YARN-2753: -- Hi Zhihai, I just review your patch, some comments:

[jira] [Assigned] (YARN-2805) RM2 in HA setup tries to login using the RM1's kerberos principal

2014-11-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2805: Assignee: Wangda Tan RM2 in HA setup tries to login using the RM1's kerberos principal

[jira] [Commented] (YARN-2805) RM2 in HA setup tries to login using the RM1's kerberos principal

2014-11-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198973#comment-14198973 ] Wangda Tan commented on YARN-2805: -- Had investigated this issue, this is caused by

[jira] [Updated] (YARN-2805) RM2 in HA setup tries to login using the RM1's kerberos principal

2014-11-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2805: - Attachment: YARN-2805.1.patch RM2 in HA setup tries to login using the RM1's kerberos principal

[jira] [Updated] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2753: - Description: Issues include: * CommonNodeLabelsManager#addToCluserNodeLabels should not change the value

[jira] [Updated] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2753: - Description: Issues include: * CommonNodeLabelsManager#addToCluserNodeLabels should not change the value

[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue infos

2014-11-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199117#comment-14199117 ] Wangda Tan commented on YARN-2647: -- [~sunilg]l, Two minor comments: 1) {code} +

[jira] [Commented] (YARN-2805) RM2 in HA setup tries to login using the RM1's kerberos principal

2014-11-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199395#comment-14199395 ] Wangda Tan commented on YARN-2805: -- Thanks for [~vinodkv]'s review and commit! RM2 in HA

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2014-11-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199494#comment-14199494 ] Wangda Tan commented on YARN-2495: -- *Major comments:* 1. As I commented,

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200973#comment-14200973 ] Wangda Tan commented on YARN-2753: -- +1 for latest patch, thanks for update! [~zxu] Fix

[jira] [Created] (YARN-2824) Capacity of labels should be zero by default

2014-11-06 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-2824: Summary: Capacity of labels should be zero by default Key: YARN-2824 URL: https://issues.apache.org/jira/browse/YARN-2824 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-2824) Capacity of labels should be zero by default

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2824: - Attachment: YARN-2824-1.patch Attached patch and added/updated tests Capacity of labels should be zero

[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue infos

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201226#comment-14201226 ] Wangda Tan commented on YARN-2647: -- Hi [~sunilg], bq. However I feel we can avoid having

[jira] [Updated] (YARN-2791) Add Disk as a resource for scheduling

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2791: - Assignee: Yuliya Feldman (was: Wangda Tan) Add Disk as a resource for scheduling

[jira] [Commented] (YARN-2744) Under some scenario, it is possible to end up with capacity scheduler configuration that uses labels that no longer exist

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201385#comment-14201385 ] Wangda Tan commented on YARN-2744: -- Thanks for Vinod's review and commit! Under some

[jira] [Commented] (YARN-2505) Support get/add/remove/change labels in RM REST API

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201402#comment-14201402 ] Wangda Tan commented on YARN-2505: -- Hi [~cwelch], Latest patch LGTM, +1. Thanks!

[jira] [Commented] (YARN-2824) Capacity of labels should be zero by default

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201413#comment-14201413 ] Wangda Tan commented on YARN-2824: -- Attached new patch suppressing findbug warnings

[jira] [Updated] (YARN-2824) Capacity of labels should be zero by default

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2824: - Attachment: YARN-2824-2.patch Capacity of labels should be zero by default

[jira] [Assigned] (YARN-2826) User-Group mappings not updated by RM when a user is removed from a group.

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2826: Assignee: Wangda Tan User-Group mappings not updated by RM when a user is removed from a group.

[jira] [Updated] (YARN-2826) User-Group mappings not updated by RM when a user is removed from a group.

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2826: - Attachment: YARN-2826-1.patch Thanks for [~sidharta-s] for reporting this issue. Attached a fix for this.

[jira] [Updated] (YARN-2647) Add yarn queue CLI to get queue infos

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2647: - Attachment: 0009-YARN-2647-trunk-full.patch Hmm.. there're some issues when trying to run queue CLI

[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue infos

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201636#comment-14201636 ] Wangda Tan commented on YARN-2647: -- Attached a patch based on [~sunilg]'s existing patch

[jira] [Updated] (YARN-2647) Add yarn queue CLI to get queue infos

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2647: - Attachment: 0009-YARN-2647-trunk-without-yarn.cmd.patch Add yarn queue CLI to get queue infos

[jira] [Updated] (YARN-2647) Add yarn queue CLI to get queue infos

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2647: - Attachment: 0009-YARN-2647-branch2-full.pach Attached updated branch-2 fix as well Add yarn queue CLI to

[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue infos

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201668#comment-14201668 ] Wangda Tan commented on YARN-2647: -- OK, tested on both trunk and branch-2, all works,

[jira] [Commented] (YARN-2826) User-Group mappings not updated by RM when a user is removed from a group.

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201671#comment-14201671 ] Wangda Tan commented on YARN-2826: -- Failed tests is tracked by

[jira] [Created] (YARN-2827) Fix bugs of yarn queue CLI

2014-11-06 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-2827: Summary: Fix bugs of yarn queue CLI Key: YARN-2827 URL: https://issues.apache.org/jira/browse/YARN-2827 Project: Hadoop YARN Issue Type: Bug Components:

[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue infos

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201680#comment-14201680 ] Wangda Tan commented on YARN-2647: -- Filed YARN-2827 for the upcoming fixes. Add yarn

[jira] [Commented] (YARN-2607) TestDistributedShell fails in trunk

2014-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14202356#comment-14202356 ] Wangda Tan commented on YARN-2607: -- Taking over, will post a patch soon

[jira] [Assigned] (YARN-2607) TestDistributedShell fails in trunk

2014-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2607: Assignee: Wangda Tan TestDistributedShell fails in trunk ---

[jira] [Updated] (YARN-2827) Fix bugs of yarn queue CLI

2014-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2827: - Attachment: YARN-2827.1.patch Attached a fix for this issue. Fix bugs of yarn queue CLI

[jira] [Updated] (YARN-2827) Fix bugs of yarn queue CLI

2014-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2827: - Attachment: YARN-2827-branch_2-1.patch Attached patch for branch-2, tested under both trunk and branch-2

[jira] [Commented] (YARN-2824) Capacity of labels should be zero by default

2014-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14202433#comment-14202433 ] Wangda Tan commented on YARN-2824: -- Hi [~vinodkv], Thanks for review and commit. bq.

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14202440#comment-14202440 ] Wangda Tan commented on YARN-2753: -- [~zxu], One minor comment is, when the newLabels is

[jira] [Commented] (YARN-2607) TestDistributedShell fails in trunk

2014-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14202457#comment-14202457 ] Wangda Tan commented on YARN-2607: -- Currently TestDistributedShell do following steps in

[jira] [Updated] (YARN-2607) TestDistributedShell fails in trunk

2014-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2607: - Attachment: YARN-2607-1.patch Attached a fix for this. TestDistributedShell fails in trunk

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14202517#comment-14202517 ] Wangda Tan commented on YARN-2753: -- +1, thanks for update! Fix potential issues and code

[jira] [Commented] (YARN-2826) User-Group mappings not updated by RM when a user is removed from a group.

2014-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14203169#comment-14203169 ] Wangda Tan commented on YARN-2826: -- Verified this patch will not break what we have

[jira] [Updated] (YARN-2607) TestDistributedShell fails in trunk

2014-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2607: - Attachment: YARN-2607-2.patch Updated the patch, now moved test for distributed shell with node labels to

[jira] [Updated] (YARN-2607) TestDistributedShell fails in trunk

2014-11-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2607: - Attachment: YARN-2607-3.patch Fixed audit warnings. TestDistributedShell fails in trunk

[jira] [Commented] (YARN-2607) TestDistributedShell fails in trunk

2014-11-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205494#comment-14205494 ] Wangda Tan commented on YARN-2607: -- Hi [~ozawa], I just tried it can pass locally, does it

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2014-11-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205689#comment-14205689 ] Wangda Tan commented on YARN-2495: -- bq. I have already added the below code in the

[jira] [Commented] (YARN-2607) TestDistributedShell fails in trunk

2014-11-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205704#comment-14205704 ] Wangda Tan commented on YARN-2607: -- Hmm.. it seems lots of distributed related tests are

[jira] [Commented] (YARN-2842) TestApplicationClientProtocolOnHA fails against Java 8

2014-11-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205800#comment-14205800 ] Wangda Tan commented on YARN-2842: -- This is not Java 8 specific issue, it is tracked by

[jira] [Assigned] (YARN-2843) NodeLabels manager should trim all inputs for hosts and labels

2014-11-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2843: Assignee: Wangda Tan NodeLabels manager should trim all inputs for hosts and labels

[jira] [Updated] (YARN-2843) NodeLabels manager should trim all inputs for hosts and labels

2014-11-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2843: - Attachment: YARN-2843-1.patch Attached fix this issue. NodeLabels manager should trim all inputs for

[jira] [Updated] (YARN-2843) NodeLabels manager should trim all inputs for hosts and labels

2014-11-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2843: - Attachment: YARN-2843-2.patch Updated patch to fix test failures NodeLabels manager should trim all

[jira] [Commented] (YARN-2843) NodeLabels manager should trim all inputs for hosts and labels

2014-11-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207057#comment-14207057 ] Wangda Tan commented on YARN-2843: -- Thanks for [~vinodkv]'s review and commit!

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2014-11-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207268#comment-14207268 ] Wangda Tan commented on YARN-2729: -- Hi [~Naganarasimha], IIRC, the script based patch

[jira] [Commented] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2014-11-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208519#comment-14208519 ] Wangda Tan commented on YARN-2786: -- bq. Essentially: adding this feature creates the

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

2014-11-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208721#comment-14208721 ] Wangda Tan commented on YARN-2056: -- bq. If it's okay with you, I would like to keep number

[jira] [Commented] (YARN-2848) (FICA) Applications should maintain an application specific 'cluster' resource to calculate headroom and userlimit

2014-11-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1420#comment-1420 ] Wangda Tan commented on YARN-2848: -- [~cwelch], IIUC, this JIRA is to tackle the cases

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

2014-11-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208990#comment-14208990 ] Wangda Tan commented on YARN-2056: -- Minor comments: 1) Typo of comment in cloneQueue: bq.

[jira] [Commented] (YARN-2848) (FICA) Applications should maintain an application specific 'cluster' resource to calculate headroom and userlimit

2014-11-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209021#comment-14209021 ] Wangda Tan commented on YARN-2848: -- [~cwelch], Thanks for your explanation, I think it is

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

2014-11-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14211630#comment-14211630 ] Wangda Tan commented on YARN-2056: -- Hi [~eepayne], Thanks for updating the patch and

[jira] [Created] (YARN-2866) Capacity scheduler preemption policy should respect yarn.scheduler.minimum-allocation-mb when computing resource of queues

2014-11-14 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-2866: Summary: Capacity scheduler preemption policy should respect yarn.scheduler.minimum-allocation-mb when computing resource of queues Key: YARN-2866 URL:

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

2014-11-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14212899#comment-14212899 ] Wangda Tan commented on YARN-2056: -- [~eepayne], Thanks for update, bq. Would you please

[jira] [Updated] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-11-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2414: - Attachment: YARN-2414.20141104-1.patch Attached patch addressed [~jlowe]'s comment, added a test with mock

[jira] [Created] (YARN-2869) CapacityScheduler should trim sub queue names when parse configuration

2014-11-14 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-2869: Summary: CapacityScheduler should trim sub queue names when parse configuration Key: YARN-2869 URL: https://issues.apache.org/jira/browse/YARN-2869 Project: Hadoop YARN

[jira] [Updated] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-11-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2414: - Attachment: YARN-2414.20141104-2.patch Fixed release audit warnings. RM web UI: app page will crash if

[jira] [Commented] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215177#comment-14215177 ] Wangda Tan commented on YARN-2414: -- Thanks [~zjshen] reporting this issue, and [~jlowe]'s

[jira] [Commented] (YARN-2745) YARN new pluggable scheduler which does multi-resource packing

2014-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215604#comment-14215604 ] Wangda Tan commented on YARN-2745: -- Read through the paper as well. Thanks for great works

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14216674#comment-14216674 ] Wangda Tan commented on YARN-1963: -- Thanks [~sunilg], [~vinodkv] for your great effort on

[jira] [Commented] (YARN-2745) YARN new pluggable scheduler which does multi-resource packing

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14216828#comment-14216828 ] Wangda Tan commented on YARN-2745: -- [~srikanthkandula], Exactly, but I think YARN-314 is

[jira] [Updated] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to disable

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2800: - Summary: Remove MemoryNodeLabelsStore and add a way to disable (was: Should print WARN log in both

[jira] [Updated] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to disable node labels feature

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2800: - Summary: Remove MemoryNodeLabelsStore and add a way to disable node labels feature (was: Remove

[jira] [Updated] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2800: - Summary: Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature (was: Remove

[jira] [Updated] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2800: - Description: In the past, we have a MemoryNodeLabelStore, mostly for user to try this feature without

[jira] [Updated] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2800: - Description: In the past, we have a MemoryNodeLabelStore, mostly for user to try this feature without

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14216897#comment-14216897 ] Wangda Tan commented on YARN-2800: -- [~vinodkv], [~ozawa], thanks for your comments, I've

[jira] [Updated] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2800: - Attachment: YARN-2800-20141118-1.patch Uploaded patch and kick Jenkins Remove MemoryNodeLabelsStore and

[jira] [Created] (YARN-2880) Add a test in TestRMRestart to make sure node labels will be recovered if it is enabled

2014-11-19 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-2880: Summary: Add a test in TestRMRestart to make sure node labels will be recovered if it is enabled Key: YARN-2880 URL: https://issues.apache.org/jira/browse/YARN-2880 Project:

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2014-11-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218400#comment-14218400 ] Wangda Tan commented on YARN-2800: -- Hi [~ozawa], Thanks for your comments, bq.

[jira] [Updated] (YARN-2869) CapacityScheduler should trim sub queue names when parse configuration

2014-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2869: - Attachment: YARN-2869-2.patch [~vinodkv], Thanks for review. The mvn eclipse:eclipse is not related. And

[jira] [Commented] (YARN-2880) Add a test in TestRMRestart to make sure node labels will be recovered if it is enabled

2014-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221271#comment-14221271 ] Wangda Tan commented on YARN-2880: -- [~rohithsharma], Thanks for taking up this JIRA, bq.

[jira] [Commented] (YARN-2727) In RMAdminCLI usage display, instead of yarn.node-labels.fs-store.root-dir, yarn.node-labels.fs-store.uri is being displayed

2014-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221281#comment-14221281 ] Wangda Tan commented on YARN-2727: -- [~Naganarasimha], I'll close this as duplicated,

[jira] [Updated] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

2014-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2762: - Summary: RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM (was:

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

2014-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221310#comment-14221310 ] Wangda Tan commented on YARN-2762: -- [~rohithsharma], Thanks for patch, I've updated the

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2014-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221342#comment-14221342 ] Wangda Tan commented on YARN-2495: -- Hi [~Naganarasimha], Thanks for update, Several minor

[jira] [Updated] (YARN-2801) Documentation development for Node labels requirment

2014-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2801: - Issue Type: Sub-task (was: New Feature) Parent: YARN-2492 Documentation development for Node

[jira] [Commented] (YARN-2801) Documentation development for Node labels requirment

2014-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221568#comment-14221568 ] Wangda Tan commented on YARN-2801: -- [~gururaj], Thanks for volunteering to do this, but

[jira] [Commented] (YARN-2801) Documentation development for Node labels requirment

2014-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221571#comment-14221571 ] Wangda Tan commented on YARN-2801: -- And added this as sub task of YARN-2492.

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

2014-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221659#comment-14221659 ] Wangda Tan commented on YARN-2056: -- Thanks [~jlowe]'s review. [~curino] wanna take a look?

[jira] [Commented] (YARN-2139) [Umbrella] Support for Disk as a Resource in YARN

2014-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221669#comment-14221669 ] Wangda Tan commented on YARN-2139: -- Thanks [~bikassaha] and [~kasha], +1 for work on a

[jira] [Commented] (YARN-2877) Extend YARN to support distributed scheduling

2014-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221745#comment-14221745 ] Wangda Tan commented on YARN-2877: -- Thanks [~sriramsrao] for bringing up the great idea

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2014-11-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222424#comment-14222424 ] Wangda Tan commented on YARN-2495: -- Hi [~Naganarasimha], For 1#, sorry my bad, it has been

[jira] [Commented] (YARN-2877) Extend YARN to support distributed scheduling

2014-11-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222447#comment-14222447 ] Wangda Tan commented on YARN-2877: -- Thanks very much for explanation from [~kkaranasos],

[jira] [Created] (YARN-2895) Integrate distributed scheduling with capacity scheduler

2014-11-24 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-2895: Summary: Integrate distributed scheduling with capacity scheduler Key: YARN-2895 URL: https://issues.apache.org/jira/browse/YARN-2895 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2014-11-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14223127#comment-14223127 ] Wangda Tan commented on YARN-1963: -- [~sunilg], I agree with your latest comment, Will get

[jira] [Commented] (YARN-2801) Documentation development for Node labels requirment

2014-11-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14223203#comment-14223203 ] Wangda Tan commented on YARN-2801: -- Since the assignee is empty and got no response,

[jira] [Assigned] (YARN-2801) Documentation development for Node labels requirment

2014-11-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2801: Assignee: Wangda Tan Documentation development for Node labels requirment

[jira] [Commented] (YARN-2906) CapacitySchedulerPage shows HTML tags for a queue's Active Users

2014-11-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14225390#comment-14225390 ] Wangda Tan commented on YARN-2906: -- [~jlowe], you're correct, this is a bug caused by

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2014-11-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14225439#comment-14225439 ] Wangda Tan commented on YARN-2495: -- [~Naganarasimha], bq. In this case i feel we need to

[jira] [Commented] (YARN-2906) CapacitySchedulerPage shows HTML tags for a queue's Active Users

2014-11-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14225440#comment-14225440 ] Wangda Tan commented on YARN-2906: -- Just tried this, without this JIRA, Active users has

[jira] [Commented] (YARN-2637) maximum-am-resource-percent could be violated when resource of AM is minimumAllocation

2014-12-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14233323#comment-14233323 ] Wangda Tan commented on YARN-2637: -- [~cwelch], I think option#2 makes more sense to me,

<    4   5   6   7   8   9   10   11   12   13   >