[jira] [Created] (YARN-2985) YARN should support to delete the aggregated logs for Non-MapReduce applications

2014-12-23 Thread Xu Yang (JIRA)
Xu Yang created YARN-2985: - Summary: YARN should support to delete the aggregated logs for Non-MapReduce applications Key: YARN-2985 URL: https://issues.apache.org/jira/browse/YARN-2985 Project: Hadoop YARN

[jira] [Updated] (YARN-2946) DeadLocks in RMStateStore-ZKRMStateStore

2014-12-23 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-2946: - Attachment: 0003-YARN-2946.patch DeadLocks in RMStateStore-ZKRMStateStore

[jira] [Commented] (YARN-2946) DeadLocks in RMStateStore-ZKRMStateStore

2014-12-23 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256877#comment-14256877 ] Rohith commented on YARN-2946: -- Updated the patch for fixing the test failure TestRMRestart.

[jira] [Commented] (YARN-2985) YARN should support to delete the aggregated logs for Non-MapReduce applications

2014-12-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256880#comment-14256880 ] Naganarasimha G R commented on YARN-2985: - Hi [~yxls123123] bq. The Non-MapReduce

[jira] [Commented] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256894#comment-14256894 ] Hudson commented on YARN-2920: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #50 (See

[jira] [Commented] (YARN-2939) Fix new findbugs warnings in hadoop-yarn-common

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256896#comment-14256896 ] Hudson commented on YARN-2939: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #50 (See

[jira] [Commented] (YARN-2340) NPE thrown when RM restart after queue is STOPPED. There after RM can not recovery application's and remain in standby

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256895#comment-14256895 ] Hudson commented on YARN-2340: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #50 (See

[jira] [Commented] (YARN-2939) Fix new findbugs warnings in hadoop-yarn-common

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256908#comment-14256908 ] Hudson commented on YARN-2939: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #784 (See

[jira] [Commented] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256906#comment-14256906 ] Hudson commented on YARN-2920: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #784 (See

[jira] [Commented] (YARN-2340) NPE thrown when RM restart after queue is STOPPED. There after RM can not recovery application's and remain in standby

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256907#comment-14256907 ] Hudson commented on YARN-2340: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #784 (See

[jira] [Commented] (YARN-2946) DeadLocks in RMStateStore-ZKRMStateStore

2014-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256945#comment-14256945 ] Hadoop QA commented on YARN-2946: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256994#comment-14256994 ] Varun Saxena commented on YARN-2937: [~zjshen], above piece of code is in finally

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256993#comment-14256993 ] Varun Saxena commented on YARN-2937: [~zjshen], above piece of code is in finally

[jira] [Commented] (YARN-2340) NPE thrown when RM restart after queue is STOPPED. There after RM can not recovery application's and remain in standby

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257002#comment-14257002 ] Hudson commented on YARN-2340: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #47 (See

[jira] [Commented] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257001#comment-14257001 ] Hudson commented on YARN-2920: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #47 (See

[jira] [Commented] (YARN-2340) NPE thrown when RM restart after queue is STOPPED. There after RM can not recovery application's and remain in standby

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257007#comment-14257007 ] Hudson commented on YARN-2340: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1982 (See

[jira] [Commented] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257006#comment-14257006 ] Hudson commented on YARN-2920: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1982 (See

[jira] [Updated] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2937: --- Attachment: YARN-2937.005.patch Fix new findbugs warnings in hadoop-yarn-nodemanager

[jira] [Commented] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257047#comment-14257047 ] Hudson commented on YARN-2920: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #51 (See

[jira] [Commented] (YARN-2340) NPE thrown when RM restart after queue is STOPPED. There after RM can not recovery application's and remain in standby

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257048#comment-14257048 ] Hudson commented on YARN-2340: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #51 (See

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

2014-12-23 Thread Matteo Mazzucchelli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257054#comment-14257054 ] Matteo Mazzucchelli commented on YARN-2664: --- Thank for your feedback {quote} high

[jira] [Commented] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257073#comment-14257073 ] Junping Du commented on YARN-2940: -- Thanks for upload related findbugs warning messages.

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257081#comment-14257081 ] Hadoop QA commented on YARN-2937: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2340) NPE thrown when RM restart after queue is STOPPED. There after RM can not recovery application's and remain in standby

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257091#comment-14257091 ] Hudson commented on YARN-2340: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2001 (See

[jira] [Commented] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257090#comment-14257090 ] Hudson commented on YARN-2920: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2001 (See

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257098#comment-14257098 ] Varun Saxena commented on YARN-2937: [~zjshen], kindly review. Have rebased the patch.

[jira] [Created] (YARN-2986) Support hierarchical and unified scheduler configuration

2014-12-23 Thread Vinod Kumar Vavilapalli (JIRA)
Vinod Kumar Vavilapalli created YARN-2986: - Summary: Support hierarchical and unified scheduler configuration Key: YARN-2986 URL: https://issues.apache.org/jira/browse/YARN-2986 Project:

[jira] [Commented] (YARN-2986) Support hierarchical and unified scheduler configuration

2014-12-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257288#comment-14257288 ] Vinod Kumar Vavilapalli commented on YARN-2986: --- Today's scheduler

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257302#comment-14257302 ] Zhijie Shen commented on YARN-2937: --- bq. Havent thrown Exception in code below though, as

[jira] [Created] (YARN-2987) ClientRMService#getQueueInfo doesn't check app ACLs

2014-12-23 Thread Jian He (JIRA)
Jian He created YARN-2987: - Summary: ClientRMService#getQueueInfo doesn't check app ACLs Key: YARN-2987 URL: https://issues.apache.org/jira/browse/YARN-2987 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-2986) Support hierarchical and unified scheduler configuration

2014-12-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257310#comment-14257310 ] Vinod Kumar Vavilapalli commented on YARN-2986: --- I propose the following - A

[jira] [Commented] (YARN-2983) NPE possible in ClientRMService#getQueueInfo

2014-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257313#comment-14257313 ] Varun Saxena commented on YARN-2983: [~kasha] / [~jianhe], kindly review this. NPE

[jira] [Commented] (YARN-2946) DeadLocks in RMStateStore-ZKRMStateStore

2014-12-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257354#comment-14257354 ] Jian He commented on YARN-2946: --- Looks good, minor comment: We can remove the exception

[jira] [Commented] (YARN-2946) DeadLocks in RMStateStore-ZKRMStateStore

2014-12-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257355#comment-14257355 ] Jian He commented on YARN-2946: --- similar for other file systems.. DeadLocks in

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257361#comment-14257361 ] Varun Saxena commented on YARN-2937: [~zjshen], yes I had got your point. What I meant

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257371#comment-14257371 ] Varun Saxena commented on YARN-2937: [~zjshen], however you are correct that as

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257404#comment-14257404 ] Varun Saxena commented on YARN-2937: [~zjshen], I think it can be changed as under.

[jira] [Updated] (YARN-2970) NodeLabel operations in RMAdmin CLI get missing in help command.

2014-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2970: --- Attachment: YARN-2970.001.patch NodeLabel operations in RMAdmin CLI get missing in help command.

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257414#comment-14257414 ] Zhijie Shen commented on YARN-2937: --- IMHO, we can simply throw it at finally block. It's

[jira] [Commented] (YARN-2983) NPE possible in ClientRMService#getQueueInfo

2014-12-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257424#comment-14257424 ] Jian He commented on YARN-2983: --- thanks [~varun_saxena], I filed YARN-2987 while looking at

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257427#comment-14257427 ] Varun Saxena commented on YARN-2937: bq. IMHO, we can simply throw it at finally block.

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257430#comment-14257430 ] Varun Saxena commented on YARN-2937: {code} } finally { if (pw != null) { boolean

[jira] [Commented] (YARN-2983) NPE possible in ClientRMService#getQueueInfo

2014-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257454#comment-14257454 ] Varun Saxena commented on YARN-2983: bq. do you also see other scenarios ? No. This is

[jira] [Updated] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2937: --- Attachment: YARN-2937.006.patch Uploading new patch after fixing review comments. Fix new findbugs

[jira] [Commented] (YARN-2970) NodeLabel operations in RMAdmin CLI get missing in help command.

2014-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257463#comment-14257463 ] Hadoop QA commented on YARN-2970: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2970) NodeLabel operations in RMAdmin CLI get missing in help command.

2014-12-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257479#comment-14257479 ] Varun Saxena commented on YARN-2970: [~djp], kindly review. Now help usage will come in

[jira] [Created] (YARN-2988) Graph#save() may leak resource

2014-12-23 Thread Ted Yu (JIRA)
Ted Yu created YARN-2988: Summary: Graph#save() may leak resource Key: YARN-2988 URL: https://issues.apache.org/jira/browse/YARN-2988 Project: Hadoop YARN Issue Type: Bug Reporter: Ted

[jira] [Updated] (YARN-2988) Graph#save() may leak resource

2014-12-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated YARN-2988: - Attachment: YARN-2988-001.patch Graph#save() may leak resource --

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257525#comment-14257525 ] Hadoop QA commented on YARN-2937: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2933) Capacity Scheduler preemption policy should only consider capacity without labels temporarily

2014-12-23 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-2933: Attachment: YARN-2933-3.patch Fixing javadoc warnings Thanks, Mayank Capacity Scheduler

[jira] [Commented] (YARN-2988) Graph#save() may leak resource

2014-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257544#comment-14257544 ] Hadoop QA commented on YARN-2988: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-2989) Better Load Balancing in Fair Scheduler

2014-12-23 Thread Kannan Rajah (JIRA)
Kannan Rajah created YARN-2989: -- Summary: Better Load Balancing in Fair Scheduler Key: YARN-2989 URL: https://issues.apache.org/jira/browse/YARN-2989 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-2983) NPE possible in ClientRMService#getQueueInfo

2014-12-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257561#comment-14257561 ] Jian He commented on YARN-2983: --- thanks for taking over YARN-2987 too ! Given the change is

[jira] [Commented] (YARN-2989) Better Load Balancing in Fair Scheduler

2014-12-23 Thread Kannan Rajah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257576#comment-14257576 ] Kannan Rajah commented on YARN-2989: Just looked at YARN-1290. Since it is doing

[jira] [Commented] (YARN-2986) Support hierarchical and unified scheduler configuration

2014-12-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257591#comment-14257591 ] Jian He commented on YARN-2986: --- I found FairScheduler support some of these hierarchical

[jira] [Commented] (YARN-2933) Capacity Scheduler preemption policy should only consider capacity without labels temporarily

2014-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257607#comment-14257607 ] Hadoop QA commented on YARN-2933: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2625) Problems with CLASSPATH in Job Submission REST API

2014-12-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257618#comment-14257618 ] Vinod Kumar Vavilapalli commented on YARN-2625: --- bq. If the default ever

[jira] [Commented] (YARN-2989) Better Load Balancing in Fair Scheduler

2014-12-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257622#comment-14257622 ] Karthik Kambatla commented on YARN-2989: [~rkannan82] - as you might have noticed,

[jira] [Commented] (YARN-2986) Support hierarchical and unified scheduler configuration

2014-12-23 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257651#comment-14257651 ] Ray Chiang commented on YARN-2986: -- Out of curiosity, any thoughts on support for unit

[jira] [Updated] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2940: Attachment: YARN-2940-122314.patch Thanks [~djp] for the review! I updated the patch according to you suggestions.

[jira] [Commented] (YARN-2957) Create unit test to automatically compare YarnConfiguration and yarn-default.xml

2014-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257670#comment-14257670 ] Hadoop QA commented on YARN-2957: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2837: -- Attachment: YARN-2837.7.patch Update the patch again: 1. Per discussion offline, store the latest

[jira] [Updated] (YARN-2958) RMStateStore seems to unnecessarily and wronly store sequence number separately

2014-12-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2958: -- Priority: Blocker (was: Major) Target Version/s: 2.7.0 RMStateStore seems to unnecessarily

[jira] [Commented] (YARN-2987) ClientRMService#getQueueInfo doesn't check app ACLs

2014-12-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257685#comment-14257685 ] Zhijie Shen commented on YARN-2987: --- Queue ACLs needs to be checked too.

[jira] [Commented] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257703#comment-14257703 ] Hadoop QA commented on YARN-2940: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2933) Capacity Scheduler preemption policy should only consider capacity without labels temporarily

2014-12-23 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257717#comment-14257717 ] Mayank Bansal commented on YARN-2933: - These findbugs is not due to this patch,

[jira] [Commented] (YARN-2957) Create unit test to automatically compare YarnConfiguration and yarn-default.xml

2014-12-23 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257722#comment-14257722 ] Robert Kanter commented on YARN-2957: - I'm not sure why test-patch gave a -1 if

[jira] [Created] (YARN-2990) FairScheduler's delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requests

2014-12-23 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-2990: -- Summary: FairScheduler's delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requests Key: YARN-2990 URL:

[jira] [Updated] (YARN-2990) FairScheduler's delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requests

2014-12-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2990: --- Attachment: yarn-2990-test.patch Posted yarn-2990-test.patch that exposes this issue. The test

[jira] [Commented] (YARN-2990) FairScheduler's delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requests

2014-12-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257730#comment-14257730 ] Karthik Kambatla commented on YARN-2990: AM containers don't care about locality,

[jira] [Commented] (YARN-2957) Create unit test to automatically compare YarnConfiguration and yarn-default.xml

2014-12-23 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257736#comment-14257736 ] Ray Chiang commented on YARN-2957: -- Thanks. I was wondering about that myself. Create

[jira] [Commented] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257754#comment-14257754 ] Hadoop QA commented on YARN-2837: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2957) Create unit test to automatically compare YarnConfiguration and yarn-default.xml

2014-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257758#comment-14257758 ] Hadoop QA commented on YARN-2957: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257759#comment-14257759 ] Li Lu commented on YARN-2940: - Similar to last time, the two UT failures are irrelevant to the

[jira] [Commented] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257768#comment-14257768 ] Junping Du commented on YARN-2940: -- bq. I updated the patch according to you suggestions.

[jira] [Commented] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257770#comment-14257770 ] Zhijie Shen commented on YARN-2837: --- The findbug warnings are not related to this patch.

[jira] [Commented] (YARN-2986) Support hierarchical and unified scheduler configuration

2014-12-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257773#comment-14257773 ] Vinod Kumar Vavilapalli commented on YARN-2986: --- Agreed, we should avoid all

[jira] [Created] (YARN-2991) TestRMRestart.testDecomissionedNMsMetricsOnRMRestart intermittently fails on trunk

2014-12-23 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2991: - Summary: TestRMRestart.testDecomissionedNMsMetricsOnRMRestart intermittently fails on trunk Key: YARN-2991 URL: https://issues.apache.org/jira/browse/YARN-2991 Project:

[jira] [Commented] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257776#comment-14257776 ] Li Lu commented on YARN-2940: - Thanks [~djp]. I agree that this looks very weird because we're

[jira] [Commented] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257785#comment-14257785 ] Jian He commented on YARN-2837: --- looks good, +1 Timeline server needs to recover the

[jira] [Commented] (YARN-2985) YARN should support to delete the aggregated logs for Non-MapReduce applications

2014-12-23 Thread Xu Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257808#comment-14257808 ] Xu Yang commented on YARN-2985: --- Hi [~Naganarasimha]. Thank you for your question. I do not

[jira] [Commented] (YARN-2970) NodeLabel operations in RMAdmin CLI get missing in help command.

2014-12-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257834#comment-14257834 ] Junping Du commented on YARN-2970: -- +1. Patch looks good. Committing it now. NodeLabel

[jira] [Commented] (YARN-2985) YARN should support to delete the aggregated logs for Non-MapReduce applications

2014-12-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257837#comment-14257837 ] Zhijie Shen commented on YARN-2985: --- When we were working on YARN-2443, we came across

[jira] [Commented] (YARN-2989) Better Load Balancing in Fair Scheduler

2014-12-23 Thread Kannan Rajah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257841#comment-14257841 ] Kannan Rajah commented on YARN-2989: I am going to close this bug since the load

[jira] [Resolved] (YARN-2989) Better Load Balancing in Fair Scheduler

2014-12-23 Thread Kannan Rajah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kannan Rajah resolved YARN-2989. Resolution: Not a Problem Better Load Balancing in Fair Scheduler

[jira] [Commented] (YARN-2970) NodeLabel operations in RMAdmin CLI get missing in help command.

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257844#comment-14257844 ] Hudson commented on YARN-2970: -- FAILURE: Integrated in Hadoop-trunk-Commit #6781 (See

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257848#comment-14257848 ] Zhijie Shen commented on YARN-2937: --- +1 for the last patch. Will commit it. Fix new

[jira] [Commented] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257854#comment-14257854 ] Hudson commented on YARN-2837: -- FAILURE: Integrated in Hadoop-trunk-Commit #6782 (See

[jira] [Updated] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2937: -- Attachment: YARN-2937.007.patch Sigh, conflicting again. Upload a new patch which fixes the confit Fix

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-12-23 Thread Kannan Rajah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257863#comment-14257863 ] Kannan Rajah commented on YARN-796: --- [~leftnoteasy] I think we can improve the performance

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257867#comment-14257867 ] Hadoop QA commented on YARN-796: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2946) DeadLocks in RMStateStore-ZKRMStateStore

2014-12-23 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-2946: - Attachment: 0004-YARN-2946.patch DeadLocks in RMStateStore-ZKRMStateStore

[jira] [Commented] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257872#comment-14257872 ] Hudson commented on YARN-2940: -- FAILURE: Integrated in Hadoop-trunk-Commit #6784 (See

[jira] [Commented] (YARN-2946) DeadLocks in RMStateStore-ZKRMStateStore

2014-12-23 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257878#comment-14257878 ] Rohith commented on YARN-2946: -- Updated patch fixing comment. Kindly reivew the updated patch.

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257898#comment-14257898 ] Hadoop QA commented on YARN-2937: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257930#comment-14257930 ] Hudson commented on YARN-2940: -- FAILURE: Integrated in Hadoop-trunk-Commit #6785 (See

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257954#comment-14257954 ] Hudson commented on YARN-2937: -- FAILURE: Integrated in Hadoop-trunk-Commit #6786 (See

[jira] [Commented] (YARN-2946) DeadLocks in RMStateStore-ZKRMStateStore

2014-12-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257955#comment-14257955 ] Hadoop QA commented on YARN-2946: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2946) DeadLocks in RMStateStore-ZKRMStateStore

2014-12-23 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257968#comment-14257968 ] Rohith commented on YARN-2946: -- Test case failure is unrelated to this patch. I am able to run

[jira] [Commented] (YARN-2946) DeadLocks in RMStateStore-ZKRMStateStore

2014-12-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14258020#comment-14258020 ] Jian He commented on YARN-2946: --- +1 DeadLocks in RMStateStore-ZKRMStateStore

  1   2   >