[jira] [Commented] (YARN-2919) Potential race between renew and cancel in DelegationTokenRenwer

2014-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240791#comment-14240791 ] Hadoop QA commented on YARN-2919: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2945) FSLeafQueue should hold lock before and after sorting runnableApps in assignContainer

2014-12-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2945: - Attachment: (was: YARN-2945.1.patch) FSLeafQueue should hold lock before and after sorting

[jira] [Updated] (YARN-2945) FSLeafQueue should hold lock before and after sorting runnableApps in assignContainer

2014-12-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2945: - Attachment: YARN-2945.001.patch FSLeafQueue should hold lock before and after sorting

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2014-12-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240836#comment-14240836 ] Tsuyoshi OZAWA commented on YARN-1197: -- [~leftnoteasy], could you review your work and

[jira] [Updated] (YARN-2618) Avoid over-allocation of disk resources

2014-12-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2618: -- Attachment: YARN-2618-4.patch Update a new patch fixing the test failures. Avoid over-allocation of disk

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240876#comment-14240876 ] Hadoop QA commented on YARN-2618: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2618) Avoid over-allocation of disk resources

2014-12-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2618: -- Attachment: YARN-2618-5.patch Avoid over-allocation of disk resources ---

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240891#comment-14240891 ] Hudson commented on YARN-2910: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #36 (See

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 8

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240895#comment-14240895 ] Hudson commented on YARN-2930: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #36 (See

[jira] [Commented] (YARN-2924) Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240904#comment-14240904 ] Hudson commented on YARN-2924: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #36 (See

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240907#comment-14240907 ] Hudson commented on YARN-2910: -- FAILURE: Integrated in Hadoop-Yarn-trunk #771 (See

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 8

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240910#comment-14240910 ] Hudson commented on YARN-2930: -- FAILURE: Integrated in Hadoop-Yarn-trunk #771 (See

[jira] [Commented] (YARN-2924) Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240923#comment-14240923 ] Hudson commented on YARN-2924: -- FAILURE: Integrated in Hadoop-Yarn-trunk #771 (See

[jira] [Commented] (YARN-2945) FSLeafQueue should hold lock before and after sorting runnableApps in assignContainer

2014-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240945#comment-14240945 ] Hadoop QA commented on YARN-2945: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240948#comment-14240948 ] Varun Vasudev commented on YARN-2618: - Wei, Karthik, in the parent JIRA design docs,

[jira] [Commented] (YARN-2448) RM should expose the resource types considered during scheduling when AMs register

2014-12-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240966#comment-14240966 ] Varun Vasudev commented on YARN-2448: - Sorry the extremely late response. The idea is

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241022#comment-14241022 ] Hadoop QA commented on YARN-2618: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2929) Adding separator ApplicationConstants.FILE_PATH_SEPARATOR for better Windows support

2014-12-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241066#comment-14241066 ] Tsuyoshi OZAWA commented on YARN-2929: -- [~cnauroth], thanks for your comments.

[jira] [Created] (YARN-2946) Deadlock in ZKRMStateStore

2014-12-10 Thread Rohith (JIRA)
Rohith created YARN-2946: Summary: Deadlock in ZKRMStateStore Key: YARN-2946 URL: https://issues.apache.org/jira/browse/YARN-2946 Project: Hadoop YARN Issue Type: Bug Components:

[jira] [Commented] (YARN-2946) Deadlock in ZKRMStateStore

2014-12-10 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241114#comment-14241114 ] Rohith commented on YARN-2946: -- Extracted Jstack detect deadlock {noformat} Found one

[jira] [Commented] (YARN-2946) Deadlock in ZKRMStateStore

2014-12-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241133#comment-14241133 ] Naganarasimha G R commented on YARN-2946: - Hi [~rohithsharma] I feel we need to

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241154#comment-14241154 ] Hudson commented on YARN-2910: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1968 (See

[jira] [Commented] (YARN-2924) Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241167#comment-14241167 ] Hudson commented on YARN-2924: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1968 (See

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 8

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241158#comment-14241158 ] Hudson commented on YARN-2930: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1968 (See

[jira] [Commented] (YARN-1695) Implement the rest (writable APIs) of RM web-services

2014-12-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241175#comment-14241175 ] Steve Loughran commented on YARN-1695: -- Now that the functionality is in, is there

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 8

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241185#comment-14241185 ] Hudson commented on YARN-2930: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #34 (See

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241182#comment-14241182 ] Hudson commented on YARN-2910: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #34 (See

[jira] [Commented] (YARN-2924) Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241196#comment-14241196 ] Hudson commented on YARN-2924: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #34 (See

[jira] [Created] (YARN-2947) Provide RESTful equivalent of YarnClientImpl

2014-12-10 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-2947: Summary: Provide RESTful equivalent of YarnClientImpl Key: YARN-2947 URL: https://issues.apache.org/jira/browse/YARN-2947 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 8

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241222#comment-14241222 ] Hudson commented on YARN-2930: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #38 (See

[jira] [Commented] (YARN-2924) Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241232#comment-14241232 ] Hudson commented on YARN-2924: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #38 (See

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241218#comment-14241218 ] Hudson commented on YARN-2910: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #38 (See

[jira] [Created] (YARN-2948) Provide Read Write REST view of YARN registry and client compatible with existing Registry API

2014-12-10 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-2948: Summary: Provide Read Write REST view of YARN registry and client compatible with existing Registry API Key: YARN-2948 URL: https://issues.apache.org/jira/browse/YARN-2948

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 8

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241281#comment-14241281 ] Hudson commented on YARN-2930: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1988 (See

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241277#comment-14241277 ] Hudson commented on YARN-2910: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1988 (See

[jira] [Commented] (YARN-2924) Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241290#comment-14241290 ] Hudson commented on YARN-2924: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1988 (See

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2014-12-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241352#comment-14241352 ] Wangda Tan commented on YARN-1197: -- I'm glad if anybody can continue this work. Since

[jira] [Commented] (YARN-2637) maximum-am-resource-percent could be violated when resource of AM is minimumAllocation

2014-12-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241381#comment-14241381 ] Junping Du commented on YARN-2637: -- Thanks [~cwelch] for updating the patch! The patch

[jira] [Commented] (YARN-2946) Deadlock in ZKRMStateStore

2014-12-10 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241439#comment-14241439 ] Rohith commented on YARN-2946: -- Looking into deep RMStateStore and ZKRMStateStore, all the ZK

[jira] [Commented] (YARN-2946) Deadlock in ZKRMStateStore

2014-12-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241444#comment-14241444 ] Varun Saxena commented on YARN-2946: [~rohithsharma], I think first approach suggested

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241486#comment-14241486 ] Wei Yan commented on YARN-2618: --- The four failed testcases passed locally. Some of the

[jira] [Updated] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2014-12-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2729: Attachment: YARN-2729.20141210-1.patch Re basing the patch and incorporating the changes

[jira] [Updated] (YARN-2923) Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup

2014-12-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2923: Attachment: YARN-2923.20141210-1.patch Updating the patch after completely removing

[jira] [Updated] (YARN-2946) Deadlock in ZKRMStateStore

2014-12-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2946: --- Priority: Blocker (was: Major) Target Version/s: 2.7.0 Deadlock in

[jira] [Commented] (YARN-2917) Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook

2014-12-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241503#comment-14241503 ] Jian He commented on YARN-2917: --- IIUC, the problem is that {{System.exit(-1);}} in

[jira] [Commented] (YARN-2945) FSLeafQueue should hold lock before and after sorting runnableApps in assignContainer

2014-12-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241508#comment-14241508 ] Karthik Kambatla commented on YARN-2945: Other committers: please hold off on

[jira] [Updated] (YARN-2619) NodeManager: Add cgroups support for disk I/O isolation

2014-12-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2619: -- Attachment: YARN-2619-1.patch Prelim patch for reviewing. The patch is based on YARN-2618. NodeManager: Add

[jira] [Commented] (YARN-2917) Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook

2014-12-10 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241555#comment-14241555 ] Rohith commented on YARN-2917: -- [~jianhe] your understanding is correct. I was meant to say

[jira] [Commented] (YARN-2917) Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook

2014-12-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241565#comment-14241565 ] Jian He commented on YARN-2917: --- this way we can still drain the events when calling the sys

[jira] [Commented] (YARN-2877) Extend YARN to support distributed scheduling

2014-12-10 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241570#comment-14241570 ] Anubhav Dhoot commented on YARN-2877: - +1 for notion of distributed scheduling. I think

[jira] [Updated] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2837: -- Attachment: YARN-2837.6.patch Make a new patch: modifying some existing test cases to use

[jira] [Updated] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2937: --- Attachment: YARN-2937.001.patch Fix new findbugs warnings in hadoop-yarn-nodemanager

[jira] [Commented] (YARN-2917) Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook

2014-12-10 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241579#comment-14241579 ] Rohith commented on YARN-2917: -- bq. setting drainEventsOnStop will not drain the events.

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

2014-12-10 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241589#comment-14241589 ] Chen He commented on YARN-1964: --- Thank [~ashahab] for the patch. It will be more clear if we

[jira] [Commented] (YARN-2877) Extend YARN to support distributed scheduling

2014-12-10 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241618#comment-14241618 ] Konstantinos Karanasos commented on YARN-2877: -- Thanks for the input,

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

2014-12-10 Thread Abin Shahab (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241672#comment-14241672 ] Abin Shahab commented on YARN-1964: --- [~airbots] We at altiscale are running this on a 6

[jira] [Commented] (YARN-2932) Add entry for preemption setting to queue status screen and startup/refresh logging

2014-12-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241675#comment-14241675 ] Eric Payne commented on YARN-2932: -- {quote} IIRC, YARN-2056 putting the disable preemption

[jira] [Commented] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241678#comment-14241678 ] Hadoop QA commented on YARN-2837: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

2014-12-10 Thread Janos Matyas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241682#comment-14241682 ] Janos Matyas commented on YARN-1964: Hi [~airbots] / [~ashabab] There should be no

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

2014-12-10 Thread Abin Shahab (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241692#comment-14241692 ] Abin Shahab commented on YARN-1964: --- Hey [~matyix], if you have a chance, can you give

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

2014-12-10 Thread Janos Matyas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241702#comment-14241702 ] Janos Matyas commented on YARN-1964: Hi [~ashahab], yes will give it a try and let you

[jira] [Commented] (YARN-2945) FSLeafQueue should hold lock before and after sorting runnableApps in assignContainer

2014-12-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241740#comment-14241740 ] Tsuyoshi OZAWA commented on YARN-2945: -- Thanks for your comment. It make sense to me,

[jira] [Commented] (YARN-2749) Some testcases from TestLogAggregationService fails in trunk

2014-12-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241752#comment-14241752 ] Xuan Gong commented on YARN-2749: - Attached a new patch to fix this. Some testcases from

[jira] [Updated] (YARN-2749) Some testcases from TestLogAggregationService fails in trunk

2014-12-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2749: Attachment: YARN-2749.2.patch Some testcases from TestLogAggregationService fails in trunk

[jira] [Commented] (YARN-2945) FSLeafQueue should hold lock before and after sorting runnableApps in assignContainer

2014-12-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241757#comment-14241757 ] Karthik Kambatla commented on YARN-2945: I am comfortable with adding comments here

[jira] [Commented] (YARN-2917) Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook

2014-12-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241755#comment-14241755 ] Jian He commented on YARN-2917: --- agree that if RM is abruptly killed, no events will be

[jira] [Updated] (YARN-2945) FSLeafQueue should hold lock before and after sorting runnableApps in assignContainer

2014-12-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2945: - Attachment: YARN-2945.002.patch OK, I updated a patch to add the comment. FSLeafQueue should

[jira] [Commented] (YARN-2932) Add entry for preemption setting to queue status screen and startup/refresh logging

2014-12-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241793#comment-14241793 ] Eric Payne commented on YARN-2932: -- Hi [~leftnoteasy]. bq. {{getIsPreemptionDisabled}}

[jira] [Commented] (YARN-2437) start-yarn.sh/stop-yarn should give info

2014-12-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241816#comment-14241816 ] Hudson commented on YARN-2437: -- FAILURE: Integrated in Hadoop-trunk-Commit #6691 (See

[jira] [Updated] (YARN-2938) Fix new findbugs warnings in hadoop-yarn-resourcemanager and hadoop-yarn-applicationhistoryservice

2014-12-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2938: --- Attachment: YARN-2938.001.patch Fix new findbugs warnings in hadoop-yarn-resourcemanager and

[jira] [Updated] (YARN-2938) Fix new findbugs warnings in hadoop-yarn-resourcemanager and hadoop-yarn-applicationhistoryservice

2014-12-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2938: --- Attachment: (was: YARN-2938.001.patch) Fix new findbugs warnings in hadoop-yarn-resourcemanager

[jira] [Updated] (YARN-2938) Fix new findbugs warnings in hadoop-yarn-resourcemanager and hadoop-yarn-applicationhistoryservice

2014-12-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2938: --- Attachment: YARN-2938.001.patch Fix new findbugs warnings in hadoop-yarn-resourcemanager and

[jira] [Commented] (YARN-2922) Concurrent Modification Exception in LeafQueue when collecting applications

2014-12-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241896#comment-14241896 ] Tsuyoshi OZAWA commented on YARN-2922: -- +1 for Rohith's patch. [~ajisakaa] it's not

[jira] [Commented] (YARN-2945) FSLeafQueue should hold lock before and after sorting runnableApps in assignContainer

2014-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241908#comment-14241908 ] Hadoop QA commented on YARN-2945: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241922#comment-14241922 ] Hadoop QA commented on YARN-2937: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241929#comment-14241929 ] Varun Saxena commented on YARN-2937: Weird...Why are HDFS tests being run for a Yarn

[jira] [Commented] (YARN-2945) FSLeafQueue should hold lock before and after sorting runnableApps in assignContainer

2014-12-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241935#comment-14241935 ] Tsuyoshi OZAWA commented on YARN-2945: -- The test failure is not related to the patch.

[jira] [Updated] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2940: Attachment: YARN-2940-121014.patch I this patch I fixed warnings from findbugs 3. Most of them are related to

[jira] [Commented] (YARN-2938) Fix new findbugs warnings in hadoop-yarn-resourcemanager and hadoop-yarn-applicationhistoryservice

2014-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241950#comment-14241950 ] Hadoop QA commented on YARN-2938: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2637) maximum-am-resource-percent could be violated when resource of AM is minimumAllocation

2014-12-10 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2637: -- Attachment: YARN-2637.17.patch Made [~djp] 's recommended changes, thanks for taking a look.

[jira] [Commented] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

2014-12-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241986#comment-14241986 ] Jian He commented on YARN-2920: --- - typo: {{// if we a previously running NM, we need notify

[jira] [Commented] (YARN-2637) maximum-am-resource-percent could be violated when resource of AM is minimumAllocation

2014-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242037#comment-14242037 ] Hadoop QA commented on YARN-2637: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2749) Some testcases from TestLogAggregationService fails in trunk

2014-12-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2749: Attachment: YARN-2749.2.patch Some testcases from TestLogAggregationService fails in trunk

[jira] [Commented] (YARN-2749) Some testcases from TestLogAggregationService fails in trunk

2014-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242097#comment-14242097 ] Hadoop QA commented on YARN-2749: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-2949) Add documentation for CGroups

2014-12-10 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-2949: --- Summary: Add documentation for CGroups Key: YARN-2949 URL: https://issues.apache.org/jira/browse/YARN-2949 Project: Hadoop YARN Issue Type: Task

[jira] [Updated] (YARN-1197) Support changing resources of an allocated container

2014-12-10 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated YARN-1197: - Assignee: (was: Jeff Zhang) Support changing resources of an allocated container

[jira] [Updated] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2940: Attachment: (was: YARN-2940-121014.patch) Fix new findbugs warnings in rest of the hadoop-yarn components

[jira] [Updated] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2940: Attachment: YARN-2940-121014.patch Kick Jenkins Fix new findbugs warnings in rest of the hadoop-yarn components

[jira] [Commented] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242220#comment-14242220 ] Hadoop QA commented on YARN-2940: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2940: Attachment: YARN-2940-121014-1.patch Rebuild the patch to see if there's something wrong in the patch itself. Fix

[jira] [Commented] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242247#comment-14242247 ] Varun Saxena commented on YARN-2940: I wonder what the issue is. Even my patch failed

[jira] [Commented] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242288#comment-14242288 ] Hadoop QA commented on YARN-2940: - {color:red}-1 overall{color}. Here are the results of