[jira] [Commented] (YARN-2917) Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook

2014-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239107#comment-14239107 ] Wangda Tan commented on YARN-2917: -- [~rohithsharma], Good catch! Thanks for thinking about

[jira] [Created] (YARN-2934) Improve handling of container's stderr

2014-12-09 Thread Gera Shegalov (JIRA)
Gera Shegalov created YARN-2934: --- Summary: Improve handling of container's stderr Key: YARN-2934 URL: https://issues.apache.org/jira/browse/YARN-2934 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2014-12-09 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239112#comment-14239112 ] Gera Shegalov commented on YARN-2934: - We need to make sure that stderr location is

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239123#comment-14239123 ] Hadoop QA commented on YARN-2910: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239134#comment-14239134 ] Hadoop QA commented on YARN-2910: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2917) Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook

2014-12-09 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239218#comment-14239218 ] Rohith commented on YARN-2917: -- bq. is it correct to set drainEventsOnStop to be false when

[jira] [Created] (YARN-2935) ResourceManager UI shows some stale values for Decommissioned Nodes field

2014-12-09 Thread Nishan Shetty (JIRA)
Nishan Shetty created YARN-2935: --- Summary: ResourceManager UI shows some stale values for Decommissioned Nodes field Key: YARN-2935 URL: https://issues.apache.org/jira/browse/YARN-2935 Project: Hadoop

[jira] [Updated] (YARN-2935) ResourceManager UI shows some stale values for Decommissioned Nodes field

2014-12-09 Thread Nishan Shetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishan Shetty updated YARN-2935: Attachment: screenshot-1.png ResourceManager UI shows some stale values for Decommissioned Nodes

[jira] [Assigned] (YARN-2935) ResourceManager UI shows some stale values for Decommissioned Nodes field

2014-12-09 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith reassigned YARN-2935: Assignee: Rohith ResourceManager UI shows some stale values for Decommissioned Nodes field

[jira] [Assigned] (YARN-2934) Improve handling of container's stderr

2014-12-09 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-2934: -- Assignee: Varun Saxena (was: Naganarasimha G R) Improve handling of container's stderr

[jira] [Assigned] (YARN-2934) Improve handling of container's stderr

2014-12-09 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-2934: --- Assignee: Naganarasimha G R Improve handling of container's stderr

[jira] [Assigned] (YARN-2934) Improve handling of container's stderr

2014-12-09 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-2934: --- Assignee: Naganarasimha G R (was: Varun Saxena) Improve handling of container's

[jira] [Updated] (YARN-2935) ResourceManager UI shows some stale values for Decommissioned Nodes field

2014-12-09 Thread Nishan Shetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishan Shetty updated YARN-2935: Attachment: (was: screenshot-1.png) ResourceManager UI shows some stale values for

[jira] [Updated] (YARN-2935) ResourceManager UI shows some stale values for Decommissioned Nodes field

2014-12-09 Thread Nishan Shetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishan Shetty updated YARN-2935: Attachment: screenshot-1.png ResourceManager UI shows some stale values for Decommissioned Nodes

[jira] [Updated] (YARN-2935) ResourceManager UI shows some stale values for Decommissioned Nodes field

2014-12-09 Thread Nishan Shetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishan Shetty updated YARN-2935: Affects Version/s: 2.4.1 ResourceManager UI shows some stale values for Decommissioned Nodes field

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 8

2014-12-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239273#comment-14239273 ] Steve Loughran commented on YARN-2930: -- the URI to the store must be from build from

[jira] [Updated] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 8

2014-12-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2930: - Environment: Java 7 8 Target Version/s: 2.7.0 Affects Version/s: 2.7.0

[jira] [Commented] (YARN-2931) PublicLocalizer may fail until directory is initialized by LocalizeRunner

2014-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239298#comment-14239298 ] Hudson commented on YARN-2931: -- FAILURE: Integrated in Hadoop-Yarn-trunk #770 (See

[jira] [Commented] (YARN-2931) PublicLocalizer may fail until directory is initialized by LocalizeRunner

2014-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239316#comment-14239316 ] Hudson commented on YARN-2931: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #34 (See

[jira] [Commented] (YARN-2935) ResourceManager UI shows some stale values for Decommissioned Nodes field

2014-12-09 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239340#comment-14239340 ] Rohith commented on YARN-2935: -- Able to reproduce, updating description with exact scenario.

[jira] [Updated] (YARN-2935) ResourceManager UI shows some stale values for Decommissioned Nodes field

2014-12-09 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-2935: - Description: Configure exclude host file patch and start RM in HA mode # Add NM1 entry in exclude host and execute

[jira] [Commented] (YARN-2931) PublicLocalizer may fail until directory is initialized by LocalizeRunner

2014-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239431#comment-14239431 ] Hudson commented on YARN-2931: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #33 (See

[jira] [Commented] (YARN-2931) PublicLocalizer may fail until directory is initialized by LocalizeRunner

2014-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239442#comment-14239442 ] Hudson commented on YARN-2931: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1966 (See

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-09 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239461#comment-14239461 ] Varun Vasudev commented on YARN-2618: - [~ywskycn] - can you please think about changing

[jira] [Commented] (YARN-2571) RM to support YARN registry

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239464#comment-14239464 ] Hadoop QA commented on YARN-2571: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2931) PublicLocalizer may fail until directory is initialized by LocalizeRunner

2014-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239506#comment-14239506 ] Hudson commented on YARN-2931: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #37 (See

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2014-12-09 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239518#comment-14239518 ] Naganarasimha G R commented on YARN-2934: - Hi [~jira.shegalov], AFAIK some

[jira] [Commented] (YARN-2931) PublicLocalizer may fail until directory is initialized by LocalizeRunner

2014-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239530#comment-14239530 ] Hudson commented on YARN-2931: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1987 (See

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2014-12-09 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239592#comment-14239592 ] Naganarasimha G R commented on YARN-2495: - Hi [~wangda] All the test case issues

[jira] [Updated] (YARN-2919) Potential race between renew and cancel in DelegationTokenRenwer

2014-12-09 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2919: Attachment: YARN-2919.20141209-1.patch Hi [~kasha] [~seth.siddha...@gmail.com] Based on my

[jira] [Commented] (YARN-2571) RM to support YARN registry

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239684#comment-14239684 ] Hadoop QA commented on YARN-2571: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2931) PublicLocalizer may fail until directory is initialized by LocalizeRunner

2014-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239702#comment-14239702 ] Hudson commented on YARN-2931: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1967 (See

[jira] [Commented] (YARN-2738) Add FairReservationSystem for FairScheduler

2014-12-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239711#comment-14239711 ] Subru Krishnan commented on YARN-2738: -- Thanks [~adhoot] and [~kasha] for taking the

[jira] [Updated] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 8

2014-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2930: - Attachment: YARN-2930.2.patch Updated patch according to [~ste...@apache.org]'s suggestion. And moved

[jira] [Updated] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

2014-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2920: - Attachment: YARN-2920.3.patch Updated patch, fixed release audit warnings and javac warnings. Test failure

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2014-12-09 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239762#comment-14239762 ] Xuan Gong commented on YARN-2934: - Hey, [~jira.shegalov] we already have a

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2014-12-09 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239779#comment-14239779 ] Gera Shegalov commented on YARN-2934: - Hi [~Naganarasimha], yes that's what I meant.

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2014-12-09 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239785#comment-14239785 ] Gera Shegalov commented on YARN-2934: - Hi [~xgong], bq. we already have a

[jira] [Commented] (YARN-2917) Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook

2014-12-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239821#comment-14239821 ] Jian He commented on YARN-2917: --- [~rohithsharma], thanks for reporting this ! how about

[jira] [Reopened] (YARN-2425) When Application submitted by via Yarn RM WS, log aggregation does not happens

2014-12-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reopened YARN-2425: --- turns out YARN-2704 doesn't solve this problem completely. there are race conditions that RM could try to launch

[jira] [Created] (YARN-2936) YARNDelegationTokenIdentifier doesn't set proto.builder now

2014-12-09 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2936: - Summary: YARNDelegationTokenIdentifier doesn't set proto.builder now Key: YARN-2936 URL: https://issues.apache.org/jira/browse/YARN-2936 Project: Hadoop YARN

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2014-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239872#comment-14239872 ] Wangda Tan commented on YARN-2800: -- The test failure is tracked by YARN-2930. Remove

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 8

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239889#comment-14239889 ] Hadoop QA commented on YARN-2930: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 8

2014-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239934#comment-14239934 ] Wangda Tan commented on YARN-2930: -- Failed tests seems not related:

[jira] [Assigned] (YARN-2936) YARNDelegationTokenIdentifier doesn't set proto.builder now

2014-12-09 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-2936: -- Assignee: Varun Saxena YARNDelegationTokenIdentifier doesn't set proto.builder now

[jira] [Moved] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-09 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena moved HADOOP-11373 to YARN-2937: - Fix Version/s: (was: 2.7.0) 2.7.0

[jira] [Moved] (YARN-2938) Fix new findbugs warnings in hadoop-yarn-resourcemanager and hadoop-yarn-applicationhistoryservice

2014-12-09 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena moved HADOOP-11375 to YARN-2938: - Key: YARN-2938 (was: HADOOP-11375) Project: Hadoop YARN (was:

[jira] [Moved] (YARN-2939) Fix new findbugs warnings in hadoop-yarn-common

2014-12-09 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena moved HADOOP-11374 to YARN-2939: - Key: YARN-2939 (was: HADOOP-11374) Project: Hadoop YARN (was:

[jira] [Moved] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-09 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena moved HADOOP-11376 to YARN-2940: - Key: YARN-2940 (was: HADOOP-11376) Project: Hadoop YARN (was:

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-09 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240056#comment-14240056 ] Varun Saxena commented on YARN-2937: These test case failures may have to do with using

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-09 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240064#comment-14240064 ] Ray Chiang commented on YARN-2910: -- RE: Unit test failure. TestRMRestart passed 10 out of

[jira] [Commented] (YARN-2937) Fix new findbugs warnings in hadoop-yarn-nodemanager

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240078#comment-14240078 ] Hadoop QA commented on YARN-2937: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2920) CapacityScheduler should be notified when labels on nodes changed

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240085#comment-14240085 ] Hadoop QA commented on YARN-2920: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240131#comment-14240131 ] Karthik Kambatla commented on YARN-2910: Ran findbugs on trunk with and without the

[jira] [Created] (YARN-2941) Revisit Disk IO configs

2014-12-09 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-2941: -- Summary: Revisit Disk IO configs Key: YARN-2941 URL: https://issues.apache.org/jira/browse/YARN-2941 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-2941) Revisit Disk IO configs

2014-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240141#comment-14240141 ] Karthik Kambatla commented on YARN-2941: Varun suggested we rename vdisks to

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240142#comment-14240142 ] Karthik Kambatla commented on YARN-2618: [~vvasudev] - Filed YARN-2941 to revisit

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2014-12-09 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240170#comment-14240170 ] Mit Desai commented on YARN-2900: - [~zjshen], I did get an exception by following the steps

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240214#comment-14240214 ] Wangda Tan commented on YARN-2618: -- Hi [~kasha], bq. I haven't looked at the CS code much,

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-09 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240223#comment-14240223 ] Wei Yan commented on YARN-2618: --- [~leftnoteasy], yes, by configuring the calculator using

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2014-12-09 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240281#comment-14240281 ] Chen He commented on YARN-1197: --- I can also contribute some time on this JIRA. Support

[jira] [Created] (YARN-2942) Aggregated Log Files should be compacted

2014-12-09 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-2942: --- Summary: Aggregated Log Files should be compacted Key: YARN-2942 URL: https://issues.apache.org/jira/browse/YARN-2942 Project: Hadoop YARN Issue Type: New

[jira] [Updated] (YARN-2939) Fix new findbugs warnings in hadoop-yarn-common

2014-12-09 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2939: Attachment: YARN-2939-120914.patch In this patch I fixed findbugs 3 warnings in hadoop-yarn-common. I added

[jira] [Updated] (YARN-2942) Aggregated Log Files should be compacted

2014-12-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-2942: Attachment: YARN-2942-preliminary.001.patch CompactedAggregatedLogsProposal_v1.pdf

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 8

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240316#comment-14240316 ] Hadoop QA commented on YARN-2930: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-2943) Add a node-labels page in RM web UI

2014-12-09 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-2943: Summary: Add a node-labels page in RM web UI Key: YARN-2943 URL: https://issues.apache.org/jira/browse/YARN-2943 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-2939) Fix new findbugs warnings in hadoop-yarn-common

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240321#comment-14240321 ] Hadoop QA commented on YARN-2939: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2939) Fix new findbugs warnings in hadoop-yarn-common

2014-12-09 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2939: Attachment: (was: YARN-2939-120914.patch) Fix new findbugs warnings in hadoop-yarn-common

[jira] [Updated] (YARN-2939) Fix new findbugs warnings in hadoop-yarn-common

2014-12-09 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2939: Attachment: YARN-2939-120914.patch Jenkins result looks weird. Kick it again. Fix new findbugs warnings in

[jira] [Commented] (YARN-2924) Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240347#comment-14240347 ] Hadoop QA commented on YARN-2924: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2014-12-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2928: -- Attachment: ATSv2.rev1.pdf Posting the first version of the design. There are some parts that still need

[jira] [Updated] (YARN-2618) Avoid over-allocation of disk resources

2014-12-09 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2618: -- Attachment: YARN-2618-3.patch Update a new patch by combing comments. Verified in a local cluster, avoid

[jira] [Comment Edited] (YARN-2942) Aggregated Log Files should be compacted

2014-12-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240398#comment-14240398 ] Zhijie Shen edited comment on YARN-2942 at 12/10/14 12:33 AM: --

[jira] [Commented] (YARN-2942) Aggregated Log Files should be compacted

2014-12-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240398#comment-14240398 ] Zhijie Shen commented on YARN-2942: --- Thanks for the proposal, Robert! It seems that this

[jira] [Commented] (YARN-2924) Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240411#comment-14240411 ] Hadoop QA commented on YARN-2924: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2939) Fix new findbugs warnings in hadoop-yarn-common

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240410#comment-14240410 ] Hadoop QA commented on YARN-2939: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2930) TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 8

2014-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240431#comment-14240431 ] Hudson commented on YARN-2930: -- FAILURE: Integrated in Hadoop-trunk-Commit #6685 (See

[jira] [Created] (YARN-2944) SCMStore/InMemorySCMStore is not currently compatible with ReflectionUtils#newInstance

2014-12-09 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-2944: -- Summary: SCMStore/InMemorySCMStore is not currently compatible with ReflectionUtils#newInstance Key: YARN-2944 URL: https://issues.apache.org/jira/browse/YARN-2944

[jira] [Commented] (YARN-2939) Fix new findbugs warnings in hadoop-yarn-common

2014-12-09 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240450#comment-14240450 ] Li Lu commented on YARN-2939: - I could not reproduce the test failures locally. For the results

[jira] [Commented] (YARN-2924) Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240485#comment-14240485 ] Hadoop QA commented on YARN-2924: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2922) Concurrent Modification Exception in LeafQueue when collecting applications

2014-12-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240508#comment-14240508 ] Akira AJISAKA commented on YARN-2922: - Thanks for creating the patch, [~rohithsharma].

[jira] [Updated] (YARN-2924) Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI

2014-12-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2924: -- Target Version/s: 2.7.0 (was: 2.7.0, 2.6.1) Node to labels mapping should not transfer to lowercase when

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240515#comment-14240515 ] Karthik Kambatla commented on YARN-2618: Looks mostly good. One minor comment -

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240520#comment-14240520 ] Hadoop QA commented on YARN-2618: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2924) Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI

2014-12-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240523#comment-14240523 ] Hudson commented on YARN-2924: -- FAILURE: Integrated in Hadoop-trunk-Commit #6686 (See

[jira] [Commented] (YARN-2924) Node to labels mapping should not transfer to lowercase when adding from RMAdminCLI

2014-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240526#comment-14240526 ] Wangda Tan commented on YARN-2924: -- Thanks for [~jianhe]'s review commit. Node to

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240559#comment-14240559 ] Tsuyoshi OZAWA commented on YARN-2910: -- [~wilfreds], [~rchiang], [~kasha] Sorry for

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240560#comment-14240560 ] Tsuyoshi OZAWA commented on YARN-2910: -- s/the fair scheduling/the semantics of fair

[jira] [Commented] (YARN-2922) Concurrent Modification Exception in LeafQueue when collecting applications

2014-12-09 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240592#comment-14240592 ] Rohith commented on YARN-2922: -- Thanks [~ajisakaa] for reviewing patch. I'd prefer to use

[jira] [Commented] (YARN-2762) RMAdminCLI node-labels-related args should be trimmed and checked before sending to RM

2014-12-09 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240595#comment-14240595 ] Rohith commented on YARN-2762: -- Thanks [~leftnoteasy] for reviewing patch:-) RMAdminCLI

[jira] [Commented] (YARN-2917) Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook

2014-12-09 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240649#comment-14240649 ] Rohith commented on YARN-2917: -- bq. how about creating a new thread and call sys exit ? This

[jira] [Created] (YARN-2945) FSLeafQueue should hold lock before and after sorting runnableApps in assignContainer

2014-12-09 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created YARN-2945: Summary: FSLeafQueue should hold lock before and after sorting runnableApps in assignContainer Key: YARN-2945 URL: https://issues.apache.org/jira/browse/YARN-2945

[jira] [Commented] (YARN-2910) FSLeafQueue can throw ConcurrentModificationException

2014-12-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240675#comment-14240675 ] Tsuyoshi OZAWA commented on YARN-2910: -- Created YARN-2945 for discussing the issue.

[jira] [Updated] (YARN-2945) FSLeafQueue should hold lock before and after sorting runnableApps in assignContainer

2014-12-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2945: - Attachment: YARN-2945.1.patch Attaching a first patch. FSLeafQueue should hold lock before and

[jira] [Updated] (YARN-2945) FSLeafQueue should hold lock before and after sorting runnableApps in assignContainer

2014-12-09 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2945: - Description: After YARN-2910, assignContainer hold WriteLock while sorting and ReadLock while

[jira] [Commented] (YARN-2945) FSLeafQueue should hold lock before and after sorting runnableApps in assignContainer

2014-12-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240677#comment-14240677 ] Hadoop QA commented on YARN-2945: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2917) Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook

2014-12-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240686#comment-14240686 ] Jian He commented on YARN-2917: --- bq. There can be centralized single thread that does

[jira] [Commented] (YARN-2917) Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook

2014-12-09 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240703#comment-14240703 ] Rohith commented on YARN-2917: -- bq. Then we need to send events to notify this single thread?

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2014-12-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240705#comment-14240705 ] Zhijie Shen commented on YARN-2900: --- I think you were still using the old FS history

[jira] [Commented] (YARN-2917) Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook

2014-12-09 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240707#comment-14240707 ] Rohith commented on YARN-2917: -- [~jianhe] In between, Thinking why to spawn new thread when

  1   2   >