[jira] [Commented] (YARN-4556) TestFifoScheduler.testResourceOverCommit fails

2016-01-08 Thread Akihiro Suda (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088930#comment-15088930 ] Akihiro Suda commented on YARN-4556: The failed test is unrelated to my change. >

[jira] [Commented] (YARN-2402) NM restart: Container recovery for Windows

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088867#comment-15088867 ] Hadoop QA commented on YARN-2402: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4556) TestFifoScheduler.testResourceOverCommit fails

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088875#comment-15088875 ] Hadoop QA commented on YARN-4556: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-2402) NM restart: Container recovery for Windows

2016-01-08 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuqi Wang updated YARN-2402: Attachment: YARN-2402-v2.patch Correct coding style. The issue is that the recovered container always exits

[jira] [Commented] (YARN-4540) Yarn property "yarn.nodemanager.localizer.cache.cleanup.interval-ms" not working as expected

2016-01-08 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088922#comment-15088922 ] Kai Sasaki commented on YARN-4540: -- As far as I have seen,

[jira] [Commented] (YARN-4438) Implement RM leader election with curator

2016-01-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089661#comment-15089661 ] Jian He commented on YARN-4438: --- [~ajisakaa], I think it's complaining that the newly added class requires a

[jira] [Commented] (YARN-1564) add some basic workflow YARN services

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089711#comment-15089711 ] Hadoop QA commented on YARN-1564: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089719#comment-15089719 ] Hadoop QA commented on YARN-3995: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4438) Implement RM leader election with curator

2016-01-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089770#comment-15089770 ] Steve Loughran commented on YARN-4438: -- Everyone: yes, the build fails in javadocs. But I don't think

[jira] [Commented] (YARN-2571) RM to support YARN registry

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089647#comment-15089647 ] ASF GitHub Bot commented on YARN-2571: -- GitHub user steveloughran opened a pull request:

[jira] [Commented] (YARN-4438) Implement RM leader election with curator

2016-01-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089746#comment-15089746 ] Steve Loughran commented on YARN-4438: -- Ignore everything I'm saying ... I'm confused now, and if

[jira] [Updated] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2016-01-08 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3995: Attachment: YARN-3995-feature-YARN-2928.v1.002.patch [~sjlee0], corrected the patch

[jira] [Commented] (YARN-679) add an entry point that can start any Yarn service

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089655#comment-15089655 ] Hadoop QA commented on YARN-679: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4438) Implement RM leader election with curator

2016-01-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089700#comment-15089700 ] Jian He commented on YARN-4438: --- [~ajisakaa], actually, what I said is about checkstyle. For the javadoc -1.

[jira] [Commented] (YARN-4567) javadoc failing on java 8

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089809#comment-15089809 ] ASF GitHub Bot commented on YARN-4567: -- GitHub user steveloughran opened a pull request:

[jira] [Assigned] (YARN-2402) NM restart: Container recovery for Windows

2016-01-08 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri reassigned YARN-2402: - Assignee: Inigo Goiri > NM restart: Container recovery for Windows >

[jira] [Commented] (YARN-4554) ApplicationReport.getDiagnostics does not return diagnostics from individual attempts

2016-01-08 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089794#comment-15089794 ] Siddharth Seth commented on YARN-4554: -- Please go ahead. Separating the diagnostics per appAttempt in

[jira] [Commented] (YARN-4568) Fix message when NodeManager runs into errors initializing the recovery directory

2016-01-08 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089951#comment-15089951 ] Ray Chiang commented on YARN-4568: -- RE: No new tests Clarifying error message. No new test needed. >

[jira] [Created] (YARN-4569) Remove incorrect documentation on maxResources in FairScheduler

2016-01-08 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-4569: Summary: Remove incorrect documentation on maxResources in FairScheduler Key: YARN-4569 URL: https://issues.apache.org/jira/browse/YARN-4569 Project: Hadoop YARN

[jira] [Commented] (YARN-4412) Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

2016-01-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089859#comment-15089859 ] Arun Suresh commented on YARN-4412: --- Thanks for the rev [~kkaranasos]. wrt 1, I understand only the wait

[jira] [Commented] (YARN-4568) Fix message when NodeManager runs into errors initializing the recovery directory

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089921#comment-15089921 ] Hadoop QA commented on YARN-4568: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2402) NM restart: Container recovery for Windows

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089931#comment-15089931 ] Hadoop QA commented on YARN-2402: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-4568) Fix message when NodeManager runs into errors initializing the recovery directory

2016-01-08 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-4568: Summary: Fix message when NodeManager runs into errors initializing the recovery directory Key: YARN-4568 URL: https://issues.apache.org/jira/browse/YARN-4568 Project:

[jira] [Updated] (YARN-4568) Fix message when NodeManager runs into errors initializing the recovery directory

2016-01-08 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4568: - Attachment: YARN-4568.001.patch > Fix message when NodeManager runs into errors initializing the recovery

[jira] [Commented] (YARN-4557) Few issues in scheduling with Node Labels

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089826#comment-15089826 ] Hadoop QA commented on YARN-4557: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-3102) Decommisioned Nodes not listed in Web UI

2016-01-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-3102: -- Attachment: YARN-3102-v2.patch Updating patch after addressing findbugs warning, failed test case and

[jira] [Commented] (YARN-2402) NM restart: Container recovery for Windows

2016-01-08 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089833#comment-15089833 ] Inigo Goiri commented on YARN-2402: --- I temporarily assigned the patch to me to trigger Jenkins. I tried

[jira] [Commented] (YARN-2571) RM to support YARN registry

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089847#comment-15089847 ] Hadoop QA commented on YARN-2571: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-4570) Nodemanager leaking RawLocalFilesystem instances for user "testing"

2016-01-08 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li reassigned YARN-4570: -- Assignee: Chang Li > Nodemanager leaking RawLocalFilesystem instances for user "testing" >

[jira] [Commented] (YARN-4412) Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

2016-01-08 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090138#comment-15090138 ] Konstantinos Karanasos commented on YARN-4412: -- bq. I understand only the wait time is

[jira] [Commented] (YARN-3102) Decommisioned Nodes not listed in Web UI

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090210#comment-15090210 ] Hadoop QA commented on YARN-3102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2016-01-08 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090213#comment-15090213 ] Sangjin Lee commented on YARN-3995: --- It looks pretty good. Thanks for updating the patch

[jira] [Commented] (YARN-4438) Implement RM leader election with curator

2016-01-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090235#comment-15090235 ] Jian He commented on YARN-4438: --- no problem, Steve, thanks for spending time on investigating this ! >

[jira] [Created] (YARN-4571) Make app id/name available to the yarn authorizer provider for better auditing

2016-01-08 Thread Jian He (JIRA)
Jian He created YARN-4571: - Summary: Make app id/name available to the yarn authorizer provider for better auditing Key: YARN-4571 URL: https://issues.apache.org/jira/browse/YARN-4571 Project: Hadoop YARN

[jira] [Commented] (YARN-4224) Support fetching entities by UID and change the REST interface to conform to current REST APIs' in YARN

2016-01-08 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090270#comment-15090270 ] Sangjin Lee commented on YARN-4224: --- I agree with what you said about escaping the separators. I'd like

[jira] [Commented] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

2016-01-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090233#comment-15090233 ] Hudson commented on YARN-4479: -- FAILURE: Integrated in Hadoop-trunk-Commit #9075 (See

[jira] [Updated] (YARN-4565) When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead to situation where all queue resources consumed by AMs only

2016-01-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4565: - Attachment: YARN-4565.1.patch Attached ver.1 patch for review. > When sizeBasedWeight enabled for

[jira] [Commented] (YARN-4571) Make app id/name available to the yarn authorizer provider for better auditing

2016-01-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090258#comment-15090258 ] Jian He commented on YARN-4571: --- The authorizer api is changed to include the app id and name. > Make app

[jira] [Updated] (YARN-4565) When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead to situation where all queue resources consumed by AMs only

2016-01-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4565: - Target Version/s: 2.8.0 > When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, >

[jira] [Updated] (YARN-4565) When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead to situation where all queue resources consumed by AMs only

2016-01-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4565: - Affects Version/s: (was: 2.7.1) > When sizeBasedWeight enabled for FairOrderingPolicy in

[jira] [Commented] (YARN-4565) When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead to situation where all queue resources consumed by AMs only

2016-01-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090260#comment-15090260 ] Wangda Tan commented on YARN-4565: -- branch-2.7 doesn't have this feature, removed from affected version >

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

2016-01-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: YARN-4265-trunk.004.patch Thanks [~djp] for the review! I updated my patch according to your comments.

[jira] [Commented] (YARN-679) add an entry point that can start any Yarn service

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090020#comment-15090020 ] ASF GitHub Bot commented on YARN-679: - GitHub user steveloughran opened a pull request:

[jira] [Commented] (YARN-4438) Implement RM leader election with curator

2016-01-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090074#comment-15090074 ] Steve Loughran commented on YARN-4438: -- OK. I've got a on-line patch YARN-4567 covering the javadocs.

[jira] [Updated] (YARN-4569) Remove incorrect part of maxResources in FairScheduler documentation

2016-01-08 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4569: - Summary: Remove incorrect part of maxResources in FairScheduler documentation (was: Remove incorrect

[jira] [Updated] (YARN-4569) Remove incorrect documentation on maxResources in FairScheduler

2016-01-08 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4569: - Attachment: YARN-4569.001.patch > Remove incorrect documentation on maxResources in FairScheduler >

[jira] [Commented] (YARN-4567) javadoc failing on java 8

2016-01-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090100#comment-15090100 ] Steve Loughran commented on YARN-4567: -- tested locally on java8 with {{ mvn package -Pdist -DskipTests

[jira] [Updated] (YARN-4519) potential deadlock of CapacityScheduler between decrease container and assign containers

2016-01-08 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-4519: Attachment: YARN-4519.2.patch Attaching new patch that addressed the failed test case. We only need to

[jira] [Assigned] (YARN-4565) When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead to situation where all queue resources consumed by AMs only

2016-01-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-4565: Assignee: Wangda Tan > When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, >

[jira] [Commented] (YARN-4438) Implement RM leader election with curator

2016-01-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089697#comment-15089697 ] Steve Loughran commented on YARN-4438: -- It's complaining that the javadocs are invalid: Java 8 javadoc

[jira] [Commented] (YARN-3940) Application moveToQueue should check NodeLabel permission

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089764#comment-15089764 ] Hadoop QA commented on YARN-3940: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-4567) javadoc failing on java 8

2016-01-08 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-4567: Summary: javadoc failing on java 8 Key: YARN-4567 URL: https://issues.apache.org/jira/browse/YARN-4567 Project: Hadoop YARN Issue Type: Bug

[jira] [Assigned] (YARN-4563) ContainerMetrics deadlocks

2016-01-08 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-4563: --- Assignee: Naganarasimha G R > ContainerMetrics deadlocks > --

[jira] [Commented] (YARN-4563) ContainerMetrics deadlocks

2016-01-08 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089046#comment-15089046 ] Naganarasimha G R commented on YARN-4563: - Sorry by mistake assigned it ... > ContainerMetrics

[jira] [Commented] (YARN-4563) ContainerMetrics deadlocks

2016-01-08 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089084#comment-15089084 ] Naganarasimha G R commented on YARN-4563: - Seems like the code in the stack trace is before to

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090448#comment-15090448 ] Hadoop QA commented on YARN-3995: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2016-01-08 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090452#comment-15090452 ] Naganarasimha G R commented on YARN-3995: - checkstyle in the latest patch is for size of

[jira] [Created] (YARN-4570) Nodemanager leaking RawLocalFilesystem instances for user "testing"

2016-01-08 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-4570: Summary: Nodemanager leaking RawLocalFilesystem instances for user "testing" Key: YARN-4570 URL: https://issues.apache.org/jira/browse/YARN-4570 Project: Hadoop YARN

[jira] [Commented] (YARN-4570) Nodemanager leaking RawLocalFilesystem instances for user "testing"

2016-01-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1508#comment-1508 ] Jason Lowe commented on YARN-4570: -- The "testing" user shows up in the LocalizerTokenIdentifier. I

[jira] [Updated] (YARN-4569) Remove incorrect part of maxResources in FairScheduler documentation

2016-01-08 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4569: - Issue Type: Improvement (was: Bug) > Remove incorrect part of maxResources in FairScheduler documentation

[jira] [Updated] (YARN-4560) Make scheduler error checking message more user friendly

2016-01-08 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4560: - Issue Type: Improvement (was: Bug) > Make scheduler error checking message more user friendly >

[jira] [Updated] (YARN-4568) Fix message when NodeManager runs into errors initializing the recovery directory

2016-01-08 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4568: - Issue Type: Improvement (was: Bug) > Fix message when NodeManager runs into errors initializing the

[jira] [Updated] (YARN-4541) Change log message in LocalizedResource#handle() to DEBUG

2016-01-08 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4541: - Issue Type: Improvement (was: Task) > Change log message in LocalizedResource#handle() to DEBUG >

[jira] [Updated] (YARN-4568) Fix message when NodeManager runs into errors initializing the recovery directory

2016-01-08 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4568: - Labels: supportability (was: ) > Fix message when NodeManager runs into errors initializing the recovery

[jira] [Updated] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2016-01-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4311: -- Attachment: YARN-4311-v5.patch Added a check before setting the timestamp of an untracked node such that

[jira] [Created] (YARN-4572) TestCapacityScheduler#testHeadRoomCalculationWithDRC failing

2016-01-08 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-4572: -- Summary: TestCapacityScheduler#testHeadRoomCalculationWithDRC failing Key: YARN-4572 URL: https://issues.apache.org/jira/browse/YARN-4572 Project: Hadoop YARN

[jira] [Updated] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2016-01-08 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3995: Attachment: YARN-3995-feature-YARN-2928.v1.003.patch Thanks for the comments [~sjlee0], have

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090427#comment-15090427 ] Hadoop QA commented on YARN-4265: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4519) potential deadlock of CapacityScheduler between decrease container and assign containers

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090357#comment-15090357 ] Hadoop QA commented on YARN-4519: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4571) Make app id/name available to the yarn authorizer provider for better auditing

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090380#comment-15090380 ] Hadoop QA commented on YARN-4571: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4565) When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead to situation where all queue resources consumed by AMs only

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090388#comment-15090388 ] Hadoop QA commented on YARN-4565: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4565) When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead to situation where all queue resources consumed by AMs only

2016-01-08 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090344#comment-15090344 ] Naganarasimha G R commented on YARN-4565: - Hi [~wangda], Overall the approach seems to be good, but

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090376#comment-15090376 ] Hadoop QA commented on YARN-4311: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4411) ResourceManager IllegalArgumentException error

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088971#comment-15088971 ] Hadoop QA commented on YARN-4411: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4563) ContainerMetrics deadlocks

2016-01-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-4563: Description: On one of our environment, some NodeManagers' webapp do not working. I found a dead

[jira] [Updated] (YARN-4563) ContainerMetrics deadlocks

2016-01-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-4563: Attachment: jstack.log Attaching the stacktrace of the threads related to the dead lock. >

[jira] [Commented] (YARN-4549) Containers stuck in KILLING state

2016-01-08 Thread Danil Serdyuchenko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088981#comment-15088981 ] Danil Serdyuchenko commented on YARN-4549: -- Yep, looks like we had tmpwatch delete all files older

[jira] [Created] (YARN-4563) ContainerMetrics deadlocks

2016-01-08 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created YARN-4563: --- Summary: ContainerMetrics deadlocks Key: YARN-4563 URL: https://issues.apache.org/jira/browse/YARN-4563 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-4563) ContainerMetrics deadlocks

2016-01-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089042#comment-15089042 ] Akira AJISAKA commented on YARN-4563: - Seems to be related to YARN-3619. > ContainerMetrics deadlocks

[jira] [Commented] (YARN-4563) ContainerMetrics deadlocks

2016-01-08 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089119#comment-15089119 ] Rohith Sharma K S commented on YARN-4563: - Based on the commit history of YARN-3619, YARN-3619 is

[jira] [Updated] (YARN-4563) ContainerMetrics deadlocks

2016-01-08 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4563: Attachment: 0001-YARN-4563.patch > ContainerMetrics deadlocks > -- >

[jira] [Commented] (YARN-4411) ResourceManager IllegalArgumentException error

2016-01-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089280#comment-15089280 ] Daniel Templeton commented on YARN-4411: Thanks, [~yarntime]. That appears to be the correct and

[jira] [Commented] (YARN-4563) ContainerMetrics deadlocks

2016-01-08 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089113#comment-15089113 ] Rohith Sharma K S commented on YARN-4563: - IIUC, in trunk this issue should not come because

[jira] [Commented] (YARN-4550) some tests in TestContainerLanch fails on non-english locale environment

2016-01-08 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089134#comment-15089134 ] Takashi Ohnishi commented on YARN-4550: --- Thank you, [~ste...@apache.org]! > some tests in

[jira] [Created] (YARN-4565) When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead to situation where all queue resources consumed by AMs only

2016-01-08 Thread Karam Singh (JIRA)
Karam Singh created YARN-4565: - Summary: When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead to situation where all queue resources consumed by AMs only Key: YARN-4565 URL:

[jira] [Created] (YARN-4566) TestMiniYarnClusterNodeUtilization sometimes fails on trunk

2016-01-08 Thread Takashi Ohnishi (JIRA)
Takashi Ohnishi created YARN-4566: - Summary: TestMiniYarnClusterNodeUtilization sometimes fails on trunk Key: YARN-4566 URL: https://issues.apache.org/jira/browse/YARN-4566 Project: Hadoop YARN

[jira] [Created] (YARN-4564) Set default Docker build uses JDK7

2016-01-08 Thread Kai Sasaki (JIRA)
Kai Sasaki created YARN-4564: Summary: Set default Docker build uses JDK7 Key: YARN-4564 URL: https://issues.apache.org/jira/browse/YARN-4564 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-4544) All the log messages about rolling monitoring interval are shown with WARN level

2016-01-08 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089133#comment-15089133 ] Takashi Ohnishi commented on YARN-4544: --- Thank you, [~ajisakaa]! > All the log messages about

[jira] [Commented] (YARN-4563) ContainerMetrics deadlocks

2016-01-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089116#comment-15089116 ] Akira AJISAKA commented on YARN-4563: - Hi [~rohithsharma], thank you for your comment. Do you think

[jira] [Resolved] (YARN-4564) Set default Docker build uses JDK7

2016-01-08 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki resolved YARN-4564. -- Resolution: Duplicate Release Note: Duplicate to HADOOP-12698. > Set default Docker build uses

[jira] [Commented] (YARN-4563) ContainerMetrics deadlocks

2016-01-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089090#comment-15089090 ] Akira AJISAKA commented on YARN-4563: - bq. you mean to say YARN-3619 fixes this issue? I meant that

[jira] [Commented] (YARN-4566) TestMiniYarnClusterNodeUtilization sometimes fails on trunk

2016-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089396#comment-15089396 ] Hadoop QA commented on YARN-4566: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

2016-01-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089395#comment-15089395 ] Sunil G commented on YARN-4304: --- Yes [~leftnoteasy] I tried this also earlier, and I was getting same

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

2016-01-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089413#comment-15089413 ] Junping Du commented on YARN-4265: -- Thanks [~gtCarrera9] for updating the patch. trunk.003 patch is

[jira] [Updated] (YARN-4412) Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

2016-01-08 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-4412: - Assignee: Arun Suresh (was: Konstantinos Karanasos) > Create ClusterMonitor to

[jira] [Updated] (YARN-3940) Application moveToQueue should check NodeLabel permission

2016-01-08 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3940: --- Attachment: 0006-YARN-3940.patch Attaching fix for checkstyle fix and findbugs. > Application

[jira] [Commented] (YARN-4438) Implement RM leader election with curator

2016-01-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089512#comment-15089512 ] Akira AJISAKA commented on YARN-4438: - Hi [~xgong] and [~jianhe], bq. -1 javadoc please do not ignore

[jira] [Commented] (YARN-1564) add some basic workflow YARN services

2016-01-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089577#comment-15089577 ] ASF GitHub Bot commented on YARN-1564: -- GitHub user steveloughran opened a pull request:

[jira] [Commented] (YARN-4566) TestMiniYarnClusterNodeUtilization sometimes fails on trunk

2016-01-08 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089328#comment-15089328 ] Takashi Ohnishi commented on YARN-4566: --- The NPE happens at getNodeUtilization: {code} 213 //

[jira] [Commented] (YARN-4414) Nodemanager connection errors are retried at multiple levels

2016-01-08 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15089339#comment-15089339 ] Chang Li commented on YARN-4414: Hi [~xinxianyin], RM HA already disables IPC retries. Also client should

  1   2   >