[jira] [Updated] (YARN-2352) FairScheduler: Collect metrics on duration of critical methods that affect performance

[ https://issues.apache.org/jira/browse/YARN-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2352: --- Attachment: yarn-2352-2.patch Patch to fix TestFairScheduler failure. > FairScheduler: Colle

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085855#comment-14085855 ] Hadoop QA commented on YARN-2229: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2136) RMStateStore can explicitly handle store/update events when fenced

[ https://issues.apache.org/jira/browse/YARN-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085826#comment-14085826 ] Varun Saxena commented on YARN-2136: Yes, no more store operations can be performed onc

[jira] [Created] (YARN-2382) Resource Manager throws InvalidStateTransitonException

Nishan Shetty created YARN-2382: --- Summary: Resource Manager throws InvalidStateTransitonException Key: YARN-2382 URL: https://issues.apache.org/jira/browse/YARN-2382 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-2352) FairScheduler: Collect metrics on duration of critical methods that affect performance

[ https://issues.apache.org/jira/browse/YARN-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085725#comment-14085725 ] Hadoop QA commented on YARN-2352: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2212) ApplicationMaster needs to find a way to update the AMRMToken periodically

[ https://issues.apache.org/jira/browse/YARN-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085722#comment-14085722 ] Hadoop QA commented on YARN-2212: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2229) ContainerId can overflow with RM restart

[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2229: - Attachment: YARN-2229.11.patch > ContainerId can overflow with RM restart > --

[jira] [Updated] (YARN-2352) FairScheduler: Collect metrics on duration of critical methods that affect performance

[ https://issues.apache.org/jira/browse/YARN-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2352: --- Attachment: yarn-2352-1.patch > FairScheduler: Collect metrics on duration of critical methods

[jira] [Updated] (YARN-2352) FairScheduler: Collect metrics on duration of critical methods that affect performance

[ https://issues.apache.org/jira/browse/YARN-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2352: --- Attachment: fs-perf-metrics.png Just got a working version of this, and here is a screenshot f

[jira] [Commented] (YARN-2301) Improve yarn container command

[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085628#comment-14085628 ] Naganarasimha G R commented on YARN-2301: - Hi [~zjshen], I believe the existing

[jira] [Updated] (YARN-2212) ApplicationMaster needs to find a way to update the AMRMToken periodically

[ https://issues.apache.org/jira/browse/YARN-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2212: Attachment: YARN-2212.6.patch > ApplicationMaster needs to find a way to update the AMRMToken periodically >

[jira] [Commented] (YARN-2212) ApplicationMaster needs to find a way to update the AMRMToken periodically

[ https://issues.apache.org/jira/browse/YARN-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085556#comment-14085556 ] Xuan Gong commented on YARN-2212: - new patch addressed all latest comments. bq. Please try

[jira] [Updated] (YARN-2212) ApplicationMaster needs to find a way to update the AMRMToken periodically

[ https://issues.apache.org/jira/browse/YARN-2212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2212: Attachment: YARN-2212.6.patch > ApplicationMaster needs to find a way to update the AMRMToken periodically >

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085516#comment-14085516 ] Zhijie Shen commented on YARN-2229: --- I'm okay with the plan. > ContainerId can overflow

[jira] [Commented] (YARN-1954) Add waitFor to AMRMClient(Async)

[ https://issues.apache.org/jira/browse/YARN-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085505#comment-14085505 ] Tsuyoshi OZAWA commented on YARN-1954: -- I see. One straight way is changing interface

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085484#comment-14085484 ] Jian He commented on YARN-611: -- Thinking if the following API is simpler to use. This is simila

[jira] [Assigned] (YARN-72) NM should handle cleaning up containers when it shuts down

[ https://issues.apache.org/jira/browse/YARN-72?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-72: Assignee: Sandy Ryza (was: Vinod Kumar Vavilapalli) > NM should handle cleaning up containers

[jira] [Commented] (YARN-2277) Add Cross-Origin support to the ATS REST API

[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085291#comment-14085291 ] Zhijie Shen commented on YARN-2277: --- [~jeagles], thanks for the patch. Some more comments

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085289#comment-14085289 ] Ivan Mitic commented on YARN-2198: -- Thanks Remus for working on this! I went over the patc

[jira] [Assigned] (YARN-2138) Cleanup notifyDone* methods in RMStateStore

[ https://issues.apache.org/jira/browse/YARN-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-2138: -- Assignee: Varun Saxena > Cleanup notifyDone* methods in RMStateStore > -

[jira] [Updated] (YARN-2375) Allow enabling/disabling timeline server per framework

[ https://issues.apache.org/jira/browse/YARN-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2375: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-1530 > Allow enabling/disabling timeline s

[jira] [Commented] (YARN-2301) Improve yarn container command

[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14085040#comment-14085040 ] Zhijie Shen commented on YARN-2301: --- [~Naganarasimha], do you mean you want to move bq.

[jira] [Updated] (YARN-857) Errors when localizing end up with the localization failure not being seen by the NM

[ https://issues.apache.org/jira/browse/YARN-857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-857: - Assignee: Vinod Kumar Vavilapalli (was: Hitesh Shah) > Errors when localizing end up with the localization

[jira] [Commented] (YARN-2374) YARN trunk build failing TestDistributedShell.testDSShell

[ https://issues.apache.org/jira/browse/YARN-2374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084986#comment-14084986 ] Jian He commented on YARN-2374: --- looks good, [~vvasudev], can you add some comments to the ch

[jira] [Commented] (YARN-1954) Add waitFor to AMRMClient(Async)

[ https://issues.apache.org/jira/browse/YARN-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084981#comment-14084981 ] Zhijie Shen commented on YARN-1954: --- My concern is that if users want a even larger check

[jira] [Commented] (YARN-2136) RMStateStore can explicitly handle store/update events when fenced

[ https://issues.apache.org/jira/browse/YARN-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084971#comment-14084971 ] Jian He commented on YARN-2136: --- On a second check, state-store is actually already stopped/c

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084869#comment-14084869 ] Zhijie Shen commented on YARN-2033: --- [~djp], thanks for you volunteering to review this b

[jira] [Commented] (YARN-2381) CLONE - Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084804#comment-14084804 ] Wei Yan commented on YARN-2381: --- [~Jackliu91], purpose of this jira? > CLONE - Yarn Schedule

[jira] [Updated] (YARN-2381) CLONE - Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2381: -- Assignee: (was: Wei Yan) > CLONE - Yarn Scheduler Load Simulator > - > >

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084797#comment-14084797 ] Wei Yan commented on YARN-1021: --- [~Jackliu91], yes, the simulator has exception in hadoop-2.4

[jira] [Commented] (YARN-2370) Fix comment in o.a.h.y.server.resourcemanager.schedulerAppSchedulingInfo

[ https://issues.apache.org/jira/browse/YARN-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084740#comment-14084740 ] Hudson commented on YARN-2370: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1852 (See [htt

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084689#comment-14084689 ] JiankunLiu commented on YARN-1021: -- I found that it was no exception on hadoop-2.3.0. But

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084670#comment-14084670 ] Junping Du commented on YARN-2033: -- Thanks [~zjshen] for uploading a proposal and keep upd

[jira] [Commented] (YARN-2370) Fix comment in o.a.h.y.server.resourcemanager.schedulerAppSchedulingInfo

[ https://issues.apache.org/jira/browse/YARN-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084666#comment-14084666 ] Hudson commented on YARN-2370: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1827 (See [https://

[jira] [Commented] (YARN-1354) Recover applications upon nodemanager restart

[ https://issues.apache.org/jira/browse/YARN-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084647#comment-14084647 ] Hudson commented on YARN-1354: -- FAILURE: Integrated in Hadoop-trunk-Commit #6007 (See [https:

[jira] [Commented] (YARN-1354) Recover applications upon nodemanager restart

[ https://issues.apache.org/jira/browse/YARN-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084554#comment-14084554 ] Junping Du commented on YARN-1354: -- bq. It's possible if they explicitly handle it themsel

[jira] [Commented] (YARN-2370) Fix comment in o.a.h.y.server.resourcemanager.schedulerAppSchedulingInfo

[ https://issues.apache.org/jira/browse/YARN-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084550#comment-14084550 ] Hudson commented on YARN-2370: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #633 (See [https://b

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084547#comment-14084547 ] Remus Rusanu commented on YARN-2198: > How the service's port is configured LRPC proto

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084540#comment-14084540 ] Remus Rusanu commented on YARN-2198: > The NM never explicitly reads the stdout/stderr

[jira] [Commented] (YARN-2136) RMStateStore can explicitly handle store/update events when fenced

[ https://issues.apache.org/jira/browse/YARN-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084473#comment-14084473 ] Varun Saxena commented on YARN-2136: Thanks [~jianhe]. I will work on it. What I will

[jira] [Created] (YARN-2381) CLONE - Yarn Scheduler Load Simulator

JiankunLiu created YARN-2381: Summary: CLONE - Yarn Scheduler Load Simulator Key: YARN-2381 URL: https://issues.apache.org/jira/browse/YARN-2381 Project: Hadoop YARN Issue Type: New Feature

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14084438#comment-14084438 ] JiankunLiu commented on YARN-1021: -- Hi Wei Yan,I meet with the following exception when I