[jira] [Created] (YARN-1192) Update HAServiceState to STOPPING on RM#stop()

2013-09-13 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-1192: -- Summary: Update HAServiceState to STOPPING on RM#stop() Key: YARN-1192 URL: https://issues.apache.org/jira/browse/YARN-1192 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-1185) FileSystemRMStateStore can leave partial files that prevent subsequent recovery

2013-09-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1185: - Summary: FileSystemRMStateStore can leave partial files that prevent subsequent recovery (was:

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

2013-09-13 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766124#comment-13766124 ] Eli Collins commented on YARN-1024: --- bq. keeping virtual cores to express parallelism

[jira] [Created] (YARN-1193) ResourceManger.clusterTimeStamp should be reset when RM transitions to active

2013-09-13 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-1193: -- Summary: ResourceManger.clusterTimeStamp should be reset when RM transitions to active Key: YARN-1193 URL: https://issues.apache.org/jira/browse/YARN-1193

[jira] [Commented] (YARN-311) Dynamic node resource configuration: core scheduler changes

2013-09-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766141#comment-13766141 ] Junping Du commented on YARN-311: - Thanks Luke for review and comments!

[jira] [Created] (YARN-1186) Add support for simulating several important behaviors in the MRAM to yarn scheduler simulator

2013-09-13 Thread Wei Yan (JIRA)
Wei Yan created YARN-1186: - Summary: Add support for simulating several important behaviors in the MRAM to yarn scheduler simulator Key: YARN-1186 URL: https://issues.apache.org/jira/browse/YARN-1186

[jira] [Updated] (YARN-1027) Implement RMHAProtocolService

2013-09-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1027: --- Attachment: yarn-1027-7.patch Implement RMHAProtocolService

[jira] [Commented] (YARN-1027) Implement RMHAProtocolService

2013-09-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766162#comment-13766162 ] Karthik Kambatla commented on YARN-1027: bq. Should createAndInit/Start/Stop

[jira] [Created] (YARN-1187) Add discrete event-based simulation to yarn scheduler simulator

2013-09-13 Thread Wei Yan (JIRA)
Wei Yan created YARN-1187: - Summary: Add discrete event-based simulation to yarn scheduler simulator Key: YARN-1187 URL: https://issues.apache.org/jira/browse/YARN-1187 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-1027) Implement RMHAProtocolService

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766174#comment-13766174 ] Hadoop QA commented on YARN-1027: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-1194) TestContainerLogsPage test fails on trunk

2013-09-13 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created YARN-1194: -- Summary: TestContainerLogsPage test fails on trunk Key: YARN-1194 URL: https://issues.apache.org/jira/browse/YARN-1194 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-1027) Implement RMHAProtocolService

2013-09-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1027: --- Attachment: yarn-1027-7.patch Implement RMHAProtocolService

[jira] [Commented] (YARN-905) Add state filters to nodes CLI

2013-09-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765778#comment-13765778 ] Wei Yan commented on YARN-905: -- [~sandyr], [~vinodkv] Confused last time. I'll close YARN-1126

[jira] [Updated] (YARN-1193) ResourceManger.clusterTimeStamp should be reset when RM transitions to active

2013-09-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1193: --- Attachment: yarn-1193-1.patch Straight-forward patch.

[jira] [Updated] (YARN-1130) Improve the log flushing for tasks when mapred.userlog.limit.kb is set

2013-09-13 Thread Paul Han (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Han updated YARN-1130: --- Attachment: YARN-1130.patch Improve the log flushing for tasks when mapred.userlog.limit.kb is set

[jira] [Commented] (YARN-1027) Implement RMHAProtocolService

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766203#comment-13766203 ] Hadoop QA commented on YARN-1027: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1189) NMTokenSecretManagerInNM is not being told when applications have finished

2013-09-13 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766208#comment-13766208 ] Omkar Vinit Joshi commented on YARN-1189: - Yes this is clearly a leak... I had this

[jira] [Assigned] (YARN-1189) NMTokenSecretManagerInNM is not being told when applications have finished

2013-09-13 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi reassigned YARN-1189: --- Assignee: Omkar Vinit Joshi NMTokenSecretManagerInNM is not being told when

[jira] [Updated] (YARN-1189) NMTokenSecretManagerInNM is not being told when applications have finished

2013-09-13 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-1189: Attachment: YARN-1189-20130912.1.patch NMTokenSecretManagerInNM is not being told when

[jira] [Commented] (YARN-867) Isolation of failures in aux services

2013-09-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765878#comment-13765878 ] Zhijie Shen commented on YARN-867: -- Think about the problem again. Essentially, problem is

[jira] [Updated] (YARN-1183) MiniYARNCluster shutdown takes several minutes intermittently

2013-09-13 Thread Andrey Klochkov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Klochkov updated YARN-1183: -- Attachment: YARN-1183--n2.patch Attaching an updated patch. Updated the name of the wait

[jira] [Commented] (YARN-1189) NMTokenSecretManagerInNM is not being told when applications have finished

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766221#comment-13766221 ] Hadoop QA commented on YARN-1189: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1068) Add admin support for HA operations

2013-09-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1068: --- Attachment: yarn-1068-1.patch Updated patch to capture the updates to YARN-1027.

[jira] [Assigned] (YARN-1184) ClassCastException is thrown during preemption When a huge job is submitted to a queue B whose resources is used by a job in queueA

2013-09-13 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K reassigned YARN-1184: --- Assignee: Devaraj K ClassCastException is thrown during preemption When a huge job is submitted

[jira] [Commented] (YARN-867) Isolation of failures in aux services

2013-09-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765884#comment-13765884 ] Zhijie Shen commented on YARN-867: -- Sorry to post the broken comment before. Think about

[jira] [Commented] (YARN-1027) Implement RMHAProtocolService

2013-09-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766227#comment-13766227 ] Karthik Kambatla commented on YARN-1027: For manual testing, I applied the patches

[jira] [Commented] (YARN-1183) MiniYARNCluster shutdown takes several minutes intermittently

2013-09-13 Thread Andrey Klochkov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766237#comment-13766237 ] Andrey Klochkov commented on YARN-1183: --- bq. MiniYARNCluster is used by several

[jira] [Created] (YARN-1195) RM may relaunch already KILLED / FAILED jobs after RM restarts

2013-09-13 Thread Jian He (JIRA)
Jian He created YARN-1195: - Summary: RM may relaunch already KILLED / FAILED jobs after RM restarts Key: YARN-1195 URL: https://issues.apache.org/jira/browse/YARN-1195 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-1194) TestContainerLogsPage test fails on trunk

2013-09-13 Thread Roman Shaposhnik (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Shaposhnik updated YARN-1194: --- Attachment: YARN-1194.patch.txt TestContainerLogsPage test fails on trunk

[jira] [Commented] (YARN-1183) MiniYARNCluster shutdown takes several minutes intermittently

2013-09-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765904#comment-13765904 ] Karthik Kambatla commented on YARN-1183: bq. It may be a non necessary optimization

[jira] [Commented] (YARN-1194) TestContainerLogsPage test fails on trunk

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766245#comment-13766245 ] Hadoop QA commented on YARN-1194: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-540: - Attachment: YARN-540.7.patch Race condition causing RM to potentially relaunch already unregistered AMs on

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766274#comment-13766274 ] Hadoop QA commented on YARN-540: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1191) [YARN-321] Update artifact versions for application history service

2013-09-13 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-1191: Summary: [YARN-321] Update artifact versions for application history service (was: [YARN-321] Compilation

[jira] [Commented] (YARN-1191) [YARN-321] Update artifact versions for application history service

2013-09-13 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766276#comment-13766276 ] Devaraj K commented on YARN-1191: - +1, Patch looks good to me. [YARN-321]

[jira] [Created] (YARN-1196) LocalDirsHandlerService never change failedDirs back to normal even when these disks turn good

2013-09-13 Thread Nemon Lou (JIRA)
Nemon Lou created YARN-1196: --- Summary: LocalDirsHandlerService never change failedDirs back to normal even when these disks turn good Key: YARN-1196 URL: https://issues.apache.org/jira/browse/YARN-1196

[jira] [Updated] (YARN-1196) LocalDirsHandlerService never change failedDirs back to normal even when these disks turn good

2013-09-13 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated YARN-1196: Description: A simple way to reproduce it: 1,change access mode of one node manager's local-dirs to 000

[jira] [Commented] (YARN-1197) Add container merge support in YARN

2013-09-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766343#comment-13766343 ] Wangda Tan commented on YARN-1197: -- I don't know is it possible to add this in RM or NM

[jira] [Created] (YARN-1197) Add container merge support in YARN

2013-09-13 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1197: Summary: Add container merge support in YARN Key: YARN-1197 URL: https://issues.apache.org/jira/browse/YARN-1197 Project: Hadoop YARN Issue Type: Task

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766290#comment-13766290 ] Bikas Saha commented on YARN-540: - bq. Delete throws exception in case of not-existing If

[jira] [Commented] (YARN-1183) MiniYARNCluster shutdown takes several minutes intermittently

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766597#comment-13766597 ] Hadoop QA commented on YARN-1183: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-978) [YARN-321] Adding ApplicationAttemptReport and Protobuf implementation

2013-09-13 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766572#comment-13766572 ] Xuan Gong commented on YARN-978: bq. I'm fine with remove it, but trackingUrl is on web UI

[jira] [Commented] (YARN-1157) ResourceManager UI has invalid tracking URL link for distributed shell application

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766565#comment-13766565 ] Hadoop QA commented on YARN-1157: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1194) TestContainerLogsPage fails with native builds

2013-09-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766547#comment-13766547 ] Hudson commented on YARN-1194: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4408 (See

[jira] [Commented] (YARN-905) Add state filters to nodes CLI

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766550#comment-13766550 ] Hadoop QA commented on YARN-905: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1194) TestContainerLogsPage test fails on trunk

2013-09-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766516#comment-13766516 ] Jason Lowe commented on YARN-1194: -- +1, lgtm. TestContainerLogsPage test

[jira] [Updated] (YARN-1194) TestContainerLogsPage fails with native builds

2013-09-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1194: - Fix Version/s: (was: 2.1.1-beta) Summary: TestContainerLogsPage fails with native builds

[jira] [Commented] (YARN-1078) TestNodeManagerResync, TestNodeManagerShutdown, and TestNodeStatusUpdater fail on Windows

2013-09-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766509#comment-13766509 ] Hudson commented on YARN-1078: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1547 (See

[jira] [Updated] (YARN-1183) MiniYARNCluster shutdown takes several minutes intermittently

2013-09-13 Thread Andrey Klochkov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Klochkov updated YARN-1183: -- Attachment: YARN-1183--n4.patch MiniYARNCluster shutdown takes several minutes

[jira] [Commented] (YARN-1157) ResourceManager UI has invalid tracking URL link for distributed shell application

2013-09-13 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766556#comment-13766556 ] Xuan Gong commented on YARN-1157: - The reason is: At

[jira] [Updated] (YARN-1183) MiniYARNCluster shutdown takes several minutes intermittently

2013-09-13 Thread Andrey Klochkov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Klochkov updated YARN-1183: -- Attachment: YARN-1183--n3.patch Attaching an updated patch MiniYARNCluster

[jira] [Commented] (YARN-1183) MiniYARNCluster shutdown takes several minutes intermittently

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766634#comment-13766634 ] Hadoop QA commented on YARN-1183: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1193) ResourceManger.clusterTimeStamp should be reset when RM transitions to active

2013-09-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766645#comment-13766645 ] Bikas Saha commented on YARN-1193: -- isnt this already fixed in YARN-1027. Did you mean to

[jira] [Commented] (YARN-1183) MiniYARNCluster shutdown takes several minutes intermittently

2013-09-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766690#comment-13766690 ] Karthik Kambatla commented on YARN-1183: Looks good to me. +1. Thanks Andrey.

[jira] [Updated] (YARN-1197) Add container merge support in YARN

2013-09-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-1197: - Description: Currently, YARN cannot support merge several containers in one node to a big container,

[jira] [Updated] (YARN-905) Add state filters to nodes CLI

2013-09-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-905: - Attachment: YARN-905-addendum.patch Add state filters to nodes CLI --

[jira] [Commented] (YARN-1193) ResourceManger.clusterTimeStamp should be reset when RM transitions to active

2013-09-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766684#comment-13766684 ] Karthik Kambatla commented on YARN-1193: [~bikassaha], looks like I misunderstood

[jira] [Commented] (YARN-1197) Add container merge support in YARN

2013-09-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766650#comment-13766650 ] Bikas Saha commented on YARN-1197: -- bq. 1) We can incrementally send resource request with

[jira] [Commented] (YARN-1193) ResourceManger.clusterTimeStamp should be reset when RM transitions to active

2013-09-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766701#comment-13766701 ] Bikas Saha commented on YARN-1193: -- The patch in YARN-1027 is incorrect without the

[jira] [Resolved] (YARN-1193) ResourceManger.clusterTimeStamp should be reset when RM transitions to active

2013-09-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved YARN-1193. -- Resolution: Duplicate Assignee: (was: Karthik Kambatla) YARN-1027 fixes this.

[jira] [Commented] (YARN-1078) TestNodeManagerResync, TestNodeManagerShutdown, and TestNodeStatusUpdater fail on Windows

2013-09-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766401#comment-13766401 ] Hudson commented on YARN-1078: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #331 (See

[jira] [Commented] (YARN-1197) Add container merge support in YARN

2013-09-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766646#comment-13766646 ] Bikas Saha commented on YARN-1197: -- (Copying description into comments to reduce email

[jira] [Updated] (YARN-1027) Implement RMHAProtocolService

2013-09-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1027: --- Attachment: yarn-1027-8.patch Including the patch from YARN-1193. Implement

[jira] [Updated] (YARN-1189) NMTokenSecretManagerInNM is not being told when applications have finished

2013-09-13 Thread Omkar Vinit Joshi (JIRA)
Reporter: Jason Lowe Assignee: Omkar Vinit Joshi Priority: Blocker Attachments: YARN-1189-20130912.1.patch, YARN-1189-20130913.txt The {{appFinished}} method is not being called when applications have finished. This causes a couple of leaks

[jira] [Commented] (YARN-1189) NMTokenSecretManagerInNM is not being told when applications have finished

2013-09-13 Thread Omkar Vinit Joshi (JIRA)
YARN Issue Type: Bug Affects Versions: 2.1.0-beta, 2.1.1-beta Reporter: Jason Lowe Assignee: Omkar Vinit Joshi Priority: Blocker Attachments: YARN-1189-20130912.1.patch, YARN-1189-20130913.txt The {{appFinished}} method is not being called

[jira] [Updated] (YARN-975) Adding HDFS implementation for grouped reading and writing interfaces of history storage

2013-09-13 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-975: --- Attachment: YARN-975.5.patch Attaching rebased patch. Thanks, Mayank Adding HDFS

[jira] [Commented] (YARN-1189) NMTokenSecretManagerInNM is not being told when applications have finished

2013-09-13 Thread Daryn Sharp (JIRA)
Project: Hadoop YARN Issue Type: Bug Affects Versions: 2.1.0-beta, 2.1.1-beta Reporter: Jason Lowe Assignee: Omkar Vinit Joshi Priority: Blocker Attachments: YARN-1189-20130912.1.patch, YARN-1189-20130913.txt The {{appFinished

[jira] [Commented] (YARN-975) Adding HDFS implementation for grouped reading and writing interfaces of history storage

2013-09-13 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766774#comment-13766774 ] Mayank Bansal commented on YARN-975: Patch needs rebasing Adding HDFS

[jira] [Commented] (YARN-1027) Implement RMHAProtocolService

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766750#comment-13766750 ] Hadoop QA commented on YARN-1027: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1194) TestContainerLogsPage fails with native builds

2013-09-13 Thread Roman Shaposhnik (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766638#comment-13766638 ] Roman Shaposhnik commented on YARN-1194: [~jlowe] thanks a lot for a quick

[jira] [Created] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2013-09-13 Thread Omkar Vinit Joshi (JIRA)
Omkar Vinit Joshi created YARN-1198: --- Summary: Capacity Scheduler headroom calculation does not work as expected Key: YARN-1198 URL: https://issues.apache.org/jira/browse/YARN-1198 Project: Hadoop

[jira] [Commented] (YARN-311) Dynamic node resource configuration: core scheduler changes

2013-09-13 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766787#comment-13766787 ] Arun C Murthy commented on YARN-311: Can I get a few more days to review this? Thanks.

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core scheduler changes

2013-09-13 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated YARN-311: --- Target Version/s: 2.3.0 (was: 2.1.1-beta) Dynamic node resource configuration: core scheduler

[jira] [Commented] (YARN-451) Add more metrics to RM page

2013-09-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766759#comment-13766759 ] Sangjin Lee commented on YARN-451: -- I am pretty close to getting a patch ready for review

[jira] [Updated] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-540: - Attachment: YARN-540.8.patch bq. why didnt this code in the previous patch cause an exception to be thrown for a

[jira] [Commented] (YARN-1189) NMTokenSecretManagerInNM is not being told when applications have finished

2013-09-13 Thread Daryn Sharp (JIRA)
/YARN-1189 Project: Hadoop YARN Issue Type: Bug Affects Versions: 2.1.0-beta, 2.1.1-beta Reporter: Jason Lowe Assignee: Omkar Vinit Joshi Priority: Blocker Attachments: YARN-1189-20130912.1.patch, YARN-1189-20130913.txt

[jira] [Commented] (YARN-953) [YARN-321] Change ResourceManager to use HistoryStorage to log history data

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766872#comment-13766872 ] Hadoop QA commented on YARN-953: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1189) NMTokenSecretManagerInNM is not being told when applications have finished

2013-09-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1189: - Attachment: YARN-1189-20130913.txt Thanks, Omkar. Patch looks good to me. Here's the patch with a unit

[jira] [Updated] (YARN-953) [YARN-321] Change ResourceManager to use HistoryStorage to log history data

2013-09-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-953: - Attachment: YARN-953.4.patch Rebase the patch [YARN-321] Change ResourceManager to use

[jira] [Commented] (YARN-1001) YARN should provide per application-type and state statistics

2013-09-13 Thread Srimanth Gunturi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766878#comment-13766878 ] Srimanth Gunturi commented on YARN-1001: What we need is a call like

[jira] [Updated] (YARN-978) [YARN-321] Adding ApplicationAttemptReport and Protobuf implementation

2013-09-13 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-978: --- Attachment: YARN-978.8.patch New patch adds TrackingUrl back, and remove the logUrl(This will be exposed by

[jira] [Commented] (YARN-978) [YARN-321] Adding ApplicationAttemptReport and Protobuf implementation

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766916#comment-13766916 ] Hadoop QA commented on YARN-978: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766926#comment-13766926 ] Bikas Saha commented on YARN-540: - bq. Because I added a check in RMAppRemovingTransition

[jira] [Resolved] (YARN-1178) TestContainerLogsPage#testContainerLogPageAccess is failing

2013-09-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved YARN-1178. -- Resolution: Duplicate Marking this as a duplicate of YARN-1194 since that already has a patch posted.

[jira] [Commented] (YARN-1189) NMTokenSecretManagerInNM is not being told when applications have finished

2013-09-13 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12603017/YARN-1189-20130913.txt against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include

[jira] [Updated] (YARN-905) Add state filters to nodes CLI

2013-09-13 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-905: - Attachment: YARN-905-addendum.patch Update an addendum patch that fixs case-ignored all and invalid input

[jira] [Commented] (YARN-978) [YARN-321] Adding ApplicationAttemptReport and Protobuf implementation

2013-09-13 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766935#comment-13766935 ] Mayank Bansal commented on YARN-978: Looks good +1 Thanks, Mayank

[jira] [Updated] (YARN-1157) ResourceManager UI has invalid tracking URL link for distributed shell application

2013-09-13 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1157: Attachment: YARN-1157.1.patch Trivial patch, no test cases added ResourceManager UI has

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766943#comment-13766943 ] Jian He commented on YARN-540: -- bq. Is that not the flow? Yeah, I think I missed that in the

[jira] [Commented] (YARN-1001) YARN should provide per application-type and state statistics

2013-09-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766950#comment-13766950 ] Zhijie Shen commented on YARN-1001: --- Having talked to [~srimanth.gunturi] offline. Here's

[jira] [Commented] (YARN-1184) ClassCastException is thrown during preemption When a huge job is submitted to a queue B whose resources is used by a job in queueA

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13767039#comment-13767039 ] Hadoop QA commented on YARN-1184: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-311) Dynamic node resource configuration: core scheduler changes

2013-09-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13767095#comment-13767095 ] Junping Du commented on YARN-311: - Sure. Thanks for review. Arun! Dynamic

[jira] [Updated] (YARN-1170) yarn proto definitions should specify package as 'hadoop.yarn'

2013-09-13 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated YARN-1170: Assignee: Binglin Chang yarn proto definitions should specify package as 'hadoop.yarn'

[jira] [Updated] (YARN-1170) yarn proto definitions should specify package as 'hadoop.yarn'

2013-09-13 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated YARN-1170: Attachment: YARN-1170.v1.patch yarn proto definitions should specify package as 'hadoop.yarn'

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13767124#comment-13767124 ] Hadoop QA commented on YARN-540: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1170) yarn proto definitions should specify package as 'hadoop.yarn'

2013-09-13 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13767123#comment-13767123 ] Arun C Murthy commented on YARN-1170: - +1, I'll commit after jenkins is back. Thanks

[jira] [Updated] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-540: - Attachment: YARN-540.9.patch Race condition causing RM to potentially relaunch already unregistered AMs on

[jira] [Commented] (YARN-1170) yarn proto definitions should specify package as 'hadoop.yarn'

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13767160#comment-13767160 ] Hadoop QA commented on YARN-1170: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1001) YARN should provide per application-type and state statistics

2013-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13767159#comment-13767159 ] Hadoop QA commented on YARN-1001: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1001) YARN should provide per application-type and state statistics

2013-09-13 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13767162#comment-13767162 ] Xuan Gong commented on YARN-1001: - One quick comment: Do we suppose to use

  1   2   >