[jira] [Moved] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran moved HADOOP-11826 to YARN-3539: --- Component/s: (was: documentation)

[jira] [Updated] (YARN-3480) Make AM max attempts stored in RMAppImpl and RMStateStore to be configurable

2015-04-23 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-3480: --- Summary: Make AM max attempts stored in RMAppImpl and RMStateStore to be configurable (was: Make AM max

[jira] [Commented] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-04-23 Thread Peng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509256#comment-14509256 ] Peng Zhang commented on YARN-3535: -- As per [~jlowe]'s thoughts, I understand here are two

[jira] [Updated] (YARN-3480) Make AM max attempts stored in RMStateStore to be configurable

2015-04-23 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-3480: --- Attachment: YARN-3480.01.patch Attach an initial patch. I will add test cases later. Make AM max attempts

[jira] [Created] (YARN-3538) TimelineServer doesn't catch/translate all exceptions raised

2015-04-23 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-3538: Summary: TimelineServer doesn't catch/translate all exceptions raised Key: YARN-3538 URL: https://issues.apache.org/jira/browse/YARN-3538 Project: Hadoop YARN

[jira] [Commented] (YARN-3537) NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked

2015-04-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509158#comment-14509158 ] Jason Lowe commented on YARN-3537: -- The code checks for a null store to avoid invoking the

[jira] [Commented] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-04-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509153#comment-14509153 ] Jason Lowe commented on YARN-3535: -- I think we need to fix the RMContainerImpl ALLOCATED

[jira] [Commented] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-23 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509152#comment-14509152 ] Thomas Graves commented on YARN-3517: - + // non-secure mode with no acls enabled

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509237#comment-14509237 ] Sangjin Lee commented on YARN-3437: --- Thanks Junping. I initially went with

[jira] [Commented] (YARN-3471) Fix timeline client retry

2015-04-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509138#comment-14509138 ] Steve Loughran commented on YARN-3471: -- Looking at this patch, it doesn't address the

[jira] [Commented] (YARN-3537) NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked

2015-04-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509208#comment-14509208 ] Brahma Reddy Battula commented on YARN-3537: [~jlowe] thanks for taking look

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509169#comment-14509169 ] Hudson commented on YARN-3434: -- FAILURE: Integrated in Hadoop-trunk-Commit #7646 (See

[jira] [Updated] (YARN-3537) NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked

2015-04-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3537: --- Attachment: YARN-3537-002.patch NPE when NodeManager.serviceInit fails and

[jira] [Commented] (YARN-3537) NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509288#comment-14509288 ] Hadoop QA commented on YARN-3537: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3537) NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked

2015-04-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509303#comment-14509303 ] Jason Lowe commented on YARN-3537: -- If the store is not null then we want to close it

[jira] [Commented] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509313#comment-14509313 ] Hadoop QA commented on YARN-3539: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2740: Attachment: YARN-2740.20150423-1.patch Hi [~wangda], Patch failed to apply on top of yest

[jira] [Updated] (YARN-3477) TimelineClientImpl swallows exceptions

2015-04-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-3477: - Attachment: YARN-3477-001.patch Patch -001 # rethrows last received exception on a retry count

[jira] [Commented] (YARN-3413) Node label attributes (like exclusivity) should settable via addToClusterNodeLabels but shouldn't be changeable at runtime

2015-04-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509556#comment-14509556 ] Hudson commented on YARN-3413: -- FAILURE: Integrated in Hadoop-trunk-Commit #7650 (See

[jira] [Commented] (YARN-3537) NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked

2015-04-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509366#comment-14509366 ] Brahma Reddy Battula commented on YARN-3537: Thanks again for your

[jira] [Commented] (YARN-3537) NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509452#comment-14509452 ] Hadoop QA commented on YARN-3537: - (!) The patch artifact directory on has been removed!

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509455#comment-14509455 ] Wangda Tan commented on YARN-2740: -- Seems like env issue, re-kicked Jenkins.

[jira] [Commented] (YARN-3413) Node label attributes (like exclusivity) should settable via addToClusterNodeLabels but shouldn't be changeable at runtime

2015-04-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509497#comment-14509497 ] Vinod Kumar Vavilapalli commented on YARN-3413: --- I tried running

[jira] [Commented] (YARN-3413) Node label attributes (like exclusivity) should settable via addToClusterNodeLabels but shouldn't be changeable at runtime

2015-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509559#comment-14509559 ] Wangda Tan commented on YARN-3413: -- Thanks Vinod for review commit! Node label

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509451#comment-14509451 ] Hadoop QA commented on YARN-2740: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3319) Implement a FairOrderingPolicy

2015-04-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509470#comment-14509470 ] Hudson commented on YARN-3319: -- FAILURE: Integrated in Hadoop-trunk-Commit #7648 (See

[jira] [Updated] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-23 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3517: Affects Version/s: (was: 2.7.0) RM web ui for dumping scheduler logs should be for admins only

[jira] [Commented] (YARN-3477) TimelineClientImpl swallows exceptions

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509409#comment-14509409 ] Hadoop QA commented on YARN-3477: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509449#comment-14509449 ] Wangda Tan commented on YARN-2740: -- Thanks [~Naganarasimha], will commit once Jenkins get

[jira] [Resolved] (YARN-3190) NM can't aggregate logs: token can't be found in cache

2015-04-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu resolved YARN-3190. - Resolution: Duplicate issue is fixed by YARN-2964 NM can't aggregate logs: token can't be found in

[jira] [Commented] (YARN-3522) DistributedShell uses the wrong user to put timeline data

2015-04-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509464#comment-14509464 ] Jian He commented on YARN-3522: --- lgtm, thanks zhijie ! DistributedShell uses the wrong

[jira] [Commented] (YARN-3522) DistributedShell uses the wrong user to put timeline data

2015-04-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509508#comment-14509508 ] Hudson commented on YARN-3522: -- FAILURE: Integrated in Hadoop-trunk-Commit #7649 (See

[jira] [Commented] (YARN-3528) Tests with 12345 as hard-coded port break jenkins

2015-04-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509230#comment-14509230 ] Brahma Reddy Battula commented on YARN-3528: Planning to give 0 for all HTTP

[jira] [Commented] (YARN-3480) Make AM max attempts stored in RMAppImpl and RMStateStore to be configurable

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509263#comment-14509263 ] Hadoop QA commented on YARN-3480: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-04-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509276#comment-14509276 ] Jason Lowe commented on YARN-3535: -- The first item is to avoid containers failing due to

[jira] [Updated] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-3539: - Attachment: YARN-3539-003.patch Patch -003 updates {{timelineserver.md}} # specify the REST API

[jira] [Updated] (YARN-3537) NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked

2015-04-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3537: --- Attachment: YARN-3537-003.patch NPE when NodeManager.serviceInit fails and

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509774#comment-14509774 ] Li Lu commented on YARN-3431: - Hi [~zjshen], thanks for the update! The latest patch LGTM.

[jira] [Commented] (YARN-3319) Implement a FairOrderingPolicy

2015-04-23 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509641#comment-14509641 ] Craig Welch commented on YARN-3319: --- Yes, it's configured in the capacity scheduler

[jira] [Resolved] (YARN-2032) Implement a scalable, available TimelineStore using HBase

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-2032. --- Resolution: Won't Fix It will be covered in YARN-2928 Implement a scalable, available TimelineStore

[jira] [Created] (YARN-3540) Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler

2015-04-23 Thread Eric Payne (JIRA)
Eric Payne created YARN-3540: Summary: Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler Key: YARN-3540 URL: https://issues.apache.org/jira/browse/YARN-3540

[jira] [Updated] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-23 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3517: Attachment: YARN-3517.005.patch Uploaded a new patch to fix the whitespace and checkstyle errors.

[jira] [Commented] (YARN-3363) add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container.

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509738#comment-14509738 ] Hadoop QA commented on YARN-3363: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509648#comment-14509648 ] Hadoop QA commented on YARN-2740: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509722#comment-14509722 ] zhihai xu commented on YARN-2893: - Hi [~jianhe], Do you think any of my earlier suggestions

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509717#comment-14509717 ] Zhijie Shen commented on YARN-3437: --- Sorry for the late comments. This patch has half MR

[jira] [Commented] (YARN-3319) Implement a FairOrderingPolicy

2015-04-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509630#comment-14509630 ] Vinod Kumar Vavilapalli commented on YARN-3319: --- Is

[jira] [Commented] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509591#comment-14509591 ] Hadoop QA commented on YARN-3517: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3529) Add miniHBase cluster and Phoenix support to ATS v2 unit tests

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509689#comment-14509689 ] Zhijie Shen commented on YARN-3529: --- Previously, we met the compatibility issue of having

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509905#comment-14509905 ] Sangjin Lee commented on YARN-3437: --- Well it's not entirely true. It seems I still need

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509932#comment-14509932 ] Zhijie Shen commented on YARN-3437: --- bq. How's that sound? It's also good to me. bq.

[jira] [Updated] (YARN-3437) convert load test driver to timeline service v.2

2015-04-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3437: -- Issue Type: New Feature (was: Sub-task) Parent: (was: YARN-3378) convert load test driver

[jira] [Updated] (YARN-3390) Reuse TimelineCollectorManager for RM

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3390: -- Attachment: YARN-3390.2.patch Reuse TimelineCollectorManager for RM

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509961#comment-14509961 ] Li Lu commented on YARN-3411: - Oh, and one thing to add, in the added pom file, maybe we can

[jira] [Commented] (YARN-3390) Reuse TimelineCollectorManager for RM

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509962#comment-14509962 ] Zhijie Shen commented on YARN-3390: --- Thanks for the comments. I've addressed Sangjin and

[jira] [Commented] (YARN-2498) Respect labels in preemption policy of capacity scheduler for inter-queue preemption

2015-04-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509967#comment-14509967 ] Jian He commented on YARN-2498: --- - remove below {code} NavigableSetFiCaSchedulerApp ns =

[jira] [Commented] (YARN-3536) ZK exception occur when updating AppAttempt status, then NPE thrown when RM do recover

2015-04-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509802#comment-14509802 ] zhihai xu commented on YARN-3536: - Is This issue similar as YARN-2834? ZK exception

[jira] [Commented] (YARN-3476) Nodemanager can fail to delete local logs if log aggregation fails

2015-04-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509841#comment-14509841 ] Jason Lowe commented on YARN-3476: -- I'm OK with deleting the logs upon error uploading.

[jira] [Commented] (YARN-3509) CollectorNodemanagerProtocol's authorization doesn't work

2015-04-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509864#comment-14509864 ] Junping Du commented on YARN-3509: -- [~zjshen], thanks for updating the patch. Shall we

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509934#comment-14509934 ] Zhijie Shen commented on YARN-3437: --- Oh, previously I said

[jira] [Commented] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509890#comment-14509890 ] Hadoop QA commented on YARN-3517: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509862#comment-14509862 ] Sangjin Lee commented on YARN-3437: --- Thanks for your comments [~zjshen]. {quote} 1. The

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509951#comment-14509951 ] Li Lu commented on YARN-3411: - Hi [~vrushalic], thanks for the patch! I'm OK with the major

[jira] [Commented] (YARN-3505) Node's Log Aggregation Report with SUCCEED should not cached in RMApps

2015-04-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509330#comment-14509330 ] Junping Du commented on YARN-3505: -- Thanks for uploading a patch to fix this problem,

[jira] [Updated] (YARN-3154) Should not upload partial logs for MR jobs or other short-running' applications

2015-04-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-3154: - Release Note: Applications which made use of the LogAggregationContext in their application will

[jira] [Updated] (YARN-3363) add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container.

2015-04-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3363: Attachment: YARN-3363.001.patch add localization and container launch time to ContainerMetrics at NM to

[jira] [Commented] (YARN-3363) add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container.

2015-04-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509674#comment-14509674 ] zhihai xu commented on YARN-3363: - Hi [~adhoot], thanks for the thorough review, Your

[jira] [Commented] (YARN-3516) killing ContainerLocalizer action doesn't take effect when private localizer receives FETCH_FAILURE status.

2015-04-23 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510058#comment-14510058 ] Xuan Gong commented on YARN-3516: - +1 LGTM. Will commit killing ContainerLocalizer action

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler for inter-queue preemption

2015-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: YARN-2498.4.patch Attached ver.4, updated test to make sure ignore_partition_exclusivity

[jira] [Commented] (YARN-3516) killing ContainerLocalizer action doesn't take effect when private localizer receives FETCH_FAILURE status.

2015-04-23 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510080#comment-14510080 ] Xuan Gong commented on YARN-3516: - Committed into trunk/branch-2. Thanks, zhihai !

[jira] [Commented] (YARN-3536) ZK exception occur when updating AppAttempt status, then NPE thrown when RM do recover

2015-04-23 Thread gu-chi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510320#comment-14510320 ] gu-chi commented on YARN-3536: -- Thx, as the exception trace stack is almost, I once looked

[jira] [Commented] (YARN-3492) AM fails to come up because RM and NM can't connect to each other

2015-04-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510099#comment-14510099 ] Vinod Kumar Vavilapalli commented on YARN-3492: --- [~kasha], can you try this

[jira] [Updated] (YARN-3534) Report node resource utilization

2015-04-23 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3534: -- Attachment: YARN-3534-1.patch No unit tests yet. Report node resource utilization

[jira] [Updated] (YARN-3534) Report node resource utilization

2015-04-23 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3534: -- Attachment: YARN-3534-2.patch Merged to trunk. Report node resource utilization

[jira] [Created] (YARN-3541) Add version info on timeline service / generic history web UI and RES API

2015-04-23 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-3541: - Summary: Add version info on timeline service / generic history web UI and RES API Key: YARN-3541 URL: https://issues.apache.org/jira/browse/YARN-3541 Project: Hadoop YARN

[jira] [Commented] (YARN-3438) add a mode to replay MR job history files to the timeline service

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510142#comment-14510142 ] Hadoop QA commented on YARN-3438: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3438) add a mode to replay MR job history files to the timeline service

2015-04-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510150#comment-14510150 ] Junping Du commented on YARN-3438: -- Thanks [~sjlee0] for uploading a patch! Given 90% work

[jira] [Updated] (YARN-3541) Add version info on timeline service / generic history web UI and RES API

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3541: -- Attachment: YARN-3541.1.patch Upload a patch: 1. Include version info in /ws/v1/timeline of timeline

[jira] [Updated] (YARN-3382) Some of UserMetricsInfo metrics are incorrectly set to root queue metrics

2015-04-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3382: -- Fix Version/s: (was: 2.8.0) 2.7.1 This seems like an

[jira] [Updated] (YARN-3351) AppMaster tracking URL is broken in HA

2015-04-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3351: -- Fix Version/s: (was: 2.8.0) 2.7.1 This seems like an

[jira] [Updated] (YARN-3472) Possible leak in DelegationTokenRenewer#allTokens

2015-04-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3472: -- Target Version/s: 2.7.1 (was: 2.8.0) This seems like an important fix. I merged

[jira] [Updated] (YARN-3472) Possible leak in DelegationTokenRenewer#allTokens

2015-04-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3472: -- Target Version/s: 2.8.0 (was: 2.7.1) Fix Version/s: (was: 2.8.0)

[jira] [Commented] (YARN-3534) Report node resource utilization

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510205#comment-14510205 ] Hadoop QA commented on YARN-3534: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3390) Reuse TimelineCollectorManager for RM

2015-04-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510053#comment-14510053 ] Sangjin Lee commented on YARN-3390: --- [~zjshen], you might want to check out [~djp]'s

[jira] [Commented] (YARN-3516) killing ContainerLocalizer action doesn't take effect when private localizer receives FETCH_FAILURE status.

2015-04-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510092#comment-14510092 ] Hudson commented on YARN-3516: -- FAILURE: Integrated in Hadoop-trunk-Commit #7656 (See

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-23 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510163#comment-14510163 ] Gera Shegalov commented on YARN-2893: - Hi [~zxu], for me personally it's easier to

[jira] [Commented] (YARN-2498) Respect labels in preemption policy of capacity scheduler for inter-queue preemption

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510177#comment-14510177 ] Hadoop QA commented on YARN-2498: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Assigned] (YARN-3458) CPU resource monitoring in Windows

2015-04-23 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri reassigned YARN-3458: - Assignee: Inigo Goiri CPU resource monitoring in Windows --

[jira] [Commented] (YARN-3541) Add version info on timeline service / generic history web UI and RES API

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14510216#comment-14510216 ] Hadoop QA commented on YARN-3541: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-2408) Resource Request REST API for YARN

2015-04-23 Thread Renan DelValle (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509106#comment-14509106 ] Renan DelValle commented on YARN-2408: -- Hi Nikhil, While I would be glad to finish

[jira] [Updated] (YARN-3477) TimelineClientImpl swallows exceptions

2015-04-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-3477: - Affects Version/s: 2.6.0 Summary: TimelineClientImpl swallows exceptions (was:

[jira] [Updated] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3431: -- Attachment: YARN-3431.6.patch Sub resources of timeline entity needs to be passed to a separate

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508529#comment-14508529 ] Zhijie Shen commented on YARN-3431: --- bq. It would be a little more consistent and perform

[jira] [Commented] (YARN-3522) DistributedShell uses the wrong user to put timeline data

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508557#comment-14508557 ] Zhijie Shen commented on YARN-3522: --- I took a look at checkstyle errors and commented on

[jira] [Commented] (YARN-2408) Resource Request REST API for YARN

2015-04-23 Thread Nikhil Mulley (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508586#comment-14508586 ] Nikhil Mulley commented on YARN-2408: - Hi [~rdelvalle] There are 8 people voting for

[jira] [Resolved] (YARN-2408) Resource Request REST API for YARN

2015-04-23 Thread Renan DelValle (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renan DelValle resolved YARN-2408. -- Resolution: Done Resource Request REST API for YARN --

[jira] [Commented] (YARN-2408) Resource Request REST API for YARN

2015-04-23 Thread Adam B (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508593#comment-14508593 ] Adam B commented on YARN-2408: -- FYI, one of the original use cases (Myriad, to run YARN on

[jira] [Commented] (YARN-3405) FairScheduler's preemption cannot happen between sibling in some case

2015-04-23 Thread Peng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508536#comment-14508536 ] Peng Zhang commented on YARN-3405: -- Update patch: only preempt from children when queue is

[jira] [Resolved] (YARN-2408) Resource Request REST API for YARN

2015-04-23 Thread Renan DelValle (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renan DelValle resolved YARN-2408. -- Resolution: Won't Fix Work on this feature has been dropped by original author due to general

[jira] [Reopened] (YARN-2408) Resource Request REST API for YARN

2015-04-23 Thread Renan DelValle (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renan DelValle reopened YARN-2408: -- Resource Request REST API for YARN -- Key:

  1   2   >