[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2015-11-25 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15028104#comment-15028104 ] Bikas Saha commented on YARN-4108: -- These problems will be hard to solve without involving

[jira] [Commented] (YARN-3862) Support for fetching specific configs and metrics based on prefixes

2015-11-25 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027929#comment-15027929 ] Allen Wittenauer commented on YARN-3862: bq. do you know what's going on? Thanks.

[jira] [Commented] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

2015-11-25 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027907#comment-15027907 ] Naganarasimha G R commented on YARN-4304: - Thanks [~wangda] for sharing your though

[jira] [Commented] (YARN-3946) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in CS

2015-11-25 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027863#comment-15027863 ] Naganarasimha G R commented on YARN-3946: - Hi [~wangda], Test case failures are not

[jira] [Commented] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

2015-11-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027820#comment-15027820 ] Wangda Tan commented on YARN-4304: -- Thanks for working on this [~sunilg] and review commen

[jira] [Updated] (YARN-4184) Remove update reservation state api from state store as its not used by ReservationSystem

2015-11-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4184: - Parent Issue: YARN-2573 (was: YARN-2572) > Remove update reservation state api from state store as

[jira] [Commented] (YARN-4380) TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027668#comment-15027668 ] Hudson commented on YARN-4380: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2580 (See [https://

[jira] [Commented] (YARN-4380) TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027640#comment-15027640 ] Hudson commented on YARN-4380: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #723 (See

[jira] [Commented] (YARN-4380) TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027623#comment-15027623 ] Hudson commented on YARN-4380: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #643 (See [htt

[jira] [Commented] (YARN-3862) Support for fetching specific configs and metrics based on prefixes

2015-11-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027596#comment-15027596 ] Sangjin Lee commented on YARN-3862: --- Failed for the same reason: {noformat} Step 16 : AD

[jira] [Commented] (YARN-3862) Support for fetching specific configs and metrics based on prefixes

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027590#comment-15027590 ] Hadoop QA commented on YARN-3862: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4318) Test failure: TestAMAuthorization

2015-11-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027565#comment-15027565 ] Kuhu Shukla commented on YARN-4318: --- Thank you Steve. I have updated the fields. Yes, it

[jira] [Updated] (YARN-4318) Test failure: TestAMAuthorization

2015-11-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4318: -- Affects Version/s: 3.0.0 Environment: jenkins Component/s: test > Test failure: TestA

[jira] [Commented] (YARN-4318) Test failure: TestAMAuthorization

2015-11-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027544#comment-15027544 ] Steve Loughran commented on YARN-4318: -- where's this happening? If jenkins, put jenkin

[jira] [Commented] (YARN-4297) TestJobHistoryEventHandler and TestRMContainerAllocator failing on YARN-2928 branch

2015-11-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027424#comment-15027424 ] Sangjin Lee commented on YARN-4297: --- +1. Committing shortly. > TestJobHistoryEventHandle

[jira] [Updated] (YARN-4293) ResourceUtilization should be a part of yarn node CLI

2015-11-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4293: -- Attachment: 0001-YARN-4293.patch Attaching an initial version. - This became little trickier as {{ResourceUtiliz

[jira] [Commented] (YARN-3226) UI changes for decommissioning node

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027384#comment-15027384 ] Junping Du commented on YARN-3226: -- The patch LGTM in overall. Some NITs: {code} +defa

[jira] [Commented] (YARN-4390) Consider container request size during CS preemption

2015-11-25 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027380#comment-15027380 ] Carlo Curino commented on YARN-4390: [~bikassaha] if the containers to be preempted (re

[jira] [Commented] (YARN-3862) Support for fetching specific configs and metrics based on prefixes

2015-11-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027378#comment-15027378 ] Varun Saxena commented on YARN-3862: I am not sure why the build failed. Can it be subm

[jira] [Commented] (YARN-3862) Support for fetching specific configs and metrics based on prefixes

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027365#comment-15027365 ] Hadoop QA commented on YARN-3862: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (YARN-4395) Typo in comment in ClientServiceDelegate

2015-11-25 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-4395: -- Summary: Typo in comment in ClientServiceDelegate Key: YARN-4395 URL: https://issues.apache.org/jira/browse/YARN-4395 Project: Hadoop YARN Issue Type: Ta

[jira] [Created] (YARN-4394) ClientServiceDelegate doesn't handle retries during AM restart as intended

2015-11-25 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-4394: -- Summary: ClientServiceDelegate doesn't handle retries during AM restart as intended Key: YARN-4394 URL: https://issues.apache.org/jira/browse/YARN-4394 Project: H

[jira] [Commented] (YARN-4292) ResourceUtilization should be a part of NodeInfo REST API

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027350#comment-15027350 ] Hadoop QA commented on YARN-4292: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-3862) Support for fetching specific configs and metrics based on prefixes

2015-11-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027348#comment-15027348 ] Sangjin Lee commented on YARN-3862: --- Yes, I think that would be better. Thanks! > Suppor

[jira] [Commented] (YARN-4380) TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027339#comment-15027339 ] Hudson commented on YARN-4380: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1454 (See [https://

[jira] [Commented] (YARN-4392) ApplicationCreatedEvent event time resets after RM restart/failover

2015-11-25 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027335#comment-15027335 ] Jonathan Eagles commented on YARN-4392: --- [~xgong], jason and I will be out until mond

[jira] [Commented] (YARN-4318) Test failure: TestAMAuthorization

2015-11-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027332#comment-15027332 ] Kuhu Shukla commented on YARN-4318: --- Although locally the tests pass, I see that the fail

[jira] [Commented] (YARN-4238) createdTime and modifiedTime is not reported while publishing entities to ATSv2

2015-11-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027316#comment-15027316 ] Varun Saxena commented on YARN-4238: [~sjlee0], kindly review. Mapreduce related test f

[jira] [Commented] (YARN-4297) TestJobHistoryEventHandler and TestRMContainerAllocator failing on YARN-2928 branch

2015-11-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027296#comment-15027296 ] Varun Saxena commented on YARN-4297: [~sjlee0], kindly review. > TestJobHistoryEventHa

[jira] [Commented] (YARN-4380) TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027275#comment-15027275 ] Hudson commented on YARN-4380: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #733 (See [htt

[jira] [Commented] (YARN-4380) TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027243#comment-15027243 ] Hudson commented on YARN-4380: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2664 (See [htt

[jira] [Updated] (YARN-3862) Support for fetching specific configs and metrics based on prefixes

2015-11-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3862: --- Attachment: YARN-3862-feature-YARN-2928.04.patch > Support for fetching specific configs and metrics ba

[jira] [Commented] (YARN-3769) Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler

2015-11-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027198#comment-15027198 ] Sangjin Lee commented on YARN-3769: --- Could you check if the 2.7 commit applies cleanly to

[jira] [Commented] (YARN-4348) ZKRMStateStore.syncInternal should wait for zkResyncWaitTime instead of zkSessionTimeout

2015-11-25 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027145#comment-15027145 ] Tsuyoshi Ozawa commented on YARN-4348: -- Kicking Jenkins again. > ZKRMStateStore.syncI

[jira] [Commented] (YARN-4393) TestResourceLocalizationService#testFailedDirsResourceRelease fails intermittently

2015-11-25 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027113#comment-15027113 ] Tsuyoshi Ozawa commented on YARN-4393: -- [~varun_saxena], before committing, I found th

[jira] [Commented] (YARN-4393) TestResourceLocalizationService#testFailedDirsResourceRelease fails intermittently

2015-11-25 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027096#comment-15027096 ] Tsuyoshi Ozawa commented on YARN-4393: -- +1, checking this in. > TestResourceLocalizat

[jira] [Updated] (YARN-4380) TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently

2015-11-25 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated YARN-4380: - Hadoop Flags: Reviewed > TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fa

[jira] [Commented] (YARN-3226) UI changes for decommissioning node

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027088#comment-15027088 ] Hadoop QA commented on YARN-3226: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Reopened] (YARN-4393) TestResourceLocalizationService#testFailedDirsResourceRelease fails intermittently

2015-11-25 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa reopened YARN-4393: -- oops, commentted on wrong jira. Reopening. > TestResourceLocalizationService#testFailedDirsResourceR

[jira] [Commented] (YARN-4380) TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027045#comment-15027045 ] Hudson commented on YARN-4380: -- FAILURE: Integrated in Hadoop-trunk-Commit #8887 (See [https:

[jira] [Commented] (YARN-3849) Too much of preemption activity causing continuos killing of containers across queues

2015-11-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027026#comment-15027026 ] Sunil G commented on YARN-3849: --- Yes, I think so. This will be a good addition in 2.6 line, I

[jira] [Commented] (YARN-4390) Consider container request size during CS preemption

2015-11-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027020#comment-15027020 ] Eric Payne commented on YARN-4390: -- [~bikassaha], thank you for your comments. {quote} How

[jira] [Commented] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

2015-11-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027016#comment-15027016 ] Sunil G commented on YARN-4386: --- {{getRMNodes}} will have only Active/Decommissioning nodes.

[jira] [Commented] (YARN-3769) Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler

2015-11-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027011#comment-15027011 ] Eric Payne commented on YARN-3769: -- bq. should this be backported to 2.6.x? [~sjlee0], I w

[jira] [Commented] (YARN-4371) "yarn application -kill" should take multiple application ids

2015-11-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027005#comment-15027005 ] Sunil G commented on YARN-4371: --- Test case failures are not related to this patch, and it hap

[jira] [Commented] (YARN-4380) TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently

2015-11-25 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027004#comment-15027004 ] Tsuyoshi Ozawa commented on YARN-4380: -- +1, checking this in. > TestResourceLocalizat

[jira] [Updated] (YARN-4292) ResourceUtilization should be a part of NodeInfo REST API

2015-11-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4292: -- Attachment: 0004-YARN-4292.patch As YARN-3980 is in, making necessary changes and updating a new version of patc

[jira] [Updated] (YARN-4318) Test failure: TestAMAuthorization

2015-11-25 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated YARN-4318: - Assignee: Kuhu Shukla > Test failure: TestAMAuthorization > - > >

[jira] [Commented] (YARN-4318) Test failure: TestAMAuthorization

2015-11-25 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026936#comment-15026936 ] Tsuyoshi Ozawa commented on YARN-4318: -- [~kshukla] please go ahead :-) > Test failure

[jira] [Commented] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

2015-11-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026926#comment-15026926 ] Kuhu Shukla commented on YARN-4386: --- [~djp], without the patch, the decommissioned node i

[jira] [Commented] (YARN-4371) "yarn application -kill" should take multiple application ids

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026923#comment-15026923 ] Hadoop QA commented on YARN-4371: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4389) "yarn.am.blacklisting.enabled" and "yarn.am.blacklisting.disable-failure-threshold" should be app specific rather than a setting for whole YARN cluster

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026917#comment-15026917 ] Hadoop QA commented on YARN-4389: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

2015-11-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026916#comment-15026916 ] Kuhu Shukla commented on YARN-4386: --- Sure that would help. I will update with revised pat

[jira] [Commented] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026913#comment-15026913 ] Junping Du commented on YARN-4386: -- Thanks [~kshukla] for the patch. I agree these test fa

[jira] [Commented] (YARN-4318) Test failure: TestAMAuthorization

2015-11-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026895#comment-15026895 ] Kuhu Shukla commented on YARN-4318: --- [~ozawa], are you looking at this test failure? I ca

[jira] [Commented] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

2015-11-25 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026890#comment-15026890 ] Kuhu Shukla commented on YARN-4386: --- Thank you [~djp] for your comments. TestClientRMTok

[jira] [Commented] (YARN-3224) Notify AM with containers (on decommissioning node) could be preempted after timeout.

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026873#comment-15026873 ] Hadoop QA commented on YARN-3224: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-556) [Umbrella] RM Restart phase 2 - Work preserving restart

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-556: Component/s: rolling upgrade graceful > [Umbrella] RM Restart phase 2 - Work preserving resta

[jira] [Updated] (YARN-1197) Support changing resources of an allocated container

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1197: - Component/s: graceful > Support changing resources of an allocated container >

[jira] [Updated] (YARN-4377) Confusing logs when killing container process

2015-11-25 Thread Jaromir Vanek (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaromir Vanek updated YARN-4377: Environment: Debian 7 (was: Debian linux) Priority: Minor (was: Critical) Description: D

[jira] [Updated] (YARN-666) [Umbrella] Support rolling upgrades in YARN

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-666: Component/s: rolling upgrade graceful > [Umbrella] Support rolling upgrades in YARN > ---

[jira] [Updated] (YARN-1336) [Umbrella] Work-preserving nodemanager restart

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1336: - Component/s: rolling upgrade graceful > [Umbrella] Work-preserving nodemanager restart > -

[jira] [Updated] (YARN-3226) UI changes for decommissioning node

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3226: - Component/s: graceful > UI changes for decommissioning node > --- > >

[jira] [Updated] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3225: - Component/s: graceful > New parameter or CLI for decommissioning node gracefully in RMAdmin CLI > -

[jira] [Updated] (YARN-3223) Resource update during NM graceful decommission

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3223: - Component/s: graceful > Resource update during NM graceful decommission > -

[jira] [Updated] (YARN-3224) Notify AM with containers (on decommissioning node) could be preempted after timeout.

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3224: - Component/s: graceful > Notify AM with containers (on decommissioning node) could be preempted after > tim

[jira] [Updated] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3212: - Component/s: graceful > RMNode State Transition Update with DECOMMISSIONING state > ---

[jira] [Updated] (YARN-1394) RM to inform AMs when a container completed due to NM going offline -planned or unplanned

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1394: - Component/s: graceful > RM to inform AMs when a container completed due to NM going offline -planned > or

[jira] [Updated] (YARN-4384) updateNodeResource CLI should not accept negative values for resource

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4384: - Component/s: graceful > updateNodeResource CLI should not accept negative values for resource > ---

[jira] [Updated] (YARN-2489) ResouceOption's overcommitTimeout should be respected during resource update on NM

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2489: - Component/s: graceful > ResouceOption's overcommitTimeout should be respected during resource update > on

[jira] [Updated] (YARN-1508) Rename ResourceOption and document resource over-commitment cases

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1508: - Component/s: graceful > Rename ResourceOption and document resource over-commitment cases > ---

[jira] [Updated] (YARN-4345) yarn rmadmin -updateNodeResource doesn't work

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4345: - Component/s: graceful > yarn rmadmin -updateNodeResource doesn't work > ---

[jira] [Updated] (YARN-1949) Add admin ACL check to AdminService#updateNodeResource()

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1949: - Component/s: graceful > Add admin ACL check to AdminService#updateNodeResource() >

[jira] [Updated] (YARN-4160) Dynamic NM Resources Configuration file should be simplified.

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4160: - Component/s: graceful > Dynamic NM Resources Configuration file should be simplified. > ---

[jira] [Updated] (YARN-1506) Replace set resource change on RMNode/SchedulerNode directly with event notification.

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1506: - Component/s: graceful > Replace set resource change on RMNode/SchedulerNode directly with event > notifica

[jira] [Updated] (YARN-997) JMX support for node resource configuration

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-997: Component/s: graceful > JMX support for node resource configuration >

[jira] [Updated] (YARN-998) Persistent resource change during NM/RM restart

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-998: Component/s: graceful > Persistent resource change during NM/RM restart >

[jira] [Updated] (YARN-1000) Dynamic resource configuration feature can be configured to enable or disable and persistent on setting or not

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1000: - Component/s: graceful > Dynamic resource configuration feature can be configured to enable or disable > an

[jira] [Updated] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-999: Component/s: graceful > In case of long running tasks, reduce node resource should balloon out > resource qui

[jira] [Updated] (YARN-313) Add Admin API for supporting node resource configuration in command line

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-313: Component/s: graceful > Add Admin API for supporting node resource configuration in command line > ---

[jira] [Updated] (YARN-312) Add updateNodeResource in ResourceManagerAdministrationProtocol

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-312: Component/s: graceful > Add updateNodeResource in ResourceManagerAdministrationProtocol >

[jira] [Updated] (YARN-996) REST API support for node resource configuration

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-996: Component/s: graceful > REST API support for node resource configuration > ---

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core scheduler changes

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Component/s: graceful > Dynamic node resource configuration: core scheduler changes >

[jira] [Updated] (YARN-914) (Umbrella) Support graceful decommission of nodemanager

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-914: Component/s: graceful > (Umbrella) Support graceful decommission of nodemanager >

[jira] [Updated] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4386: - Component/s: graceful > refreshNodesGracefully() looks at active RMNode list for recommissioning > decommi

[jira] [Updated] (YARN-291) [Umbrella] Dynamic resource configuration

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-291: Component/s: graceful > [Umbrella] Dynamic resource configuration > -

[jira] [Updated] (YARN-3226) UI changes for decommissioning node

2015-11-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3226: -- Attachment: 0003-YARN-3226.patch Attaching a new patch to address test failures and relevant checkstyles warning

[jira] [Commented] (YARN-4386) refreshNodesGracefully() looks at active RMNode list for recommissioning decommissioned nodes

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026805#comment-15026805 ] Junping Du commented on YARN-4386: -- Thanks [~kshukla] to report this issue and [~sunilg] f

[jira] [Updated] (YARN-4371) "yarn application -kill" should take multiple application ids

2015-11-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4371: -- Attachment: 0002-YARN-4371.patch Hi [~ozawa] Attaching an updated patch as per latest comment. As we call kill ap

[jira] [Commented] (YARN-4384) updateNodeResource CLI should not accept negative values for resource

2015-11-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026736#comment-15026736 ] Junping Du commented on YARN-4384: -- Thanks [~leftnoteasy] for review and commit! > update

[jira] [Commented] (YARN-3226) UI changes for decommissioning node

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026681#comment-15026681 ] Hadoop QA commented on YARN-3226: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4389) "yarn.am.blacklisting.enabled" and "yarn.am.blacklisting.disable-failure-threshold" should be app specific rather than a setting for whole YARN cluster

2015-11-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4389: -- Attachment: 0001-YARN-4389.patch Hi [~djp] Attaching an initial version of patch. Kindly help to check the same.

[jira] [Commented] (YARN-3862) Support for fetching specific configs and metrics based on prefixes

2015-11-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026505#comment-15026505 ] Varun Saxena commented on YARN-3862: I think passing columnprefix would be better as we

[jira] [Updated] (YARN-3226) UI changes for decommissioning node

2015-11-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3226: -- Attachment: 0002-YARN-3226.patch Thank you [~djp] for the comments. Updating a new patch and also attached new U

[jira] [Commented] (YARN-2882) Introducing container types

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026488#comment-15026488 ] Hadoop QA commented on YARN-2882: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-3226) UI changes for decommissioning node

2015-11-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3226: -- Attachment: ClusterMetricsOnNodes_UI.png > UI changes for decommissioning node >

[jira] [Updated] (YARN-3226) UI changes for decommissioning node

2015-11-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3226: -- Attachment: (was: Decommissioning_MetricsPge.png) > UI changes for decommissioning node > ---

[jira] [Commented] (YARN-3862) Support for fetching specific configs and metrics based on prefixes

2015-11-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026481#comment-15026481 ] Varun Saxena commented on YARN-3862: [~sjlee0] Looking at the code again, I am actually

[jira] [Commented] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026402#comment-15026402 ] Hadoop QA commented on YARN-4304: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4393) TestResourceLocalizationService#testFailedDirsResourceRelease fails intermittently

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15026391#comment-15026391 ] Hadoop QA commented on YARN-4393: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

  1   2   >