[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-2185: - Fix Version/s: (was: 3.1.0) > Use pipes when localizing archives > -- >

[jira] [Reopened] (YARN-2185) Use pipes when localizing archives

2018-01-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened YARN-2185: -- My apologies.  Since this broke secure cluster setups, I reverted the change until it gets sorted out.  I ha

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization

2018-01-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344214#comment-16344214 ] Jason Lowe commented on YARN-7849: -- Looks like this started failing after YARN-7102. I th

[jira] [Created] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization

2018-01-29 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7849: Summary: TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization Key: YARN-7849 URL: https://issues.apache.org/jira/browse/YARN-7849 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344123#comment-16344123 ] Jason Lowe commented on YARN-7815: -- bq. Can we break anything if we move localized user-pr

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344067#comment-16344067 ] Jason Lowe commented on YARN-7815: -- This would break a framework where containers on the s

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344007#comment-16344007 ] Jason Lowe commented on YARN-7815: -- bq. Would it make sense to detach the appcache and mou

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16341805#comment-16341805 ] Jason Lowe commented on YARN-7815: -- I suspect we can't make the usercache readonly because

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16341471#comment-16341471 ] Jason Lowe commented on YARN-2185: -- The mvn install failure appears to be a hiccup with th

[jira] [Comment Edited] (YARN-3895) Support ACLs in ATSv2

2018-01-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16341258#comment-16341258 ] Jason Lowe edited comment on YARN-3895 at 1/26/18 4:47 PM: --- After

***UNCHECKED*** [jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2018-01-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16341258#comment-16341258 ] Jason Lowe commented on YARN-3895: -- After chatting about this with [~jeagles] offline, we

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2018-01-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16341217#comment-16341217 ] Jason Lowe commented on YARN-3895: -- bq. How many domains would there be? I would expect a

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2018-01-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16340308#comment-16340308 ] Jason Lowe commented on YARN-7102: -- I agree the unit tests failures on branch-2 and branch

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-2185: - Attachment: YARN-2185.012.patch > Use pipes when localizing archives > -- >

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16340296#comment-16340296 ] Jason Lowe commented on YARN-2185: -- Thanks for updating the patch! Looks good to me. I n

[jira] [Updated] (YARN-7728) Expose container preemptions related information in Capacity Scheduler queue metrics

2018-01-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7728: - Fix Version/s: (was: 2.8.4) I reverted this from branch-2.8 since it broke the build there: {noformat}

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2018-01-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16337903#comment-16337903 ] Jason Lowe commented on YARN-7102: -- Sorry for the delay.  The latest patch looks good to m

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16337856#comment-16337856 ] Jason Lowe commented on YARN-2185: -- Thanks for updating the patch! I think it's very clos

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2018-01-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16335849#comment-16335849 ] Jason Lowe commented on YARN-3895: -- bq. Yes, doing a lookup in two tables at read time (re

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2018-01-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16334907#comment-16334907 ] Jason Lowe commented on YARN-3895: -- {quote} So, we store these kind of doAs query related

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16334872#comment-16334872 ] Jason Lowe commented on YARN-2185: -- Thanks for updating the patch! Should a SuppressWarni

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16324545#comment-16324545 ] Jason Lowe commented on YARN-2185: -- Thanks for updating the patch! bq. I was wondering, i

[jira] [Commented] (YARN-7739) Revisit scheduler resource normalization behavior for max allocation

2018-01-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16324511#comment-16324511 ] Jason Lowe commented on YARN-7739: -- I'm OK with getting rid of implicitly shrinking contai

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2018-01-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16324140#comment-16324140 ] Jason Lowe commented on YARN-3895: -- I think Application ACLs could work fine for the strai

[jira] [Commented] (YARN-7739) Revisit scheduler resource normalization behavior for max allocation

2018-01-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16324014#comment-16324014 ] Jason Lowe commented on YARN-7739: -- I'm not a fan of silently capping the app's request.

[jira] [Commented] (YARN-6948) Invalid event: ATTEMPT_ADDED at FINAL_SAVING

2018-01-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16318725#comment-16318725 ] Jason Lowe commented on YARN-6948: -- Thanks for the patch! +1 lgtm. Committing this. >

[jira] [Created] (YARN-7721) TestContinuousScheduling fails sporadically with NPE

2018-01-09 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7721: Summary: TestContinuousScheduling fails sporadically with NPE Key: YARN-7721 URL: https://issues.apache.org/jira/browse/YARN-7721 Project: Hadoop YARN Issue Type: Bu

[jira] [Commented] (YARN-7663) RMAppImpl:Invalid event: START at KILLED

2018-01-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16318609#comment-16318609 ] Jason Lowe commented on YARN-7663: -- Thanks for updating the patch! The unit test failure

[jira] [Commented] (YARN-7663) RMAppImpl:Invalid event: START at KILLED

2018-01-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317315#comment-16317315 ] Jason Lowe commented on YARN-7663: -- Thanks for updating the patch! I thought the TODO com

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

2018-01-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317251#comment-16317251 ] Jason Lowe commented on YARN-6929: -- Sorry for the delay. Looks like the patch needs to be

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16316777#comment-16316777 ] Jason Lowe commented on YARN-2185: -- Thanks for the patch! This patch adds parallel copyin

[jira] [Commented] (YARN-7663) RMAppImpl:Invalid event: START at KILLED

2018-01-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16314020#comment-16314020 ] Jason Lowe commented on YARN-7663: -- Thanks for updating the patch! bq. The TODO already e

[jira] [Commented] (YARN-7663) RMAppImpl:Invalid event: START at KILLED

2018-01-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16311910#comment-16311910 ] Jason Lowe commented on YARN-7663: -- Thanks for updating the patch! bq. These two InvalidS

[jira] [Created] (YARN-7703) Apps killed from the NEW state are not recorded in the state store

2018-01-04 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7703: Summary: Apps killed from the NEW state are not recorded in the state store Key: YARN-7703 URL: https://issues.apache.org/jira/browse/YARN-7703 Project: Hadoop YARN

[jira] [Commented] (YARN-7678) Ability to enable logging of container memory stats

2018-01-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16311575#comment-16311575 ] Jason Lowe commented on YARN-7678: -- I filed YARN-7700 to track the TestContainerSchedulerQ

[jira] [Created] (YARN-7700) TestContainerSchedulerQueuing sporadically fails in precommit builds

2018-01-04 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7700: Summary: TestContainerSchedulerQueuing sporadically fails in precommit builds Key: YARN-7700 URL: https://issues.apache.org/jira/browse/YARN-7700 Project: Hadoop YARN

[jira] [Commented] (YARN-7663) RMAppImpl:Invalid event: START at KILLED

2018-01-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16310417#comment-16310417 ] Jason Lowe commented on YARN-7663: -- Thanks for updating the patch! The unit test passes e

[jira] [Updated] (YARN-7678) Ability to enable logging of container memory stats

2018-01-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7678: - Summary: Ability to enable logging of container memory stats (was: Logging of container memory stats is mi

[jira] [Commented] (YARN-7663) RMAppImpl:Invalid event: START at KILLED

2018-01-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16309884#comment-16309884 ] Jason Lowe commented on YARN-7663: -- Please do not remove old patches that were commented o

[jira] [Assigned] (YARN-7663) RMAppImpl:Invalid event: START at KILLED

2018-01-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-7663: Assignee: lujie Thanks for the report and the patch! Ignoring the START event seems appropriate her

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2018-01-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308446#comment-16308446 ] Jason Lowe commented on YARN-3136: -- bq. could you please tell me what is the jira about We

[jira] [Commented] (YARN-7676) Fix inconsistent priority ordering in Priority and SchedulerRequestKey

2017-12-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16299014#comment-16299014 ] Jason Lowe commented on YARN-7676: -- I'm not sure we can fix this in a backwards-compatible

[jira] [Commented] (YARN-7661) NodeManager metrics return wrong value after update node resource

2017-12-18 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16295667#comment-16295667 ] Jason Lowe commented on YARN-7661: -- Thanks for updating the patch! +1 lgtm. Committing t

[jira] [Commented] (YARN-7595) Container launching code suppresses close exceptions after writes

2017-12-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16293323#comment-16293323 ] Jason Lowe commented on YARN-7595: -- +1 for the branch-2.8 patch as well. I agree the unit

[jira] [Updated] (YARN-7629) TestContainerLaunch fails

2017-12-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7629: - Attachment: YARN-7629.001.patch Rather than trying to rework this test to fit what the debug code expects,

[jira] [Assigned] (YARN-7629) TestContainerLaunch fails

2017-12-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-7629: Assignee: Jason Lowe Target Version/s: 3.1.0, 3.0.1 > TestContainerLaunch fails > --

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-12-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292591#comment-16292591 ] Jason Lowe commented on YARN-7190: -- +1 lgtm. > Ensure only NM classpath in 2.x gets TSv2

[jira] [Updated] (YARN-7661) NodeManager metrics return wrong value after update node resource

2017-12-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7661: - Affects Version/s: 2.7.0 Target Version/s: 2.7.5, 3.1.0, 2.9.1, 3.0.1, 2.8.4 Thanks for the report and

[jira] [Resolved] (YARN-7659) NodeManager metrics return wrong value after update resource

2017-12-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved YARN-7659. -- Resolution: Duplicate > NodeManager metrics return wrong value after update resource > --

[jira] [Moved] (YARN-7663) RMAppImpl:Invalid event: START at KILLED

2017-12-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved MAPREDUCE-7024 to YARN-7663: - Affects Version/s: (was: 2.8.0) 2.8.0 Targe

[jira] [Commented] (YARN-7595) Container launching code suppresses close exceptions after writes

2017-12-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291330#comment-16291330 ] Jason Lowe commented on YARN-7595: -- Thanks for providing the branch-2 patch! +1 lgtm. It

[jira] [Commented] (YARN-7646) MR job (based on old version tarball) get failed due to incompatible resource request

2017-12-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16291086#comment-16291086 ] Jason Lowe commented on YARN-7646: -- I just re-tested running a job based on the 2.8.3 tarb

[jira] [Commented] (YARN-7646) MR job (based on old version tarball) get failed due to incompatible resource request

2017-12-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16289455#comment-16289455 ] Jason Lowe commented on YARN-7646: -- I was not able to reproduce this with a job using 2.8.

[jira] [Commented] (YARN-7595) Container launching code suppresses close exceptions after writes

2017-12-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16288348#comment-16288348 ] Jason Lowe commented on YARN-7595: -- Thanks for updating the patch! The unit test failure

[jira] [Updated] (YARN-7644) NM gets backed up deleting docker containers

2017-12-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7644: - Component/s: (was: yarn) nodemanager > NM gets backed up deleting docker containers >

[jira] [Commented] (YARN-7625) Expose NM node/containers resource utilization in JVM metrics

2017-12-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16288069#comment-16288069 ] Jason Lowe commented on YARN-7625: -- Thanks for updating the patch! +1 lgtm. Committing t

[jira] [Commented] (YARN-7576) Findbug warning for Resource exposing internal representation

2017-12-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16286131#comment-16286131 ] Jason Lowe commented on YARN-7576: -- Sorry this fell off my radar and now the patch doesn't

[jira] [Commented] (YARN-7625) Expose NM node/containers resource utilization in JVM metrics

2017-12-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16286035#comment-16286035 ] Jason Lowe commented on YARN-7625: -- Thanks for updating the patch! It looks a lot better.

[jira] [Commented] (YARN-7595) Container launching code suppresses close exceptions after writes

2017-12-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16284381#comment-16284381 ] Jason Lowe commented on YARN-7595: -- Thanks for the patch! Looks good overall, just a few

[jira] [Commented] (YARN-7629) TestContainerLaunch fails

2017-12-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16284376#comment-16284376 ] Jason Lowe commented on YARN-7629: -- This started failing after YARN-7381. I'm guessing th

[jira] [Created] (YARN-7629) TestContainerLaunch fails

2017-12-08 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7629: Summary: TestContainerLaunch fails Key: YARN-7629 URL: https://issues.apache.org/jira/browse/YARN-7629 Project: Hadoop YARN Issue Type: Bug Affects Versions: 3.0

[jira] [Commented] (YARN-7625) Expose NM node/containers resource utilization in JVM metrics

2017-12-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283556#comment-16283556 ] Jason Lowe commented on YARN-7625: -- Thanks for the patch! Get methods that have side effe

[jira] [Commented] (YARN-7455) quote_and_append_arg can overflow buffer

2017-12-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275037#comment-16275037 ] Jason Lowe commented on YARN-7455: -- Thanks for updating the patch! The test failure is un

[jira] [Commented] (YARN-7589) TestPBImplRecords fails with NullPointerException

2017-12-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275015#comment-16275015 ] Jason Lowe commented on YARN-7589: -- Thanks for finding time to look into it, Daniel! I ve

[jira] [Assigned] (YARN-7589) TestPBImplRecords fails with NullPointerException

2017-12-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-7589: Assignee: Daniel Templeton > TestPBImplRecords fails with NullPointerException > ---

[jira] [Commented] (YARN-7595) Container launching code suppresses close exceptions after writes

2017-12-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274494#comment-16274494 ] Jason Lowe commented on YARN-7595: -- This code pattern appears in the following places rela

[jira] [Created] (YARN-7595) Container launching code suppresses close exceptions after writes

2017-12-01 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7595: Summary: Container launching code suppresses close exceptions after writes Key: YARN-7595 URL: https://issues.apache.org/jira/browse/YARN-7595 Project: Hadoop YARN

[jira] [Commented] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2017-12-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274425#comment-16274425 ] Jason Lowe commented on YARN-7541: -- Despite TestPBImplRecords being in the org.apache.hado

[jira] [Commented] (YARN-7455) quote_and_append_arg can overflow buffer

2017-11-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16273582#comment-16273582 ] Jason Lowe commented on YARN-7455: -- Thanks for the patch! I'm wondering if it would be ea

[jira] [Commented] (YARN-7495) Improve robustness of the AggregatedLogDeletionService

2017-11-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16273129#comment-16273129 ] Jason Lowe commented on YARN-7495: -- Thanks for updating the patch! The unit test failure

[jira] [Updated] (YARN-7589) TestPBImplRecords fails with NullPointerException

2017-11-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7589: - Affects Version/s: 3.0.1 Target Version/s: 3.1.0, 3.0.1 (was: 3.1.0) This is now failing in branch-3.

[jira] [Commented] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2017-11-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16272973#comment-16272973 ] Jason Lowe commented on YARN-7541: -- TestPBImplRecords is failing with an NPE after this wa

[jira] [Created] (YARN-7589) TestPBImplRecords fails with NullPointerException

2017-11-30 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7589: Summary: TestPBImplRecords fails with NullPointerException Key: YARN-7589 URL: https://issues.apache.org/jira/browse/YARN-7589 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-7583) Reduce overhead of container reacquisition

2017-11-29 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7583: Summary: Reduce overhead of container reacquisition Key: YARN-7583 URL: https://issues.apache.org/jira/browse/YARN-7583 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-7576) Findbug warning for Resource exposing internal representation

2017-11-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16269436#comment-16269436 ] Jason Lowe commented on YARN-7576: -- This looks like it could be an artifact from YARN-7136

[jira] [Created] (YARN-7576) Findbug warning for Resource exposing internal representation

2017-11-28 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7576: Summary: Findbug warning for Resource exposing internal representation Key: YARN-7576 URL: https://issues.apache.org/jira/browse/YARN-7576 Project: Hadoop YARN Issu

[jira] [Commented] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16269045#comment-16269045 ] Jason Lowe commented on YARN-6647: -- +1 lgtm as well. Committing this. > RM can crash dur

[jira] [Commented] (YARN-7495) Improve robustness of the AggregatedLogDeletionService

2017-11-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16267235#comment-16267235 ] Jason Lowe commented on YARN-7495: -- Thanks for updating the patch! It would be good to ad

[jira] [Commented] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16263328#comment-16263328 ] Jason Lowe commented on YARN-6647: -- I think this change should be safe for pulling into 3.

[jira] [Commented] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16263156#comment-16263156 ] Jason Lowe commented on YARN-6647: -- Thanks for updating the patch! +1 lgtm. The test fai

[jira] [Commented] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260882#comment-16260882 ] Jason Lowe commented on YARN-6647: -- Thanks for the patch! I agree with [~rohithsharma]'s

[jira] [Commented] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259398#comment-16259398 ] Jason Lowe commented on YARN-6647: -- bq. IIUC its not the interrupted exception bubbling ca

[jira] [Commented] (YARN-7532) NM rolling restart causing application exceed max attempt

2017-11-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259360#comment-16259360 ] Jason Lowe commented on YARN-7532: -- What version of Hadoop are you using? This looks like

[jira] [Commented] (YARN-7274) Ability to disable elasticity at leaf queue level

2017-11-17 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257228#comment-16257228 ] Jason Lowe commented on YARN-7274: -- bq. Basically we want to make sure queue.absolute_capa

[jira] [Commented] (YARN-7515) HA related tests fails in trunk

2017-11-17 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257182#comment-16257182 ] Jason Lowe commented on YARN-7515: -- There aren't enough logs from the precommit build to p

[jira] [Commented] (YARN-2331) Distinguish shutdown during supervision vs. shutdown for rolling upgrade

2017-11-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253956#comment-16253956 ] Jason Lowe commented on YARN-2331: -- There is documentation of the property at https://had

[jira] [Created] (YARN-7502) Nodemanager restart docs should describe nodemanager supervised property

2017-11-15 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7502: Summary: Nodemanager restart docs should describe nodemanager supervised property Key: YARN-7502 URL: https://issues.apache.org/jira/browse/YARN-7502 Project: Hadoop YARN

[jira] [Commented] (YARN-7361) Improve the docker container runtime documentation

2017-11-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253911#comment-16253911 ] Jason Lowe commented on YARN-7361: -- Thanks for updating the patch! +1 lgtm. Committing t

[jira] [Commented] (YARN-7495) Improve robustness of the AggregatedLogDeletionService

2017-11-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253703#comment-16253703 ] Jason Lowe commented on YARN-7495: -- Thanks for the patch! Looks good overall. The readab

[jira] [Commented] (YARN-7500) LogAggregation DeletionService should consider completedTime for long running jobs

2017-11-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253603#comment-16253603 ] Jason Lowe commented on YARN-7500: -- bq. Currently LogAggregation deletes the application l

[jira] [Commented] (YARN-7361) Improve the docker container runtime documentation

2017-11-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16252168#comment-16252168 ] Jason Lowe commented on YARN-7361: -- Sorry for the late reply. The capabilities property e

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-11-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16249671#comment-16249671 ] Jason Lowe commented on YARN-7102: -- Thanks for updating the patches! Unfortunately the br

[jira] [Commented] (YARN-7080) TestSubmitApplicationWithRMHA times out

2017-11-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246628#comment-16246628 ] Jason Lowe commented on YARN-7080: -- I think this may be essentially a duplicate of YARN-66

[jira] [Updated] (YARN-7455) quote_and_append_arg can overflow buffer

2017-11-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7455: - Summary: quote_and_append_arg can overflow buffer (was: add_mounts can overrun temporary buffer) The code

[jira] [Updated] (YARN-6232) Update resource usage and preempted resource calculations to take into account all resource types

2017-11-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6232: - Fix Version/s: 3.0.0 Updating the fix version since this was committed to branch-3.0 at some point. > Upda

[jira] [Commented] (YARN-7458) TestContainerManagerSecurity is still flakey

2017-11-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16244226#comment-16244226 ] Jason Lowe commented on YARN-7458: -- Thanks for the patch! If the container never complete

[jira] [Commented] (YARN-3091) [Umbrella] Improve and fix locks of RM scheduler

2017-11-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16244191#comment-16244191 ] Jason Lowe commented on YARN-3091: -- bq. I'm looking at reverting the read/write lock chang

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-11-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16242415#comment-16242415 ] Jason Lowe commented on YARN-7197: -- bq. Docker image can also be regulated through trusted

[jira] [Created] (YARN-7455) add_mounts can overrun temporary buffer

2017-11-07 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7455: Summary: add_mounts can overrun temporary buffer Key: YARN-7455 URL: https://issues.apache.org/jira/browse/YARN-7455 Project: Hadoop YARN Issue Type: Bug C

[jira] [Assigned] (YARN-7454) RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to double lookup

2017-11-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-7454: Assignee: Jason Lowe Affects Version/s: 3.1.0 Target Version/s: 3.1.0 > RMAppAttem

<    1   2   3   4   5   6   7   8   9   10   >