[jira] [Commented] (YARN-8082) Include LocalizedResource size information in the NM download log for localization

[ https://issues.apache.org/jira/browse/YARN-8082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418060#comment-16418060 ] Jason Lowe commented on YARN-8082: -- Thanks for the patch! The line-length checkstyle issu

[jira] [Commented] (YARN-8071) Provide Spark-like API for setting Environment Variables to enable vars with commas

[ https://issues.apache.org/jira/browse/YARN-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415791#comment-16415791 ] Jason Lowe commented on YARN-8071: -- It sounds like separate JIRAs, at least for MapReduce

[jira] [Commented] (YARN-8071) Provide Spark-like API for setting Environment Variables to enable vars with commas

[ https://issues.apache.org/jira/browse/YARN-8071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16412177#comment-16412177 ] Jason Lowe commented on YARN-8071: -- Is this a YARN JIRA? I would think the changes would

[jira] [Commented] (YARN-6830) Support quoted strings for environment variables

[ https://issues.apache.org/jira/browse/YARN-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16411546#comment-16411546 ] Jason Lowe commented on YARN-6830: -- Yes, the downside with the key-prefix approach is it h

[jira] [Commented] (YARN-1151) Ability to configure auxiliary services from HDFS-based JAR files

[ https://issues.apache.org/jira/browse/YARN-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410330#comment-16410330 ] Jason Lowe commented on YARN-1151: -- +1 for Robert's comment about security. We need to be

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409856#comment-16409856 ] Jason Lowe commented on YARN-7654: -- bq. Can you share how spark does tokenizer for environ

[jira] [Updated] (YARN-8012) Support Unmanaged Container Cleanup

[ https://issues.apache.org/jira/browse/YARN-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-8012: - Target Version/s: 3.0.0, 2.7.1 (was: 2.7.1, 3.0.0) Fix Version/s: (was: 2.7.1) > Support Unmana

[jira] [Commented] (YARN-6830) Support quoted strings for environment variables

[ https://issues.apache.org/jira/browse/YARN-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409762#comment-16409762 ] Jason Lowe commented on YARN-6830: -- Sorry to show up late on this. I'm leaning towards [~

[jira] [Commented] (YARN-8012) Support Unmanaged Container Cleanup

[ https://issues.apache.org/jira/browse/YARN-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409737#comment-16409737 ] Jason Lowe commented on YARN-8012: -- {quote}Agree. The configuration is windows specific no

[jira] [Commented] (YARN-8054) Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread

[ https://issues.apache.org/jira/browse/YARN-8054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409713#comment-16409713 ] Jason Lowe commented on YARN-8054: -- Ah, sorry, I missed that branch-3.1.0 was created.  IM

[jira] [Commented] (YARN-7581) HBase filters are not constructed correctly in ATSv2

[ https://issues.apache.org/jira/browse/YARN-7581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409706#comment-16409706 ] Jason Lowe commented on YARN-7581: -- bq. I did compilation for branch-2 and committed. Look

[jira] [Updated] (YARN-7581) HBase filters are not constructed correctly in ATSv2

[ https://issues.apache.org/jira/browse/YARN-7581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7581: - Fix Version/s: (was: 2.10.0) This patch broke branch-2 compilation, so I reverted it from branch-2. Lo

[jira] [Commented] (YARN-8054) Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread

[ https://issues.apache.org/jira/browse/YARN-8054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16408663#comment-16408663 ] Jason Lowe commented on YARN-8054: -- Thanks for updating the patch! +1 lgtm. Committing t

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16408637#comment-16408637 ] Jason Lowe commented on YARN-7654: -- What is the base for this patch? It doesn't apply dir

[jira] [Commented] (YARN-8034) Clarification on preferredHost request with relaxedLocality

[ https://issues.apache.org/jira/browse/YARN-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16408190#comment-16408190 ] Jason Lowe commented on YARN-8034: -- {quote}The code you pointed out: FsAppAttempt#getLocal

[jira] [Commented] (YARN-8054) Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread

[ https://issues.apache.org/jira/browse/YARN-8054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16408153#comment-16408153 ] Jason Lowe commented on YARN-8054: -- Thanks for the patch! Do we really want to suppress t

[jira] [Commented] (YARN-8012) Support Unmanaged Container Cleanup

[ https://issues.apache.org/jira/browse/YARN-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16408148#comment-16408148 ] Jason Lowe commented on YARN-8012: -- Thanks for the document! I know very little about Win

[jira] [Commented] (YARN-7872) labeled node cannot be used to satisfy locality specified request

[ https://issues.apache.org/jira/browse/YARN-7872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16407094#comment-16407094 ] Jason Lowe commented on YARN-7872: -- [~leftnoteasy] would be better at answering this, as h

[jira] [Commented] (YARN-8012) Support Unmanaged Container Cleanup

[ https://issues.apache.org/jira/browse/YARN-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405039#comment-16405039 ] Jason Lowe commented on YARN-8012: -- Thanks for the report and patch, [~yqwang]! {quote}The

[jira] [Commented] (YARN-8027) Setting hostname of docker container breaks for --net=host in docker 1.13

[ https://issues.apache.org/jira/browse/YARN-8027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16405001#comment-16405001 ] Jason Lowe commented on YARN-8027: -- Sounds like there's a reason to set a hostname when we

[jira] [Commented] (YARN-8034) Clarification on preferredHost request with relaxedLocality

[ https://issues.apache.org/jira/browse/YARN-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16402088#comment-16402088 ] Jason Lowe commented on YARN-8034: -- {quote}I observed that the Yarn RM immediately returns

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16401973#comment-16401973 ] Jason Lowe commented on YARN-7654: -- bq. As you can see the struggle with flipping code for

[jira] [Commented] (YARN-8034) Clarification on preferredHost request with relaxedLocality

[ https://issues.apache.org/jira/browse/YARN-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16401950#comment-16401950 ] Jason Lowe commented on YARN-8034: -- If you need a specific host then set relaxLocality=fal

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16400676#comment-16400676 ] Jason Lowe commented on YARN-7654: -- Thanks for the patch! Switching the code to execv doc

[jira] [Commented] (YARN-7999) Docker launch fails when user private filecache directory is missing

[ https://issues.apache.org/jira/browse/YARN-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398840#comment-16398840 ] Jason Lowe commented on YARN-7999: -- Thanks for the commit! Since this was introduced by Y

[jira] [Commented] (YARN-8027) Setting hostname of docker container breaks for --net=host in docker 1.13

[ https://issues.apache.org/jira/browse/YARN-8027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398704#comment-16398704 ] Jason Lowe commented on YARN-8027: -- Thanks for the patch! Curious, is there any reason fo

[jira] [Commented] (YARN-7999) Docker launch fails when user private filecache directory is missing

[ https://issues.apache.org/jira/browse/YARN-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16397635#comment-16397635 ] Jason Lowe commented on YARN-7999: -- The problem is the version number. The container-exec

[jira] [Commented] (YARN-7999) Docker launch fails when user private filecache directory is missing

[ https://issues.apache.org/jira/browse/YARN-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16397592#comment-16397592 ] Jason Lowe commented on YARN-7999: -- Thanks for the logs! I don't see how this could be a

[jira] [Commented] (YARN-7999) Docker launch fails when user private filecache directory is missing

[ https://issues.apache.org/jira/browse/YARN-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16397068#comment-16397068 ] Jason Lowe commented on YARN-7999: -- The container executor should always create at least o

[jira] [Commented] (YARN-8027) Setting hostname of docker container breaks for --net=host in docker 1.13

[ https://issues.apache.org/jira/browse/YARN-8027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16396987#comment-16396987 ] Jason Lowe commented on YARN-8027: -- Overriding the hostname only makes sense if the new na

[jira] [Commented] (YARN-7999) Docker launch fails when user private filecache directory is missing

[ https://issues.apache.org/jira/browse/YARN-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391499#comment-16391499 ] Jason Lowe commented on YARN-7999: -- Thanks for trying out the patch! Can you provide more

[jira] [Commented] (YARN-8014) YARN ResourceManager Lists A NodeManager As RUNNING & SHUTDOWN Simultaneously

[ https://issues.apache.org/jira/browse/YARN-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391417#comment-16391417 ] Jason Lowe commented on YARN-8014: -- I believe this is an artifact of the NM appearing to b

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388632#comment-16388632 ] Jason Lowe commented on YARN-7677: -- Thanks for updating the patch! +1 lgtm. I'll commit

[jira] [Commented] (YARN-7999) Docker launch fails when user private filecache directory is missing

[ https://issues.apache.org/jira/browse/YARN-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388606#comment-16388606 ] Jason Lowe commented on YARN-7999: -- The unit test failure is unrelated. It passes for me

[jira] [Commented] (YARN-7999) Docker launch fails when user private filecache directory is missing

[ https://issues.apache.org/jira/browse/YARN-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388054#comment-16388054 ] Jason Lowe commented on YARN-7999: -- Thanks for the review, Shane! I updated the patch to

[jira] [Updated] (YARN-7999) Docker launch fails when user private filecache directory is missing

[ https://issues.apache.org/jira/browse/YARN-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7999: - Attachment: YARN-7999.002.patch > Docker launch fails when user private filecache directory is missing > --

[jira] [Commented] (YARN-7935) Expose container's hostname to applications running within the docker container

[ https://issues.apache.org/jira/browse/YARN-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387944#comment-16387944 ] Jason Lowe commented on YARN-7935: -- Why is this new environment variable only being set in

[jira] [Assigned] (YARN-7999) Docker launch fails when user private filecache directory is missing

[ https://issues.apache.org/jira/browse/YARN-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-7999: Assignee: Jason Lowe (was: Shane Kumpf) Target Version/s: 3.1.0 Got around to testing t

[jira] [Commented] (YARN-7999) Docker launch fails when user private filecache directory is missing

[ https://issues.apache.org/jira/browse/YARN-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16386517#comment-16386517 ] Jason Lowe commented on YARN-7999: -- I haven't had a chance to test this at all yet, but he

[jira] [Updated] (YARN-7999) Docker launch fails when user private filecache directory is missing

[ https://issues.apache.org/jira/browse/YARN-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7999: - Attachment: YARN-7999.001.patch > Docker launch fails when user private filecache directory is missing > --

[jira] [Commented] (YARN-7511) NPE in ContainerLocalizer when localization failed for running container

[ https://issues.apache.org/jira/browse/YARN-7511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383724#comment-16383724 ] Jason Lowe commented on YARN-7511: -- Thanks for the patch! +1 lgtm. Committing this. > N

[jira] [Commented] (YARN-4088) RM should be able to process heartbeats from NM concurrently

[ https://issues.apache.org/jira/browse/YARN-4088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383597#comment-16383597 ] Jason Lowe commented on YARN-4088: -- bq. if the OOB heartbeat could reduce the ability of

[jira] [Commented] (YARN-5910) Support for multi-cluster delegation tokens

[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16373672#comment-16373672 ] Jason Lowe commented on YARN-5910: -- I think the problem here is that the token renewer, wh

[jira] [Commented] (YARN-5714) ContainerExecutor does not order environment map

[ https://issues.apache.org/jira/browse/YARN-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16373644#comment-16373644 ] Jason Lowe commented on YARN-5714: -- +1 lgtm. I'll commit this tomorrow if there are no ob

[jira] [Commented] (YARN-7945) Java Doc error in UnmanagedAMPoolManager for branch-2

[ https://issues.apache.org/jira/browse/YARN-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16373053#comment-16373053 ] Jason Lowe commented on YARN-7945: -- Thanks for updating the patch! +1 lgtm. Committing t

[jira] [Commented] (YARN-7916) Remove call to docker logs on failure in container-executor

[ https://issues.apache.org/jira/browse/YARN-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16372144#comment-16372144 ] Jason Lowe commented on YARN-7916: -- Thanks for the patch! +1 lgtm as well. Committing th

[jira] [Commented] (YARN-7935) Expose container's hostname to applications running within the docker container

[ https://issues.apache.org/jira/browse/YARN-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16372117#comment-16372117 ] Jason Lowe commented on YARN-7935: -- Curious, why does Spark (or other applications) need h

[jira] [Commented] (YARN-7945) Java Doc error in UnmanagedAMPoolManager for branch-2

[ https://issues.apache.org/jira/browse/YARN-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16372082#comment-16372082 ] Jason Lowe commented on YARN-7945: -- Sure, or you can fully qualify the classname in the Ja

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369469#comment-16369469 ] Jason Lowe commented on YARN-7813: -- Thanks for updating the patch! +1 lgtm. Committing t

[jira] [Updated] (YARN-7945) Java Doc error in UnmanagedAMPoolManager for branch-2

[ https://issues.apache.org/jira/browse/YARN-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7945: - Affects Version/s: 2.9.1 Target Version/s: 2.10.0, 2.9.1 > Java Doc error in UnmanagedAMPoolManager fo

[jira] [Commented] (YARN-7945) Java Doc error in UnmanagedAMPoolManager for branch-2

[ https://issues.apache.org/jira/browse/YARN-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369352#comment-16369352 ] Jason Lowe commented on YARN-7945: -- This was broken when YARN-6128 was committed. Oddly e

[jira] [Commented] (YARN-5714) ContainerExecutor does not order environment map

[ https://issues.apache.org/jira/browse/YARN-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369200#comment-16369200 ] Jason Lowe commented on YARN-5714: -- While preserving the user's order sounds nice, I don't

[jira] [Updated] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7677: - Fix Version/s: (was: 3.1.0) I reverted this from trunk and branch-3.1. While the breakage is definitel

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365736#comment-16365736 ] Jason Lowe commented on YARN-7677: -- That makes sense.  Agreed it is probably safer to leav

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16364890#comment-16364890 ] Jason Lowe commented on YARN-7677: -- Thanks for updating the patch! Overall looks good, bu

[jira] [Assigned] (YARN-7927) TestRMWebServicesSchedulerActivities is failing

[ https://issues.apache.org/jira/browse/YARN-7927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-7927: Assignee: Eric Payne Description: YARN-7813 broke TestRMWebServicesSchedulerActivities. The

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16362921#comment-16362921 ] Jason Lowe commented on YARN-7677: -- Thanks for updating the patch! Looks good overall, ju

[jira] [Commented] (YARN-7914) Fix exit code handling for short lived Docker containers

[ https://issues.apache.org/jira/browse/YARN-7914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360938#comment-16360938 ] Jason Lowe commented on YARN-7914: -- Thanks for the report and patch, Shane! +1 lgtm. I'l

[jira] [Commented] (YARN-7917) Fix failing test TestDockerContainerRuntime#testLaunchContainerWithDockerTokens

[ https://issues.apache.org/jira/browse/YARN-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360877#comment-16360877 ] Jason Lowe commented on YARN-7917: -- Thanks for the report and patch! +1 lgtm. Committing

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16358938#comment-16358938 ] Jason Lowe commented on YARN-7813: -- Thanks for updating the patch! +1 lgtm. > Capacity

[jira] [Commented] (YARN-7908) TestSystemMetricsPublisher#testPublishContainerMetrics can fail with an NPE

[ https://issues.apache.org/jira/browse/YARN-7908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16357167#comment-16357167 ] Jason Lowe commented on YARN-7908: -- The line that corresponds with that NPE is: {code:java

[jira] [Created] (YARN-7908) TestSystemMetricsPublisher#testPublishContainerMetrics can fail with an NPE

Jason Lowe created YARN-7908: Summary: TestSystemMetricsPublisher#testPublishContainerMetrics can fail with an NPE Key: YARN-7908 URL: https://issues.apache.org/jira/browse/YARN-7908 Project: Hadoop YARN

[jira] [Commented] (YARN-7813) Capacity Scheduler Intra-queue Preemption should be configurable for each queue

[ https://issues.apache.org/jira/browse/YARN-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16355697#comment-16355697 ] Jason Lowe commented on YARN-7813: -- Thanks for the patch! It looks like this has the pote

[jira] [Comment Edited] (YARN-5714) ContainerExecutor does not order environment map

[ https://issues.apache.org/jira/browse/YARN-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350359#comment-16350359 ] Jason Lowe edited comment on YARN-5714 at 2/7/18 4:10 PM: -- On seco

[jira] [Commented] (YARN-7815) Make the YARN mounts added to Docker containers more restrictive

[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16354612#comment-16354612 ] Jason Lowe commented on YARN-7815: -- Thanks for updating the patch! +1 lgtm. I'll commit

[jira] [Updated] (YARN-7890) NPE during container relaunch

[ https://issues.apache.org/jira/browse/YARN-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7890: - Target Version/s: 3.1.0, 2.10.0, 2.9.1, 3.0.1 (was: 3.1.0, 2.9.1, 3.0.1) It typically is at the discretion

[jira] [Commented] (YARN-7815) Make the YARN mounts added to Docker containers more restrictive

[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16354171#comment-16354171 ] Jason Lowe commented on YARN-7815: -- Thanks for updating the patch! Looks good overall, ju

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353974#comment-16353974 ] Jason Lowe commented on YARN-3895: -- Thanks for the detailed writeup, Vrushali! I am a bit

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353077#comment-16353077 ] Jason Lowe commented on YARN-7849: -- Thanks for the explanation, Botong! I see now how it

[jira] [Commented] (YARN-7890) NPE during container relaunch

[ https://issues.apache.org/jira/browse/YARN-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353007#comment-16353007 ] Jason Lowe commented on YARN-7890: -- Thanks for the review, Shane! I added a token comment

[jira] [Updated] (YARN-7890) NPE during container relaunch

[ https://issues.apache.org/jira/browse/YARN-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7890: - Attachment: YARN-7890.002.patch > NPE during container relaunch > - > >

[jira] [Assigned] (YARN-7890) NPE during container relaunch

[ https://issues.apache.org/jira/browse/YARN-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-7890: Assignee: Jason Lowe Affects Version/s: 2.9.0 3.0.0-alpha1 T

[jira] [Updated] (YARN-7890) NPE during container relaunch

[ https://issues.apache.org/jira/browse/YARN-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7890: - Attachment: YARN-7890.001.patch > NPE during container relaunch > - > >

[jira] [Commented] (YARN-7890) NPE during container relaunch

[ https://issues.apache.org/jira/browse/YARN-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352503#comment-16352503 ] Jason Lowe commented on YARN-7890: -- The NPE occurs because ContainerRelaunch never initial

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16351059#comment-16351059 ] Jason Lowe commented on YARN-7879: -- bq. We are allowing file cache to be mounted in docker

[jira] [Commented] (YARN-7876) Localized jars that are expanded after localization are not fully copied

[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350832#comment-16350832 ] Jason Lowe commented on YARN-7876: -- Right, thanks for clarifying the title further. +1 lg

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350794#comment-16350794 ] Jason Lowe commented on YARN-7879: -- bq. Are we conformable in assuming all files in fileca

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350628#comment-16350628 ] Jason Lowe commented on YARN-7879: -- I also manually tested the patch on a secure cluster a

[jira] [Updated] (YARN-7879) NM user is unable to access the application filecache due to permissions

[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7879: - Attachment: YARN-7879.001.patch > NM user is unable to access the application filecache due to permissions

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350564#comment-16350564 ] Jason Lowe commented on YARN-7879: -- This was caused by YARN-2185. That change locked down

[jira] [Updated] (YARN-7876) Localized jars that are expanded during localization are not fully copied

[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7876: - Affects Version/s: 3.1.0 Target Version/s: 3.1.0 Priority: Blocker (was: Major)

[jira] [Assigned] (YARN-7879) NM user is unable to access the application filecache due to permissions

[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-7879: Assignee: Jason Lowe Affects Version/s: 3.1.0 Priority: Critical (was: Maj

[jira] [Commented] (YARN-5714) ContainerExecutor does not order environment map

[ https://issues.apache.org/jira/browse/YARN-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350359#comment-16350359 ] Jason Lowe commented on YARN-5714: -- On second thought, it's extremely unlikely that NM whi

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350353#comment-16350353 ] Jason Lowe commented on YARN-7677: -- I realize now that the theoretical example cannot work

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349437#comment-16349437 ] Jason Lowe commented on YARN-7677: -- True, but that assumes the user even knows what the pa

[jira] [Commented] (YARN-4882) Change the log level to DEBUG for recovering completed applications

[ https://issues.apache.org/jira/browse/YARN-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349432#comment-16349432 ] Jason Lowe commented on YARN-4882: -- bq. From the above code, if RM fails to recover an app

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349420#comment-16349420 ] Jason Lowe commented on YARN-7677: -- bq. the primary use case is AM-defined vars being able

[jira] [Commented] (YARN-5714) ContainerExecutor does not order environment map

[ https://issues.apache.org/jira/browse/YARN-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349312#comment-16349312 ] Jason Lowe commented on YARN-5714: -- Sorry to come to this late. We ran across an instance

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16349301#comment-16349301 ] Jason Lowe commented on YARN-7677: -- YARN-5714 is very relevant here. In the general case,

[jira] [Updated] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7677: - Fix Version/s: (was: 3.0.1) (was: 3.1.0) I reverted this from trunk and branch-3

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348841#comment-16348841 ] Jason Lowe commented on YARN-7677: -- Ultimately one way to debug this would be to compare t

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16348810#comment-16348810 ] Jason Lowe commented on YARN-7677: -- Is this with Docker containers or without? There are

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16347559#comment-16347559 ] Jason Lowe commented on YARN-7849: -- Thanks for the patch! I'm worried that this test is s

[jira] [Updated] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7677: - Summary: Docker image cannot set HADOOP_CONF_DIR (was: HADOOP_CONF_DIR should not be automatically put in

[jira] [Updated] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7849: - Summary: TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error (w

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16347030#comment-16347030 ] Jason Lowe commented on YARN-2185: -- +1 lgtm. Committing this. > Use pipes when localizin

[jira] [Commented] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345645#comment-16345645 ] Jason Lowe commented on YARN-7677: -- Thanks for the patch! +1 lgtm. I will commit this to

[jira] [Commented] (YARN-7843) Container Localizer is failing with NPE

[ https://issues.apache.org/jira/browse/YARN-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345571#comment-16345571 ] Jason Lowe commented on YARN-7843: -- The NoSuchMethodError implies some code is running wit

[jira] [Updated] (YARN-7843) Container Localizer is failing with NPE

[ https://issues.apache.org/jira/browse/YARN-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7843: - Affects Version/s: 3.1.0 Target Version/s: 3.1.0 > Container Localizer is failing with NPE > -

[jira] [Commented] (YARN-7843) Container Localizer is failing with NPE

[ https://issues.apache.org/jira/browse/YARN-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16345232#comment-16345232 ] Jason Lowe commented on YARN-7843: -- Is this against 3.1.0?  I am guessing this is the rele

<    1   2   3   4   5   6   7   8   9   10   >