[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-11-15 Thread Shane Kumpf (Jira)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16975326#comment-16975326 ] Shane Kumpf commented on YARN-9562: --- I retested without the private tmp mount and moving

[jira] [Commented] (YARN-9561) Add C changes for the new RuncContainerRuntime

2019-11-15 Thread Shane Kumpf (Jira)
[ https://issues.apache.org/jira/browse/YARN-9561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16975061#comment-16975061 ] Shane Kumpf commented on YARN-9561: --- I retested without the private tmp mount and moving

[jira] [Commented] (YARN-9959) Work around hard-coded tmp and /var/tmp bind-mounts in the container's working directory

2019-11-15 Thread Shane Kumpf (Jira)
[ https://issues.apache.org/jira/browse/YARN-9959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16975058#comment-16975058 ] Shane Kumpf commented on YARN-9959: --- Sounds like a reasonable approach to me. Thanks! >

[jira] [Comment Edited] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-11-13 Thread Shane Kumpf (Jira)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973463#comment-16973463 ] Shane Kumpf edited comment on YARN-9562 at 11/13/19 3:55 PM: -

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-11-13 Thread Shane Kumpf (Jira)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973463#comment-16973463 ] Shane Kumpf commented on YARN-9562: --- Hey Eric, sorry for the delay. Just a note that my

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-11-10 Thread Shane Kumpf (Jira)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971141#comment-16971141 ] Shane Kumpf commented on YARN-9562: --- Thanks for the new patches, [~ebadger]! I was able

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-11-07 Thread Shane Kumpf (Jira)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969572#comment-16969572 ] Shane Kumpf commented on YARN-9562: --- Thanks again, Eric! I'll give the latest patches a

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-11-06 Thread Shane Kumpf (Jira)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968539#comment-16968539 ] Shane Kumpf commented on YARN-9562: --- bq. So you're setting linux-container-executor.nons

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-11-05 Thread Shane Kumpf (Jira)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16967937#comment-16967937 ] Shane Kumpf commented on YARN-9562: --- Hey [~ebadger]. Thanks for your (and everyone elses

[jira] [Comment Edited] (YARN-9860) Enable service mode for Docker containers on YARN

2019-10-08 Thread Shane Kumpf (Jira)
[ https://issues.apache.org/jira/browse/YARN-9860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946765#comment-16946765 ] Shane Kumpf edited comment on YARN-9860 at 10/8/19 11:51 AM: -

[jira] [Commented] (YARN-9860) Enable service mode for Docker containers on YARN

2019-10-08 Thread Shane Kumpf (Jira)
[ https://issues.apache.org/jira/browse/YARN-9860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946765#comment-16946765 ] Shane Kumpf commented on YARN-9860: --- {quote}Have changed the Keytab file visibility to P

[jira] [Commented] (YARN-9860) Enable service mode for Docker containers on YARN

2019-10-02 Thread Shane Kumpf (Jira)
[ https://issues.apache.org/jira/browse/YARN-9860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942957#comment-16942957 ] Shane Kumpf commented on YARN-9860: --- {quote}It looks like we are reverting to our old ha

[jira] [Commented] (YARN-9860) Enable service mode for Docker containers on YARN

2019-10-02 Thread Shane Kumpf (Jira)
[ https://issues.apache.org/jira/browse/YARN-9860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942699#comment-16942699 ] Shane Kumpf commented on YARN-9860: --- {quote}Can you give more clear definition of servic

[jira] [Commented] (YARN-8045) Reduce log output from container status calls

2019-08-07 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16902067#comment-16902067 ] Shane Kumpf commented on YARN-8045: --- +1 on the 2.8 patch. Feel free to go ahead with com

[jira] [Commented] (YARN-8045) Reduce log output from container status calls

2019-07-25 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893070#comment-16893070 ] Shane Kumpf commented on YARN-8045: --- No concerns from me. The fix should not break exist

[jira] [Commented] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-08 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16880265#comment-16880265 ] Shane Kumpf commented on YARN-9660: --- Thanks for the improvements [~pbacsko]! lgtm +1 >

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875089#comment-16875089 ] Shane Kumpf commented on YARN-9560: --- Thanks for the patch and explanation, [~ebadger]. I

[jira] [Commented] (YARN-9230) Write a go hdfs driver for Docker Registry

2019-01-30 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16756164#comment-16756164 ] Shane Kumpf commented on YARN-9230: --- Thanks for taking another look at the library, [~ey

[jira] [Commented] (YARN-9074) Docker container rm command should be executed after stop

2019-01-23 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16749972#comment-16749972 ] Shane Kumpf commented on YARN-9074: --- [~uranus] To add to what [~csingh] noted, the check

[jira] [Commented] (YARN-9074) Docker container rm command should be executed after stop

2019-01-12 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16741292#comment-16741292 ] Shane Kumpf commented on YARN-9074: --- lgtm +1 > Docker container rm command should be ex

[jira] [Commented] (YARN-9074) Docker container rm command should be executed after stop

2018-12-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16707375#comment-16707375 ] Shane Kumpf commented on YARN-9074: --- Thanks for the input, [~uranus]. {quote}I think it

[jira] [Commented] (YARN-9074) Docker container rm command should be executed after stop

2018-11-30 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16705036#comment-16705036 ] Shane Kumpf commented on YARN-9074: --- {quote}In my opinion, if we want to debug, we can j

[jira] [Commented] (YARN-9074) Docker container rm command should be executed after stop

2018-11-30 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16704968#comment-16704968 ] Shane Kumpf commented on YARN-9074: --- [~ebadger] is correct. To allow for debugging, YARN

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-15 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16688056#comment-16688056 ] Shane Kumpf commented on YARN-5168: --- I believe there are two options, and we may want to

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685724#comment-16685724 ] Shane Kumpf commented on YARN-5168: --- Great, thanks for validating, that is inline. +1 fr

[jira] [Comment Edited] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685660#comment-16685660 ] Shane Kumpf edited comment on YARN-5168 at 11/13/18 7:46 PM: -

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685660#comment-16685660 ] Shane Kumpf commented on YARN-5168: --- I believe supporting -P will lead to port conflicts

[jira] [Updated] (YARN-6729) Clarify documentation on how to enable cgroup support

2018-10-30 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-6729: -- Summary: Clarify documentation on how to enable cgroup support (was: NM percentage-physical-cpu-limit s

[jira] [Commented] (YARN-6729) NM percentage-physical-cpu-limit should be always 100 if DefaultLCEResourcesHandler is used

2018-10-30 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16668663#comment-16668663 ] Shane Kumpf commented on YARN-6729: --- Thanks, [~tangzhankun]! I'm good with that approach

[jira] [Comment Edited] (YARN-6729) NM percentage-physical-cpu-limit should be always 100 if DefaultLCEResourcesHandler is used

2018-10-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16667780#comment-16667780 ] Shane Kumpf edited comment on YARN-6729 at 10/29/18 9:34 PM: -

[jira] [Commented] (YARN-6729) NM percentage-physical-cpu-limit should be always 100 if DefaultLCEResourcesHandler is used

2018-10-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16667780#comment-16667780 ] Shane Kumpf commented on YARN-6729: --- Thanks for the patch, [~tangzhankun]! The update lo

[jira] [Commented] (YARN-8924) Refine the document or code related to legacy CPU isolation/enforcement

2018-10-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16667223#comment-16667223 ] Shane Kumpf commented on YARN-8924: --- Sorry for the delay. As mentioned, {{LCEResourcesHa

[jira] [Commented] (YARN-8785) Improve the error message when a bind mount is not whitelisted

2018-10-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16635477#comment-16635477 ] Shane Kumpf commented on YARN-8785: --- Thanks for the contribution [~simonprewo] and thank

[jira] [Updated] (YARN-8785) Improve the error message when a bind mount is not whitelisted

2018-10-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8785: -- Summary: Improve the error message when a bind mount is not whitelisted (was: Error Message "Invalid do

[jira] [Commented] (YARN-8623) Update Docker examples to use image which exists

2018-09-25 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16627274#comment-16627274 ] Shane Kumpf commented on YARN-8623: --- Thanks [~ccondit-target] for the contribution and t

[jira] [Commented] (YARN-8623) Update Docker examples to use image which exists

2018-09-25 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16627270#comment-16627270 ] Shane Kumpf commented on YARN-8623: --- +1 thanks for the patch, [~ccondit-target]! So that

[jira] [Commented] (YARN-8785) Error Message "Invalid docker rw mount" not helpful

2018-09-25 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16627256#comment-16627256 ] Shane Kumpf commented on YARN-8785: --- I'll note that we will also want a patch for trunk,

[jira] [Commented] (YARN-8785) Error Message "Invalid docker rw mount" not helpful

2018-09-25 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16627254#comment-16627254 ] Shane Kumpf commented on YARN-8785: --- [~simonprewo] - to specify a branch, rename your pa

[jira] [Commented] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

2018-09-20 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622503#comment-16622503 ] Shane Kumpf commented on YARN-8805: --- Thanks, [~Zian Chen]. Please feel free to take this

[jira] [Created] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

2018-09-20 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8805: - Summary: Automatically convert the launch command to the exec form when using entrypoint support Key: YARN-8805 URL: https://issues.apache.org/jira/browse/YARN-8805 Project

[jira] [Commented] (YARN-8791) When STOPSIGNAL is not present then docker inspect returns an extra line feed

2018-09-19 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620748#comment-16620748 ] Shane Kumpf commented on YARN-8791: --- Thanks for the patch, [~csingh]! I have confirmed t

[jira] [Updated] (YARN-8783) Improve the documentation for the docker.trusted.registries configuration

2018-09-18 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8783: -- Summary: Improve the documentation for the docker.trusted.registries configuration (was: Property docke

[jira] [Commented] (YARN-8623) Update Docker examples to use image which exists

2018-09-17 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16618172#comment-16618172 ] Shane Kumpf commented on YARN-8623: --- The direction I was proposing for the default MR pi

[jira] [Updated] (YARN-8783) Property docker.trusted.registries does not work when using a list

2018-09-17 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8783: -- Labels: Docker container-executor docker (was: container-executor docker) > Property docker.trusted.reg

[jira] [Updated] (YARN-8783) Property docker.trusted.registries does not work when using a list

2018-09-17 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8783: -- Issue Type: Sub-task (was: Bug) Parent: YARN-8472 > Property docker.trusted.registries does not

[jira] [Updated] (YARN-8785) Error Message "Invalid docker rw mount" not helpful

2018-09-17 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8785: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-8472 > Error Message "Invalid docker rw mo

[jira] [Updated] (YARN-8785) Error Message "Invalid docker rw mount" not helpful

2018-09-17 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8785: -- Labels: Docker (was: ) > Error Message "Invalid docker rw mount" not helpful >

[jira] [Moved] (YARN-8785) Error Message "Invalid docker rw mount" not helpful

2018-09-17 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf moved HADOOP-15734 to YARN-8785: Affects Version/s: (was: 3.1.1) (was: 2.9.1)

[jira] [Commented] (YARN-8783) Property docker.trusted.registries does not work when using a list

2018-09-17 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16617933#comment-16617933 ] Shane Kumpf commented on YARN-8783: --- [~simonprewo] - one trick here is that there is an

[jira] [Commented] (YARN-8045) Reduce log output from container status calls

2018-09-14 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16615073#comment-16615073 ] Shane Kumpf commented on YARN-8045: --- Thanks again for the contribution, [~ccondit-target

[jira] [Commented] (YARN-8748) Javadoc warnings within the nodemanager package

2018-09-14 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16615055#comment-16615055 ] Shane Kumpf commented on YARN-8748: --- Thanks again for the contribution, [~ccondit-target

[jira] [Commented] (YARN-8045) Reduce log output from container status calls

2018-09-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16613969#comment-16613969 ] Shane Kumpf commented on YARN-8045: --- Thanks for the patch, [~ccondit-target]. This is mu

[jira] [Commented] (YARN-8748) Javadoc warnings within the nodemanager package

2018-09-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16613661#comment-16613661 ] Shane Kumpf commented on YARN-8748: --- Thanks for the contribution, [~ccondit-target]. It'

[jira] [Commented] (YARN-8768) Javadoc error in node attributes

2018-09-12 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612746#comment-16612746 ] Shane Kumpf commented on YARN-8768: --- Thanks to [~sunilg] for the contribution and [~rohi

[jira] [Commented] (YARN-8045) Reduce log output from container status calls

2018-09-06 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606463#comment-16606463 ] Shane Kumpf commented on YARN-8045: --- Good call, that sounds good to me. > Reduce log ou

[jira] [Commented] (YARN-8045) Reduce log output from container status calls

2018-09-06 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606394#comment-16606394 ] Shane Kumpf commented on YARN-8045: --- Thanks for the proposal [~ccondit-target]. Moving t

[jira] [Commented] (YARN-8751) Container-executor permission check errors cause the NM to be marked unhealthy

2018-09-06 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606189#comment-16606189 ] Shane Kumpf commented on YARN-8751: --- Thanks for the feedback and suggestions everyone. I

[jira] [Updated] (YARN-8751) Container-executor permission check errors cause the NM to be marked unhealthy

2018-09-06 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8751: -- Description: {{ContainerLaunch}} (and {{ContainerRelaunch}}) contains logic to mark a NodeManager as UN

[jira] [Created] (YARN-8751) Container-executor permission check errors cause the NM to be marked unhealthy

2018-09-06 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8751: - Summary: Container-executor permission check errors cause the NM to be marked unhealthy Key: YARN-8751 URL: https://issues.apache.org/jira/browse/YARN-8751 Project: Hadoop

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-09-05 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16604384#comment-16604384 ] Shane Kumpf commented on YARN-8638: --- I opened HADOOP-15721 and YARN-8748 to discuss disa

[jira] [Created] (YARN-8748) Javadoc warnings within the nodemanager package

2018-09-05 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8748: - Summary: Javadoc warnings within the nodemanager package Key: YARN-8748 URL: https://issues.apache.org/jira/browse/YARN-8748 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-09-05 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16604366#comment-16604366 ] Shane Kumpf commented on YARN-8638: --- Thanks for the contribution, [~ccondit-target] and

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-09-01 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16599643#comment-16599643 ] Shane Kumpf commented on YARN-8638: --- Thanks for the patch [~ccondit-target]! I have been

[jira] [Commented] (YARN-8642) Add support for tmpfs mounts with the Docker runtime

2018-08-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16596307#comment-16596307 ] Shane Kumpf commented on YARN-8642: --- Thanks to [~ccondit-target] for the contribution an

[jira] [Commented] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16595562#comment-16595562 ] Shane Kumpf commented on YARN-8706: --- Seems like a reasonable solution to me. {{docker st

[jira] [Commented] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16595507#comment-16595507 ] Shane Kumpf commented on YARN-8706: --- Thanks for reporting this, [~csingh]. I know severa

[jira] [Assigned] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf reassigned YARN-8706: - Assignee: Shane Kumpf (was: Chandni Singh) > DelayedProcessKiller is executed for Docker contain

[jira] [Assigned] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf reassigned YARN-8706: - Assignee: Chandni Singh (was: Shane Kumpf) > DelayedProcessKiller is executed for Docker contain

[jira] [Commented] (YARN-8623) Update Docker examples to use image which exists

2018-08-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16595488#comment-16595488 ] Shane Kumpf commented on YARN-8623: --- Thanks [~elek]. Craig and I had a quick offline cha

[jira] [Commented] (YARN-8642) Add support for tmpfs mounts with the Docker runtime

2018-08-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16595446#comment-16595446 ] Shane Kumpf commented on YARN-8642: --- Thanks for the patch, [~ccondit-target]! With this

[jira] [Commented] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590633#comment-16590633 ] Shane Kumpf commented on YARN-8704: --- [~cheersyang] - Thanks for reporting this. Can you

[jira] [Reopened] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-23 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf reopened YARN-8675: --- > Setting hostname of docker container breaks with "host" networking mode for > Apps which do not run as

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-23 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590143#comment-16590143 ] Shane Kumpf commented on YARN-8675: --- Looking back over the history here, I think we made

[jira] [Commented] (YARN-3611) Support Docker Containers In LinuxContainerExecutor

2018-08-20 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586630#comment-16586630 ] Shane Kumpf commented on YARN-3611: --- [~zhouyunfan] - thank you for your interest! Please

[jira] [Comment Edited] (YARN-8623) Update Docker examples to use image which exists

2018-08-20 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586592#comment-16586592 ] Shane Kumpf edited comment on YARN-8623 at 8/20/18 10:34 PM: -

[jira] [Commented] (YARN-8623) Update Docker examples to use image which exists

2018-08-20 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586601#comment-16586601 ] Shane Kumpf commented on YARN-8623: --- I was able to run the below MR pi job with the modi

[jira] [Commented] (YARN-8623) Update Docker examples to use image which exists

2018-08-20 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586592#comment-16586592 ] Shane Kumpf commented on YARN-8623: --- [~elek] - thanks, those details are helpful. It doe

[jira] [Commented] (YARN-8520) Document best practice for user management

2018-08-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576832#comment-16576832 ] Shane Kumpf commented on YARN-8520: --- Thanks for the contribution, [~eyang]! I committed

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-08-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576681#comment-16576681 ] Shane Kumpf commented on YARN-8569: --- Thanks for filing this [~eyang]. I have a use case

[jira] [Comment Edited] (YARN-8623) Update Docker examples to use image which exists

2018-08-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576655#comment-16576655 ] Shane Kumpf edited comment on YARN-8623 at 8/10/18 6:07 PM: [~

[jira] [Commented] (YARN-8623) Update Docker examples to use image which exists

2018-08-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576655#comment-16576655 ] Shane Kumpf commented on YARN-8623: --- [~ccondit-target] - thanks for looking into this. I

[jira] [Commented] (YARN-8520) Document best practice for user management

2018-08-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576597#comment-16576597 ] Shane Kumpf commented on YARN-8520: --- Thanks for the updated patch, [~eyang]! +1 on the l

[jira] [Created] (YARN-8642) Add support for tmpfs mounts with the Docker runtime

2018-08-09 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8642: - Summary: Add support for tmpfs mounts with the Docker runtime Key: YARN-8642 URL: https://issues.apache.org/jira/browse/YARN-8642 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-8287) Update documentation and yarn-default related to the Docker runtime

2018-08-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8287: -- Target Version/s: 3.2.0, 3.1.2 (was: 3.2.0) > Update documentation and yarn-default related to the Dock

[jira] [Updated] (YARN-8287) Update documentation and yarn-default related to the Docker runtime

2018-08-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8287: -- Fix Version/s: 3.1.2 3.2.0 > Update documentation and yarn-default related to the Doc

[jira] [Commented] (YARN-8287) Update documentation and yarn-default related to the Docker runtime

2018-08-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16568952#comment-16568952 ] Shane Kumpf commented on YARN-8287: --- Thanks for the contribution [~ccondit-target]! I co

[jira] [Commented] (YARN-8520) Document best practice for user management

2018-08-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16568683#comment-16568683 ] Shane Kumpf commented on YARN-8520: --- Thanks for the patch [~eyang]! Sorry for the delaye

[jira] [Commented] (YARN-8287) Update documentation and yarn-default related to the Docker runtime

2018-08-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16568613#comment-16568613 ] Shane Kumpf commented on YARN-8287: --- Thanks for addressing my comments, [~ccondit-target

[jira] [Commented] (YARN-8287) Update documentation and yarn-default related to the Docker runtime

2018-08-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16568185#comment-16568185 ] Shane Kumpf commented on YARN-8287: --- Thanks for the patch, [~ccondit-target]! Overall th

[jira] [Commented] (YARN-8619) Automate docker network configuration through YARN API

2018-08-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16567596#comment-16567596 ] Shane Kumpf commented on YARN-8619: --- Thanks for the proposal, [~eyang]! I can see the va

[jira] [Commented] (YARN-8600) RegistryDNS hang when remote lookup does not reply

2018-08-01 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16565792#comment-16565792 ] Shane Kumpf commented on YARN-8600: --- Thanks for the updated patch [~eyang]! +1 on the 00

[jira] [Updated] (YARN-8600) RegistryDNS hang when remote lookup does not reply

2018-08-01 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8600: -- Fix Version/s: 3.1.1 3.2.0 > RegistryDNS hang when remote lookup does not reply > ---

[jira] [Updated] (YARN-8600) RegistryDNS hang when remote lookup does not reply

2018-08-01 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8600: -- Target Version/s: 3.2.0, 3.1.1 (was: 3.2.0, 3.1.2) > RegistryDNS hang when remote lookup does not reply

[jira] [Commented] (YARN-8600) RegistryDNS hang when remote lookup does not reply

2018-08-01 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16565277#comment-16565277 ] Shane Kumpf commented on YARN-8600: --- Thanks for the patch, [~eyang]. I had some trouble

[jira] [Commented] (YARN-3611) Support Docker Containers In LinuxContainerExecutor

2018-07-11 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16540749#comment-16540749 ] Shane Kumpf commented on YARN-3611: --- +1000 :) Great effort everyone. I'm excited for wha

[jira] [Commented] (YARN-8485) Priviledged container app launch is failing intermittently

2018-07-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530510#comment-16530510 ] Shane Kumpf commented on YARN-8485: --- Thanks to [~yeshavora] for reporting this, [~eyang]

[jira] [Updated] (YARN-8485) Priviledged container app launch is failing intermittently

2018-07-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8485: -- Issue Type: Sub-task (was: Bug) Parent: YARN-3611 > Priviledged container app launch is failing

[jira] [Updated] (YARN-8485) Priviledged container app launch is failing intermittently

2018-07-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8485: -- Affects Version/s: 3.1.1 3.2.0 Target Version/s: 3.2.0, 3.1.1

[jira] [Commented] (YARN-8485) Priviledged container app launch is failing intermittently

2018-07-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530482#comment-16530482 ] Shane Kumpf commented on YARN-8485: --- {code}by checking /usr/bin/sudo is good enough{code

[jira] [Comment Edited] (YARN-8485) Priviledged container app launch is failing intermittently

2018-07-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530482#comment-16530482 ] Shane Kumpf edited comment on YARN-8485 at 7/2/18 9:58 PM: --- {quo

  1   2   3   4   5   6   7   8   9   >