[jira] [Created] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

2018-09-20 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8805: - Summary: Automatically convert the launch command to the exec form when using entrypoint support Key: YARN-8805 URL: https://issues.apache.org/jira/browse/YARN-8805

[jira] [Created] (YARN-8751) Container-executor permission check errors cause the NM to be marked unhealthy

2018-09-06 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8751: - Summary: Container-executor permission check errors cause the NM to be marked unhealthy Key: YARN-8751 URL: https://issues.apache.org/jira/browse/YARN-8751 Project: Hadoop

[jira] [Created] (YARN-8748) Javadoc warnings within the nodemanager package

2018-09-05 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8748: - Summary: Javadoc warnings within the nodemanager package Key: YARN-8748 URL: https://issues.apache.org/jira/browse/YARN-8748 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-8642) Add support for tmpfs mounts with the Docker runtime

2018-08-09 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8642: - Summary: Add support for tmpfs mounts with the Docker runtime Key: YARN-8642 URL: https://issues.apache.org/jira/browse/YARN-8642 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-8410) Registry DNS lookup fails to return for CNAMEs

2018-06-10 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8410: - Summary: Registry DNS lookup fails to return for CNAMEs Key: YARN-8410 URL: https://issues.apache.org/jira/browse/YARN-8410 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-8365) Revisit the record type used by Registry DNS for upstream resolution

2018-05-25 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8365: - Summary: Revisit the record type used by Registry DNS for upstream resolution Key: YARN-8365 URL: https://issues.apache.org/jira/browse/YARN-8365 Project: Hadoop YARN

[jira] [Created] (YARN-8349) Remove YARN registry entries when a service is killed by the RM

2018-05-23 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8349: - Summary: Remove YARN registry entries when a service is killed by the RM Key: YARN-8349 URL: https://issues.apache.org/jira/browse/YARN-8349 Project: Hadoop YARN

[jira] [Created] (YARN-8329) Docker client configuration can still be set incorrectly

2018-05-19 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8329: - Summary: Docker client configuration can still be set incorrectly Key: YARN-8329 URL: https://issues.apache.org/jira/browse/YARN-8329 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8287) Update documentation and yarn-default related to the Docker runtime

2018-05-12 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8287: - Summary: Update documentation and yarn-default related to the Docker runtime Key: YARN-8287 URL: https://issues.apache.org/jira/browse/YARN-8287 Project: Hadoop YARN

[jira] [Created] (YARN-8285) Remove unused environment variables from the Docker runtime

2018-05-12 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8285: - Summary: Remove unused environment variables from the Docker runtime Key: YARN-8285 URL: https://issues.apache.org/jira/browse/YARN-8285 Project: Hadoop YARN

[jira] [Created] (YARN-8259) Revisit liveliness checks for privileged Docker containers

2018-05-08 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8259: - Summary: Revisit liveliness checks for privileged Docker containers Key: YARN-8259 URL: https://issues.apache.org/jira/browse/YARN-8259 Project: Hadoop YARN Issue

[jira] [Resolved] (YARN-8227) TestPlacementConstraintTransformations is failing in trunk

2018-04-27 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-8227. --- Resolution: Duplicate This is being tracked under YARN-8225, going to close this one as a duplicate.

[jira] [Resolved] (YARN-6639) Docker container can not find launch_container.sh in workdir

2018-04-27 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-6639. --- Resolution: Cannot Reproduce > Docker container can not find launch_container.sh in workdir >

[jira] [Resolved] (YARN-7706) Improve error logging for "java.lang.IllegalArgumentException: Src_file does not exist for config file: httpd-proxy.conf"

2018-04-26 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-7706. --- Resolution: Duplicate > Improve error logging for "java.lang.IllegalArgumentException: Src_file does

[jira] [Resolved] (YARN-3201) add args for DistributedShell to specify a image for tasks that will run on docker

2018-04-19 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-3201. --- Resolution: Duplicate > add args for DistributedShell to specify a image for tasks that will run on >

[jira] [Resolved] (YARN-2466) Umbrella issue for Yarn launched Docker Containers

2018-04-04 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-2466. --- Resolution: Won't Fix > Umbrella issue for Yarn launched Docker Containers >

[jira] [Resolved] (YARN-3290) DockerContainerExecutor should optionally limit memory and cpu

2018-04-04 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-3290. --- Resolution: Won't Fix > DockerContainerExecutor should optionally limit memory and cpu >

[jira] [Resolved] (YARN-3095) Enable DockerContainerExecutor to update Docker image

2018-04-04 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-3095. --- Resolution: Won't Fix > Enable DockerContainerExecutor to update Docker image >

[jira] [Resolved] (YARN-3289) Docker images should be downloaded during localization

2018-04-04 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-3289. --- Resolution: Duplicate > Docker images should be downloaded during localization >

[jira] [Resolved] (YARN-7278) LinuxContainer in docker mode will be failed when nodemanager restart, because timeout for docker is too slow.

2018-03-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-7278. --- Resolution: Duplicate Fix Version/s: (was: 2.9.1) > LinuxContainer in docker mode will be

[jira] [Resolved] (YARN-8044) Determine the appropriate default ContainerRetryPolicy

2018-03-27 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-8044. --- Resolution: Won't Fix > Determine the appropriate default ContainerRetryPolicy >

[jira] [Resolved] (YARN-8037) CGroupsResourceCalculator logs excessive warnings on container relaunch

2018-03-27 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-8037. --- Resolution: Not A Problem > CGroupsResourceCalculator logs excessive warnings on container relaunch >

[jira] [Created] (YARN-8045) Reduce log output from container status calls

2018-03-17 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8045: - Summary: Reduce log output from container status calls Key: YARN-8045 URL: https://issues.apache.org/jira/browse/YARN-8045 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-8044) Determine the appropriate default ContainerRetryPolicy

2018-03-17 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8044: - Summary: Determine the appropriate default ContainerRetryPolicy Key: YARN-8044 URL: https://issues.apache.org/jira/browse/YARN-8044 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8043) Add the exception message for failed launches running under LCE

2018-03-17 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8043: - Summary: Add the exception message for failed launches running under LCE Key: YARN-8043 URL: https://issues.apache.org/jira/browse/YARN-8043 Project: Hadoop YARN

[jira] [Created] (YARN-8037) CGroupsResourceCalculator excessive warnings on container relaunch

2018-03-16 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8037: - Summary: CGroupsResourceCalculator excessive warnings on container relaunch Key: YARN-8037 URL: https://issues.apache.org/jira/browse/YARN-8037 Project: Hadoop YARN

[jira] [Created] (YARN-8035) Uncaught exception in ContainersMonitorImpl during relaunch due to the process ID changing

2018-03-16 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8035: - Summary: Uncaught exception in ContainersMonitorImpl during relaunch due to the process ID changing Key: YARN-8035 URL: https://issues.apache.org/jira/browse/YARN-8035

[jira] [Created] (YARN-8017) Validate the application ID has been persisted to the service definition prior to use

2018-03-09 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-8017: - Summary: Validate the application ID has been persisted to the service definition prior to use Key: YARN-8017 URL: https://issues.apache.org/jira/browse/YARN-8017 Project:

[jira] [Created] (YARN-7996) Allow user supplied Docker client configurations with YARN native services

2018-03-04 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7996: - Summary: Allow user supplied Docker client configurations with YARN native services Key: YARN-7996 URL: https://issues.apache.org/jira/browse/YARN-7996 Project: Hadoop

[jira] [Created] (YARN-7973) Support ContainerRelaunch for Docker containers

2018-02-26 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7973: - Summary: Support ContainerRelaunch for Docker containers Key: YARN-7973 URL: https://issues.apache.org/jira/browse/YARN-7973 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-7917) Fix failing test TestDockerContainerRuntime#testLaunchContainerWithDockerTokens

2018-02-09 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7917: - Summary: Fix failing test TestDockerContainerRuntime#testLaunchContainerWithDockerTokens Key: YARN-7917 URL: https://issues.apache.org/jira/browse/YARN-7917 Project:

[jira] [Created] (YARN-7916) Remove call to docker logs on failure in container-executor

2018-02-09 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7916: - Summary: Remove call to docker logs on failure in container-executor Key: YARN-7916 URL: https://issues.apache.org/jira/browse/YARN-7916 Project: Hadoop YARN

[jira] [Created] (YARN-7914) Fix exit code handling for short lived Docker containers

2018-02-09 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7914: - Summary: Fix exit code handling for short lived Docker containers Key: YARN-7914 URL: https://issues.apache.org/jira/browse/YARN-7914 Project: Hadoop YARN Issue

[jira] [Created] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7879: - Summary: NM user is unable to access the application filecache due to permissions Key: YARN-7879 URL: https://issues.apache.org/jira/browse/YARN-7879 Project: Hadoop YARN

[jira] [Resolved] (YARN-7846) Ss

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-7846. --- Resolution: Invalid > Ss > -- > > Key: YARN-7846 > URL:

[jira] [Resolved] (YARN-7845) H

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-7845. --- Resolution: Invalid > H > - > > Key: YARN-7845 > URL:

[jira] [Created] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-24 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7815: - Summary: Mount the filecache as read-only in Docker containers Key: YARN-7815 URL: https://issues.apache.org/jira/browse/YARN-7815 Project: Hadoop YARN Issue

[jira] [Created] (YARN-7814) Remove automatic mounting of cgroups into Docker containers

2018-01-24 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7814: - Summary: Remove automatic mounting of cgroups into Docker containers Key: YARN-7814 URL: https://issues.apache.org/jira/browse/YARN-7814 Project: Hadoop YARN

[jira] [Resolved] (YARN-5818) Support the Docker Live Restore feature

2018-01-24 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-5818. --- Resolution: Duplicate > Support the Docker Live Restore feature >

[jira] [Resolved] (YARN-6305) Improve signaling of short lived containers

2018-01-24 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-6305. --- Resolution: Duplicate > Improve signaling of short lived containers >

[jira] [Created] (YARN-7810) TestDockerContainerRuntime test failures due to UID lookup of a non-existent user

2018-01-24 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7810: - Summary: TestDockerContainerRuntime test failures due to UID lookup of a non-existent user Key: YARN-7810 URL: https://issues.apache.org/jira/browse/YARN-7810 Project:

[jira] [Created] (YARN-7729) Add support for setting the PID namespace mode

2018-01-10 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7729: - Summary: Add support for setting the PID namespace mode Key: YARN-7729 URL: https://issues.apache.org/jira/browse/YARN-7729 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-7361) Improve the docker container related documentation

2017-10-18 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7361: - Summary: Improve the docker container related documentation Key: YARN-7361 URL: https://issues.apache.org/jira/browse/YARN-7361 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-7246) Fix the default docker binary path

2017-09-23 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7246: - Summary: Fix the default docker binary path Key: YARN-7246 URL: https://issues.apache.org/jira/browse/YARN-7246 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-7014) test-container-executor is failing with exit code 139

2017-08-15 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7014: - Summary: test-container-executor is failing with exit code 139 Key: YARN-7014 URL: https://issues.apache.org/jira/browse/YARN-7014 Project: Hadoop YARN Issue

[jira] [Created] (YARN-6830) Support quoted strings for environment variables

2017-07-17 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-6830: - Summary: Support quoted strings for environment variables Key: YARN-6830 URL: https://issues.apache.org/jira/browse/YARN-6830 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-6726) Support additional docker commands in container-executor

2017-06-21 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-6726: - Summary: Support additional docker commands in container-executor Key: YARN-6726 URL: https://issues.apache.org/jira/browse/YARN-6726 Project: Hadoop YARN Issue

[jira] [Created] (YARN-6374) Improve test coverage and add utility classes for common Docker operations.

2017-03-22 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-6374: - Summary: Improve test coverage and add utility classes for common Docker operations. Key: YARN-6374 URL: https://issues.apache.org/jira/browse/YARN-6374 Project: Hadoop

[jira] [Created] (YARN-6366) Refactor the NodeManager DeletionService to support additional DeletionTask types.

2017-03-20 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-6366: - Summary: Refactor the NodeManager DeletionService to support additional DeletionTask types. Key: YARN-6366 URL: https://issues.apache.org/jira/browse/YARN-6366 Project:

[jira] [Created] (YARN-6305) Improve signaling of short lived containers

2017-03-08 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-6305: - Summary: Improve signaling of short lived containers Key: YARN-6305 URL: https://issues.apache.org/jira/browse/YARN-6305 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Resolved] (YARN-5827) DockerLinuxContainer can't limit the cpu usage

2016-11-21 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-5827. --- Resolution: Duplicate Target Version/s: (was: 2.8.0) > DockerLinuxContainer can't limit

[jira] [Created] (YARN-5818) Support the Docker Live Restore feature

2016-11-02 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-5818: - Summary: Support the Docker Live Restore feature Key: YARN-5818 URL: https://issues.apache.org/jira/browse/YARN-5818 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Resolved] (YARN-5645) Support a white list of admin approved mounts

2016-09-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-5645. --- Resolution: Duplicate > Support a white list of admin approved mounts >

[jira] [Created] (YARN-5645) Support a white list of admin approved mounts.

2016-09-13 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-5645: - Summary: Support a white list of admin approved mounts. Key: YARN-5645 URL: https://issues.apache.org/jira/browse/YARN-5645 Project: Hadoop YARN Issue Type:

[jira] [Resolved] (YARN-5643) Remove package line length checkstyle rule

2016-09-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-5643. --- Resolution: Invalid should be a HADOOP jira > Remove package line length checkstyle rule >

[jira] [Created] (YARN-5643) Remove package line length checkstyle rule

2016-09-13 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-5643: - Summary: Remove package line length checkstyle rule Key: YARN-5643 URL: https://issues.apache.org/jira/browse/YARN-5643 Project: Hadoop YARN Issue Type: Bug

[jira] [Resolved] (YARN-5628) Remove package line length checkstyle rule

2016-09-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-5628. --- Resolution: Invalid This needs to be a HADOOP jira. > Remove package line length checkstyle rule >

[jira] [Created] (YARN-5628) Remove package line length checkstyle rule

2016-09-08 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-5628: - Summary: Remove package line length checkstyle rule Key: YARN-5628 URL: https://issues.apache.org/jira/browse/YARN-5628 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-5460) Move container runtime type logging in DelegatingLinuxContainerRuntime to debug

2016-08-01 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-5460: - Summary: Move container runtime type logging in DelegatingLinuxContainerRuntime to debug Key: YARN-5460 URL: https://issues.apache.org/jira/browse/YARN-5460 Project:

[jira] [Created] (YARN-5458) Rename DockerStopCommandTest to TestDockerStopCommand

2016-08-01 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-5458: - Summary: Rename DockerStopCommandTest to TestDockerStopCommand Key: YARN-5458 URL: https://issues.apache.org/jira/browse/YARN-5458 Project: Hadoop YARN Issue

[jira] [Created] (YARN-5459) Add support for docker rm

2016-08-01 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-5459: - Summary: Add support for docker rm Key: YARN-5459 URL: https://issues.apache.org/jira/browse/YARN-5459 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-5443) Add support for docker inspect

2016-07-28 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-5443: - Summary: Add support for docker inspect Key: YARN-5443 URL: https://issues.apache.org/jira/browse/YARN-5443 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-5428) Allow for specifying the docker client configuration directory

2016-07-25 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-5428: - Summary: Allow for specifying the docker client configuration directory Key: YARN-5428 URL: https://issues.apache.org/jira/browse/YARN-5428 Project: Hadoop YARN

[jira] [Created] (YARN-5404) Add the ability to split reverse zone subnets

2016-07-19 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-5404: - Summary: Add the ability to split reverse zone subnets Key: YARN-5404 URL: https://issues.apache.org/jira/browse/YARN-5404 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-5366) Add support for toggling the removal of completed and failed docker containers

2016-07-12 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-5366: - Summary: Add support for toggling the removal of completed and failed docker containers Key: YARN-5366 URL: https://issues.apache.org/jira/browse/YARN-5366 Project: Hadoop