[jira] [Commented] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-09-04 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603613#comment-16603613 ] Eric Badger commented on YARN-8706: --- {quote} Either we implement native code that accepts name of the

[jira] [Commented] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-31 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599088#comment-16599088 ] Eric Badger commented on YARN-8706: --- bq. In DockerLinuxContainerRuntime, reapContainer() calls

[jira] [Commented] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-31 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598932#comment-16598932 ] Eric Badger commented on YARN-8706: --- Thanks for the patch, [~csingh]! Both {{reapContainer()}} and

[jira] [Commented] (YARN-8729) Node status updater thread could be lost after it restarted

2018-08-31 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598852#comment-16598852 ] Eric Badger commented on YARN-8729: --- Been awhile since I worked on that patch, but I think the idea was

[jira] [Commented] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-29 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596887#comment-16596887 ] Eric Badger commented on YARN-8706: --- I think the default sleep delay between STOPSIGNAL and SIGKILL is

[jira] [Commented] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595623#comment-16595623 ] Eric Badger commented on YARN-8706: --- bq. If this is setup properly, code only needs to ensure

[jira] [Commented] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595535#comment-16595535 ] Eric Badger commented on YARN-8706: --- bq. I can work on it, if there aren't any concerns? Sounds good to

[jira] [Commented] (YARN-8642) Add support for tmpfs mounts with the Docker runtime

2018-08-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595349#comment-16595349 ] Eric Badger commented on YARN-8642: --- Ahhh that's right, we invoke using exec now. I had forgotten about

[jira] [Commented] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16595170#comment-16595170 ] Eric Badger commented on YARN-8706: --- Really it would be better if we didn't send the kill from docker

[jira] [Commented] (YARN-8642) Add support for tmpfs mounts with the Docker runtime

2018-08-27 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593856#comment-16593856 ] Eric Badger commented on YARN-8642: --- {noformat} + const char *regex_str = "^/[^:]+$"; {noformat} This

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591801#comment-16591801 ] Eric Badger commented on YARN-8638: --- Thanks for the patch updates, [~ccondit-target]. Patch 004 looks

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590483#comment-16590483 ] Eric Badger commented on YARN-8638: --- bq. LinuxContainerRuntime is already marked @Private and @Unstable,

[jira] [Commented] (YARN-6456) Allow administrators to set a single ContainerRuntime for all containers

2018-08-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590423#comment-16590423 ] Eric Badger commented on YARN-6456: --- [~ccondit-target], I attached a patch of what we're using to force

[jira] [Updated] (YARN-6456) Allow administrators to set a single ContainerRuntime for all containers

2018-08-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6456: -- Attachment: YARN-6456-ForceDockerRuntimeIfSupported.patch > Allow administrators to set a single

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590412#comment-16590412 ] Eric Badger commented on YARN-8638: --- bq. Default's logic is as before, but since pluggable runtimes get

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590376#comment-16590376 ] Eric Badger commented on YARN-8638: --- bq. It will be very clean if we can make runc/containerd to be a

[jira] [Reopened] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reopened YARN-8675: --- > Setting hostname of docker container breaks with "host" networking mode for > Apps which do not run as

[jira] [Assigned] (YARN-7644) NM gets backed up deleting docker containers

2018-08-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reassigned YARN-7644: - Assignee: Chandni Singh (was: Eric Badger) [~csingh], assigned to you. Thanks for picking this

[jira] [Commented] (YARN-8648) Container cgroups are leaked when using docker

2018-08-21 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587681#comment-16587681 ] Eric Badger commented on YARN-8648: --- IMO I like the idea of actually dealing with this problem via

[jira] [Commented] (YARN-8523) Interactive docker shell

2018-08-03 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568721#comment-16568721 ] Eric Badger commented on YARN-8523: --- bq. The down side is the security model may become harder to

[jira] [Commented] (YARN-8287) Update documentation and yarn-default related to the Docker runtime

2018-08-03 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568695#comment-16568695 ] Eric Badger commented on YARN-8287: --- Nevermind, disregard that comment. Just saw that

[jira] [Commented] (YARN-8287) Update documentation and yarn-default related to the Docker runtime

2018-08-03 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568692#comment-16568692 ] Eric Badger commented on YARN-8287: --- At one point we had discussed adding a section detailing how the

[jira] [Updated] (YARN-8587) Delays are noticed to launch docker container

2018-07-26 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8587: -- Labels: Docker (was: ) > Delays are noticed to launch docker container >

[jira] [Commented] (YARN-8380) Support shared mounts in docker runtime

2018-07-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16549903#comment-16549903 ] Eric Badger commented on YARN-8380: --- {quote} That's how it works before this patch. Previously there

[jira] [Commented] (YARN-8380) Support shared mounts in docker runtime

2018-07-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16549852#comment-16549852 ] Eric Badger commented on YARN-8380: --- {noformat} +mount_type = get_mount_type(values[i]); +if

[jira] [Commented] (YARN-7590) Improve container-executor validation check

2018-07-17 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16546828#comment-16546828 ] Eric Badger commented on YARN-7590: --- Is your NM running as root? {noformat} if (caller_uid !=

[jira] [Updated] (YARN-8523) Interactive docker shell

2018-07-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8523: -- Labels: Docker (was: ) > Interactive docker shell > > > Key:

[jira] [Updated] (YARN-8520) Document best practice for user management

2018-07-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8520: -- Labels: Docker (was: ) > Document best practice for user management >

[jira] [Resolved] (YARN-3611) Support Docker Containers In LinuxContainerExecutor

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger resolved YARN-3611. --- Resolution: Fixed We have closed out Phase 1 of Docker container support and are now moving onto

[jira] [Updated] (YARN-8472) YARN Container Phase 2

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8472: -- Description: In YARN-3611, we have implemented basic Docker container support for YARN.  This story is

[jira] [Resolved] (YARN-8241) MRAppMaster fails when using UID:GID pair within docker container

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger resolved YARN-8241. --- Resolution: Won't Fix We do not plan to support running containers in which a user lookup cannot be

[jira] [Updated] (YARN-7904) Privileged, trusted containers need all of their bind-mounted directories to be read-only

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7904: -- Parent Issue: YARN-8472 (was: YARN-3611) > Privileged, trusted containers need all of their

[jira] [Updated] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5168: -- Parent Issue: YARN-8472 (was: YARN-3611) > Add port mapping handling when docker container use bridge

[jira] [Resolved] (YARN-7197) Add support for a volume blacklist for docker containers

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger resolved YARN-7197. --- Resolution: Won't Fix There are currently no plans to attempt to implement this feature. Feel free to

[jira] [Updated] (YARN-5670) Add support for Docker image clean up

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5670: -- Parent: YARN-8472 (was: YARN-3611) > Add support for Docker image clean up >

[jira] [Updated] (YARN-6495) check docker container's exit code when writing to cgroup task files

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6495: -- Parent: YARN-8472 (was: YARN-3611) > check docker container's exit code when writing to cgroup task

[jira] [Updated] (YARN-8376) Separate white list for docker.trusted.registries and docker.privileged-container.registries

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8376: -- Parent: YARN-8472 (was: YARN-3611) > Separate white list for docker.trusted.registries and >

[jira] [Updated] (YARN-3854) Add localization support for docker images

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-3854: -- Parent: YARN-8472 (was: YARN-3611) > Add localization support for docker images >

[jira] [Updated] (YARN-6456) Allow administrators to set a single ContainerRuntime for all containers

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6456: -- Parent: YARN-8472 (was: YARN-3611) > Allow administrators to set a single ContainerRuntime for all

[jira] [Updated] (YARN-7848) Force removal of docker containers that do not get removed on first try

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7848: -- Parent: YARN-8472 (was: YARN-3611) > Force removal of docker containers that do not get removed on

[jira] [Updated] (YARN-8263) DockerClient still touches hadoop.tmp.dir

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8263: -- Parent: YARN-8472 (was: YARN-3611) > DockerClient still touches hadoop.tmp.dir >

[jira] [Updated] (YARN-8287) Update documentation and yarn-default related to the Docker runtime

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8287: -- Parent: YARN-8472 (was: YARN-3611) > Update documentation and yarn-default related to the Docker

[jira] [Updated] (YARN-8515) container-executor can crash with SIGPIPE after nodemanager restart

2018-07-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8515: -- Labels: Docker (was: ) > container-executor can crash with SIGPIPE after nodemanager restart >

[jira] [Commented] (YARN-8259) Revisit liveliness checks for Docker containers

2018-06-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508657#comment-16508657 ] Eric Badger commented on YARN-8259: --- I would give a slight preference to proposal #1 because of

[jira] [Commented] (YARN-8259) Revisit liveliness checks for Docker containers

2018-05-31 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497239#comment-16497239 ] Eric Badger commented on YARN-8259: --- For proposal #1, if the yarn user is whitelisted for hidepid, then

[jira] [Resolved] (YARN-8343) YARN should have ability to run images only from a whitelist docker registries

2018-05-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger resolved YARN-8343. --- Resolution: Duplicate > YARN should have ability to run images only from a whitelist docker

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-29 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494123#comment-16494123 ] Eric Badger commented on YARN-8342: --- {quote}This is progression improvement that can be enhanced to

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-29 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493990#comment-16493990 ] Eric Badger commented on YARN-8342: --- bq. Sudo users can easily change the configuration to allow the

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-29 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493743#comment-16493743 ] Eric Badger commented on YARN-8342: --- bq. Is there any reason to block sudo users from running images in

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491128#comment-16491128 ] Eric Badger commented on YARN-8342: --- Naming conventions aside for the moment, I believe we should have 3

[jira] [Commented] (YARN-6919) Add default volume mount list

2018-05-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16489243#comment-16489243 ] Eric Badger commented on YARN-6919: --- Thanks [~shaneku...@gmail.com] and [~Jim_Brennan]! > Add default

[jira] [Commented] (YARN-8343) YARN should have ability to run images only from a whitelist docker registries

2018-05-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488084#comment-16488084 ] Eric Badger commented on YARN-8343: --- I think we need to do a rework around privileged/non-privileged

[jira] [Commented] (YARN-8342) Using docker image from a non-privileged registry, the launch_command is not honored

2018-05-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488073#comment-16488073 ] Eric Badger commented on YARN-8342: --- {quote}Looks like the name 

[jira] [Commented] (YARN-6919) Add default volume mount list

2018-05-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488049#comment-16488049 ] Eric Badger commented on YARN-6919: --- Hey [~shaneku...@gmail.com], I think this should go into 3.1 as

[jira] [Updated] (YARN-6919) Add default volume mount list

2018-05-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6919: -- Attachment: YARN-6919-branch-3.1.002.patch > Add default volume mount list >

[jira] [Reopened] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-05-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger reopened YARN-7530: --- This change breaks branch-3.1 compilation if the .m2 directory is cleaned. {noformat} [ERROR] [ERROR]

[jira] [Commented] (YARN-8285) Remove unused environment variables from the Docker runtime

2018-05-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16487323#comment-16487323 ] Eric Badger commented on YARN-8285: --- Thanks, [~shaneku...@gmail.com]! > Remove unused environment

[jira] [Commented] (YARN-7960) Add no-new-privileges flag to docker run

2018-05-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16484385#comment-16484385 ] Eric Badger commented on YARN-7960: --- Thanks [~eyang] for the review/commit! > Add no-new-privileges flag

[jira] [Commented] (YARN-8206) Sending a kill does not immediately kill docker containers

2018-05-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16484382#comment-16484382 ] Eric Badger commented on YARN-8206: --- Wonderful! Thanks [~jlowe] for the review/commit and

[jira] [Resolved] (YARN-8335) Privileged docker containers' jobSubmitDir does not get successfully cleaned up

2018-05-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger resolved YARN-8335. --- Resolution: Duplicate > Privileged docker containers' jobSubmitDir does not get successfully cleaned

[jira] [Commented] (YARN-8335) Privileged docker containers' jobSubmitDir does not get successfully cleaned up

2018-05-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16484379#comment-16484379 ] Eric Badger commented on YARN-8335: --- Hmm, good point. I guess I wouldn't say it's exactly a dup of

[jira] [Commented] (YARN-8259) Revisit liveliness checks for Docker containers

2018-05-21 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16483041#comment-16483041 ] Eric Badger commented on YARN-8259: --- Also, I have tested the current patch for correctness. So, if we

[jira] [Commented] (YARN-8259) Revisit liveliness checks for Docker containers

2018-05-21 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16483038#comment-16483038 ] Eric Badger commented on YARN-8259: --- bq. If hidepid option is used by system administrator, yarn user

[jira] [Created] (YARN-8335) Privileged docker containers' jobSubmitDir does not get successfully cleaned up

2018-05-21 Thread Eric Badger (JIRA)
Eric Badger created YARN-8335: - Summary: Privileged docker containers' jobSubmitDir does not get successfully cleaned up Key: YARN-8335 URL: https://issues.apache.org/jira/browse/YARN-8335 Project:

[jira] [Commented] (YARN-8206) Sending a kill does not immediately kill docker containers

2018-05-21 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482694#comment-16482694 ] Eric Badger commented on YARN-8206: --- Thanks for the review, [~jlowe]! Patch 011 addresses your comments.

[jira] [Updated] (YARN-8206) Sending a kill does not immediately kill docker containers

2018-05-21 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8206: -- Attachment: YARN-8206.011.patch > Sending a kill does not immediately kill docker containers >

[jira] [Commented] (YARN-7960) Add no-new-privileges flag to docker run

2018-05-21 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482548#comment-16482548 ] Eric Badger commented on YARN-7960: --- Test doesn't fail for me locally and is in RM code, so it's

[jira] [Updated] (YARN-7960) Add no-new-privileges flag to docker run

2018-05-18 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7960: -- Attachment: YARN-7960.002.patch > Add no-new-privileges flag to docker run >

[jira] [Commented] (YARN-7960) Add no-new-privileges flag to docker run

2018-05-18 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481175#comment-16481175 ] Eric Badger commented on YARN-7960: --- Attaching patch 002 which uses a boolean to determine whether to

[jira] [Commented] (YARN-8259) Revisit liveliness checks for privileged Docker containers

2018-05-18 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480830#comment-16480830 ] Eric Badger commented on YARN-8259: --- bq. Root user signal can be too powerful for status check in some

[jira] [Updated] (YARN-8206) Sending a kill does not immediately kill docker containers

2018-05-17 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8206: -- Attachment: YARN-8206.010.patch > Sending a kill does not immediately kill docker containers >

[jira] [Commented] (YARN-8206) Sending a kill does not immediately kill docker containers

2018-05-17 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479315#comment-16479315 ] Eric Badger commented on YARN-8206: --- Thanks for the review, [~jlowe]! Patch 010 addresses your comments.

[jira] [Updated] (YARN-7278) LinuxContainer in docker mode will be failed when nodemanager restart, because timeout for docker is too slow.

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7278: -- Labels: Docker (was: ) > LinuxContainer in docker mode will be failed when nodemanager restart, >

[jira] [Updated] (YARN-7246) Fix the default docker binary path

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7246: -- Labels: Docker (was: ) > Fix the default docker binary path > -- > >

[jira] [Updated] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8141: -- Labels: Docker (was: ) > YARN Native Service: Respect >

[jira] [Updated] (YARN-4018) correct docker image name is rejected by DockerContainerExecutor

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-4018: -- Labels: Docker (was: ) > correct docker image name is rejected by DockerContainerExecutor >

[jira] [Updated] (YARN-8274) Docker command error during container relaunch

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8274: -- Labels: Docker (was: ) > Docker command error during container relaunch >

[jira] [Updated] (YARN-4016) docker container is still running when app is killed

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-4016: -- Labels: Docker (was: ) > docker container is still running when app is killed >

[jira] [Updated] (YARN-3201) add args for DistributedShell to specify a image for tasks that will run on docker

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-3201: -- Labels: Docker (was: ) > add args for DistributedShell to specify a image for tasks that will run on >

[jira] [Updated] (YARN-2976) Invalid docs for specifying yarn.nodemanager.docker-container-executor.exec-name

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-2976: -- Labels: Docker (was: ) > Invalid docs for specifying >

[jira] [Updated] (YARN-3302) TestDockerContainerExecutor should run automatically if it can detect docker in the usual place

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-3302: -- Labels: Docker (was: ) > TestDockerContainerExecutor should run automatically if it can detect docker

[jira] [Updated] (YARN-5426) Enable distributed shell to launch docker containers

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5426: -- Labels: Docker (was: ) > Enable distributed shell to launch docker containers >

[jira] [Updated] (YARN-6387) Provide a flag in Rest API GET response to notify if the app launch delay is due to docker image download.

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6387: -- Labels: Docker (was: ) > Provide a flag in Rest API GET response to notify if the app launch delay is

[jira] [Updated] (YARN-3289) Docker images should be downloaded during localization

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-3289: -- Labels: Docker (was: ) > Docker images should be downloaded during localization >

[jira] [Updated] (YARN-6454) Add support for setting environment variables for docker containers

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6454: -- Labels: Docker (was: ) > Add support for setting environment variables for docker containers >

[jira] [Updated] (YARN-7996) Allow user supplied Docker client configurations with YARN native services

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7996: -- Labels: Docker (was: ) > Allow user supplied Docker client configurations with YARN native services >

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-1964: -- Labels: Docker (was: ) > Create Docker analog of the LinuxContainerExecutor in YARN >

[jira] [Updated] (YARN-5505) Create an agent-less docker provider in the native-services framework

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5505: -- Labels: Docker (was: ) > Create an agent-less docker provider in the native-services framework >

[jira] [Updated] (YARN-3988) DockerContainerExecutor should allow user specify "docker run" parameters

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-3988: -- Labels: Docker (was: ) > DockerContainerExecutor should allow user specify "docker run" parameters >

[jira] [Updated] (YARN-8181) Docker container run_time

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8181: -- Labels: Docker (was: ) > Docker container run_time > - > > Key:

[jira] [Updated] (YARN-6160) Create an agent-less docker-less provider in the native services framework

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6160: -- Labels: Docker (was: ) > Create an agent-less docker-less provider in the native services framework >

[jira] [Updated] (YARN-8231) Dshell application fails when one of the docker container gets killed

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8231: -- Labels: Docker (was: ) > Dshell application fails when one of the docker container gets killed >

[jira] [Updated] (YARN-7416) Use "docker volume inspect" to make sure that volumes for GPU drivers/libs are properly mounted.

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7416: -- Labels: Docker (was: ) > Use "docker volume inspect" to make sure that volumes for GPU drivers/libs >

[jira] [Updated] (YARN-6804) Allow custom hostname for docker containers in native services

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6804: -- Labels: Docker (was: ) > Allow custom hostname for docker containers in native services >

[jira] [Updated] (YARN-2466) Umbrella issue for Yarn launched Docker Containers

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-2466: -- Labels: Docker (was: ) > Umbrella issue for Yarn launched Docker Containers >

[jira] [Updated] (YARN-8208) Add log statement for Docker client configuration file at INFO level

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8208: -- Labels: Docker (was: ) > Add log statement for Docker client configuration file at INFO level >

[jira] [Updated] (YARN-6622) Document Docker work as experimental

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6622: -- Labels: Docker (was: ) > Document Docker work as experimental > >

[jira] [Updated] (YARN-3324) TestDockerContainerExecutor should clean test docker image from local repository after test is done

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-3324: -- Labels: BB2015-05-TBR Docker (was: BB2015-05-TBR) > TestDockerContainerExecutor should clean test

[jira] [Updated] (YARN-6091) the AppMaster register failed when use Docker on LinuxContainer

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6091: -- Labels: Docker (was: ) > the AppMaster register failed when use Docker on LinuxContainer >

[jira] [Updated] (YARN-7361) Improve the docker container runtime documentation

2018-05-16 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7361: -- Labels: Docker (was: ) > Improve the docker container runtime documentation >

<    2   3   4   5   6   7   8   9   10   11   >