[jira] [Updated] (YARN-3854) Add localization support for docker images

2016-06-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-3854: --- Attachment: YARN-3854_Localization_support_for_Docker_image_v1.pdf > Add localization support for

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-06-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326730#comment-15326730 ] Zhankun Tang commented on YARN-3854: [~sidharta-s], [~hex108], [~zyluo], I have filed a draft design

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2016-06-11 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326194#comment-15326194 ] Zhankun Tang commented on YARN-5168: [~hex108], that's cool. Looking forward to your proposal! > Add

[jira] [Updated] (YARN-3854) Add localization support for docker images

2016-06-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-3854: --- Attachment: YARN-3854_Localization_support_for_Docker_image_v2.pdf There is an existing environment

[jira] [Commented] (YARN-5258) Document Use of Docker with LinuxContainerExecutor

2016-07-25 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393245#comment-15393245 ] Zhankun Tang commented on YARN-5258: Sure. I'll post a draft version here. > Document Use of Docker

[jira] [Commented] (YARN-5258) Document Use of Docker with LinuxContainerExecutor

2016-07-25 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393248#comment-15393248 ] Zhankun Tang commented on YARN-5258: [~templedf], I can pick this. And [~shaneku...@gmail.com] is also

[jira] [Commented] (YARN-5042) Mount /sys/fs/cgroup into Docker containers as read only mount

2016-07-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15393310#comment-15393310 ] Zhankun Tang commented on YARN-5042: I am not a systemd expert so one question is that why we need to

[jira] [Created] (YARN-5360) Use UID instead of user name to build the Docker run command

2016-07-12 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-5360: -- Summary: Use UID instead of user name to build the Docker run command Key: YARN-5360 URL: https://issues.apache.org/jira/browse/YARN-5360 Project: Hadoop YARN

[jira] [Commented] (YARN-5360) Decouple host user and Docker container user

2016-07-25 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391563#comment-15391563 ] Zhankun Tang commented on YARN-5360: [~vvasudev], Thanks but I think set to 705 won't affect current

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-07-25 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391515#comment-15391515 ] Zhankun Tang commented on YARN-3854: [~sidharta-s], Thanks for the update! For the security issue

[jira] [Comment Edited] (YARN-5394) Correct the wrong file name when mounting /etc/passwd to Docker Container

2016-07-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391255#comment-15391255 ] Zhankun Tang edited comment on YARN-5394 at 7/25/16 2:13 AM: - [~sidharta-s],

[jira] [Commented] (YARN-5394) Correct the wrong file name when mounting /etc/passwd to Docker Container

2016-07-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391255#comment-15391255 ] Zhankun Tang commented on YARN-5394: [~sidharta-s], Yes. agree that there should be a way to disable

[jira] [Commented] (YARN-5394) Correct the wrong file name when mounting /etc/passwd to Docker Container

2016-07-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391332#comment-15391332 ] Zhankun Tang commented on YARN-5394: And I think the application can mount /etc/passwd thru the

[jira] [Comment Edited] (YARN-5394) Correct the wrong file name when mounting /etc/passwd to Docker Container

2016-07-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391332#comment-15391332 ] Zhankun Tang edited comment on YARN-5394 at 7/25/16 4:31 AM: - And I think the

[jira] [Comment Edited] (YARN-5360) Decouple host user and Docker container user

2016-07-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391336#comment-15391336 ] Zhankun Tang edited comment on YARN-5360 at 7/25/16 4:39 AM: - [~sidharta-s],

[jira] [Commented] (YARN-5360) Decouple host user and Docker container user

2016-07-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391336#comment-15391336 ] Zhankun Tang commented on YARN-5360: [~sidharta-s], although running a container as root have security

[jira] [Commented] (YARN-5360) Decouple host user and Docker container user

2016-07-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397027#comment-15397027 ] Zhankun Tang commented on YARN-5360: [~sidharta-s], thanks for pointing out this. Actually, different

[jira] [Comment Edited] (YARN-5360) Decouple host user and Docker container user

2016-07-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397027#comment-15397027 ] Zhankun Tang edited comment on YARN-5360 at 7/28/16 7:05 AM: - [~sidharta-s],

[jira] [Commented] (YARN-5042) Mount /sys/fs/cgroup into Docker containers as read only mount

2016-07-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397496#comment-15397496 ] Zhankun Tang commented on YARN-5042: I guess existing unit test should be changed to pass the unit

[jira] [Commented] (YARN-5042) Mount /sys/fs/cgroup into Docker containers as read only mount

2016-07-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397498#comment-15397498 ] Zhankun Tang commented on YARN-5042: yes. It seems more and more linux distribution is going to adopt

[jira] [Issue Comment Deleted] (YARN-3854) Add localization support for docker images

2016-07-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-3854: --- Comment: was deleted (was: Yes. Explicit "docker pull" have the benifit over implicitly that we can

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-07-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388715#comment-15388715 ] Zhankun Tang commented on YARN-3854: Yes. Explicit "docker pull" have the benifit over implicitly that

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-07-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388714#comment-15388714 ] Zhankun Tang commented on YARN-3854: Yes. Explicit "docker pull" have the benifit over implicitly that

[jira] [Commented] (YARN-5258) Document Use of Docker with LinuxContainerExecutor

2016-07-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388861#comment-15388861 ] Zhankun Tang commented on YARN-5258: Yes, [~templedf]. The user cannot find a one-stop document about

[jira] [Commented] (YARN-5360) Decouple host user and Docker container user

2016-07-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15398563#comment-15398563 ] Zhankun Tang commented on YARN-5360: [~sidharta-s], The first testing result table shows us existing

[jira] [Updated] (YARN-5394) Correct the wrong file name when mounting /etc/passwd to Docker Container

2016-07-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-5394: --- Attachment: YARN-5394-branch-2.8.002.patch Upload a new patch of removing /etc/passwd bind-mount. This

[jira] [Updated] (YARN-5394) Remove bind-mount /etc/passwd to Docker Container

2016-07-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-5394: --- Summary: Remove bind-mount /etc/passwd to Docker Container (was: Correct the wrong file name when

[jira] [Updated] (YARN-5394) Remove bind-mount /etc/passwd to Docker Container

2016-07-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-5394: --- Description: Current LCE (DockerLinuxContainerRuntime) is mounting /etc/passwd to the container. And

[jira] [Commented] (YARN-5394) Remove bind-mount /etc/passwd to Docker Container

2016-07-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15398924#comment-15398924 ] Zhankun Tang commented on YARN-5394: Title and description updated > Remove bind-mount /etc/passwd to

[jira] [Comment Edited] (YARN-5360) Decouple host user and Docker container user

2016-07-31 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15401522#comment-15401522 ] Zhankun Tang edited comment on YARN-5360 at 8/1/16 4:53 AM: [~sidharta-s],

[jira] [Commented] (YARN-5360) Decouple host user and Docker container user

2016-07-31 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15401522#comment-15401522 ] Zhankun Tang commented on YARN-5360: [~sidharta-s], Thanks for the explaination. And I appreciate that

[jira] [Commented] (YARN-5394) Remove bind-mount /etc/passwd to Docker Container

2016-07-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400698#comment-15400698 ] Zhankun Tang commented on YARN-5394: The failed unit test "TestNMProxy" seems unrelated to this patch.

[jira] [Commented] (YARN-5394) Remove bind-mount /etc/passwd to Docker Container

2016-07-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400669#comment-15400669 ] Zhankun Tang commented on YARN-5394: Yes. Sure. Have it submitted. > Remove bind-mount /etc/passwd to

[jira] [Updated] (YARN-5394) Remove bind-mount /etc/passwd to Docker Container

2016-07-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-5394: --- Attachment: (was: YARN-5394-branch-2.8.001.patch) > Remove bind-mount /etc/passwd to Docker

[jira] [Updated] (YARN-5394) Remove bind-mount /etc/passwd to Docker Container

2016-07-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-5394: --- Attachment: YARN-5394.002.patch > Remove bind-mount /etc/passwd to Docker Container >

[jira] [Updated] (YARN-5394) Remove bind-mount /etc/passwd to Docker Container

2016-07-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-5394: --- Attachment: (was: YARN-5394-branch-2.8.002.patch) > Remove bind-mount /etc/passwd to Docker

[jira] [Commented] (YARN-5394) Remove bind-mount /etc/passwd to Docker Container

2016-07-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400963#comment-15400963 ] Zhankun Tang commented on YARN-5394: Changed the patch name. Set 2.8.0 to "Affects version" and "Fix

[jira] [Commented] (YARN-5428) Allow for specifying the docker client configuration directory

2016-08-02 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405147#comment-15405147 ] Zhankun Tang commented on YARN-5428: Yes. Agree. It can store other settings besides credentials. Since

[jira] [Commented] (YARN-5428) Allow for specifying the docker client configuration directory

2016-08-03 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15405645#comment-15405645 ] Zhankun Tang commented on YARN-5428: The admin provided creds in config.json is to avoid interactive

[jira] [Updated] (YARN-3854) Add localization support for docker images

2016-08-14 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-3854: --- Attachment: YARN-3854_Localization_support_for_Docker_image_v3.pdf A new proposal for docker pull

[jira] [Commented] (YARN-5360) Use UID instead of user name to build the Docker run command

2016-07-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374436#comment-15374436 ] Zhankun Tang commented on YARN-5360: Current LCE (DockerLinuxContainerRuntime) is mounting /etc/passwd

[jira] [Updated] (YARN-5360) Use UID instead of user name to build the Docker run command

2016-07-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-5360: --- Description: There is *a dependency between job submitting user and the user in the Docker image* in

[jira] [Commented] (YARN-5360) Use UID instead of user name to build the Docker run command

2016-07-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374547#comment-15374547 ] Zhankun Tang commented on YARN-5360: And one more thing we need to know is that this UID need not to

[jira] [Commented] (YARN-5360) Use UID instead of user name to build the Docker run command

2016-07-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374454#comment-15374454 ] Zhankun Tang commented on YARN-5360: *The root cause is that there is a wrong file name in the

[jira] [Updated] (YARN-5360) Use UID instead of user name to build the Docker run command

2016-07-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-5360: --- Description: There is *a dependency between job submitting user and the user in the Docker image* in

[jira] [Comment Edited] (YARN-5360) Use UID instead of user name to build the Docker run command

2016-07-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374547#comment-15374547 ] Zhankun Tang edited comment on YARN-5360 at 7/13/16 7:51 AM: - And one more

[jira] [Commented] (YARN-5360) Use UID instead of user name to build the Docker run command

2016-07-13 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15374529#comment-15374529 ] Zhankun Tang commented on YARN-5360: [~vvasudev], thanks for the tip. Yes, if the running job user is

[jira] [Commented] (YARN-5360) Use UID instead of user name to build the Docker run command

2016-07-14 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376531#comment-15376531 ] Zhankun Tang commented on YARN-5360: [~sidharta-s], I understand your concerns of the side effect of

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-07-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387044#comment-15387044 ] Zhankun Tang commented on YARN-3854: [~templedf], thanks for pointing out the extra efforts of "docker

[jira] [Comment Edited] (YARN-3854) Add localization support for docker images

2016-07-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387117#comment-15387117 ] Zhankun Tang edited comment on YARN-3854 at 7/21/16 4:08 AM: -

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-07-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387117#comment-15387117 ] Zhankun Tang commented on YARN-3854: [~shaneku...@gmail.com], thanks and I totally agree with your

[jira] [Updated] (YARN-5360) Decouple host user and Docker container user

2016-07-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-5360: --- Description: There is *a dependency between job submitting user and the user in the Docker image* in

[jira] [Updated] (YARN-5360) Decouple host user and Docker container user

2016-07-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-5360: --- Description: There is *a dependency between job submitting user and the user in the Docker image* in

[jira] [Commented] (YARN-5360) Decouple host user and Docker container user

2016-07-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15381650#comment-15381650 ] Zhankun Tang commented on YARN-5360: Change the title from "use UID .." to "Decouple host user and

[jira] [Updated] (YARN-5360) Decouple host user and Docker container user

2016-07-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-5360: --- Summary: Decouple host user and Docker container user (was: Use UID instead of user name to build the

[jira] [Created] (YARN-5394) Correct the wrong file name when mounting /etc/passwd to Docker Container

2016-07-17 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-5394: -- Summary: Correct the wrong file name when mounting /etc/passwd to Docker Container Key: YARN-5394 URL: https://issues.apache.org/jira/browse/YARN-5394 Project: Hadoop

[jira] [Updated] (YARN-5394) Correct the wrong file name when mounting /etc/passwd to Docker Container

2016-07-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-5394: --- Attachment: YARN-5394-branch-2.8.001.patch Patch attached > Correct the wrong file name when mounting

[jira] [Updated] (YARN-3854) Add localization support for docker images

2016-07-05 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-3854: --- Attachment: YARN-3854-branch-2.8.001.patch draft version patch for your review. > Add localization

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-07-05 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363663#comment-15363663 ] Zhankun Tang commented on YARN-3854: [~sidharta-s], [~templedf], [~hex108], [~zyluo], I have

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-07-05 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363674#comment-15363674 ] Zhankun Tang commented on YARN-3854: One more thing to note that is this patch needs a config in

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-08-04 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15408801#comment-15408801 ] Zhankun Tang commented on YARN-3854: [~vvasudev], Yes. Proposal is in progress > Add localization

[jira] [Commented] (YARN-5459) Add support for docker rm

2016-08-02 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403467#comment-15403467 ] Zhankun Tang commented on YARN-5459: The container-executor seems always execute "docker rm" after

[jira] [Commented] (YARN-5428) Allow for specifying the docker client configuration directory

2016-08-02 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403503#comment-15403503 ] Zhankun Tang commented on YARN-5428: thanks for the patch, [~shaneku...@gmail.com]. Looks good to me.

[jira] [Updated] (YARN-5394) Remove bind-mount /etc/passwd to Docker Container

2016-08-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-5394: --- Attachment: YARN-5394.003.patch generated based on trunk > Remove bind-mount /etc/passwd to Docker

[jira] [Comment Edited] (YARN-5394) Remove bind-mount /etc/passwd to Docker Container

2016-08-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403368#comment-15403368 ] Zhankun Tang edited comment on YARN-5394 at 8/2/16 5:14 AM: generated against

[jira] [Commented] (YARN-5394) Remove bind-mount /etc/passwd to Docker Container

2016-08-02 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403477#comment-15403477 ] Zhankun Tang commented on YARN-5394: Seems unrelated unit test failed. Please review > Remove

[jira] [Comment Edited] (YARN-5428) Allow for specifying the docker client configuration directory

2016-08-02 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403503#comment-15403503 ] Zhankun Tang edited comment on YARN-5428 at 8/2/16 7:29 AM: Thanks for the

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-08-02 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403564#comment-15403564 ] Zhankun Tang commented on YARN-3854: Yes. It seems that our direction is towards "docker pull" during

[jira] [Commented] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-08-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15422307#comment-15422307 ] Zhankun Tang commented on YARN-4266: [~sidharta-s], Any progress/update on this? We would like to help

[jira] [Commented] (YARN-6043) [HDL] Tensorflow on YARN

2017-01-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837238#comment-15837238 ] Zhankun Tang commented on YARN-6043: [~zhz], Yes. Thanks for mentioning that. We'll update the design

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-09-05 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465230#comment-15465230 ] Zhankun Tang commented on YARN-3854: [~vvasudev], thanks for the review. Yes. I want to go ahead and

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-08-31 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454397#comment-15454397 ] Zhankun Tang commented on YARN-3854: We need to delete the application scoped Docker image in local

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-09-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454438#comment-15454438 ] Zhankun Tang commented on YARN-3854: [~templedf], Thanks for the review. My current plan is that we

[jira] [Commented] (YARN-5428) Allow for specifying the docker client configuration directory

2016-08-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451008#comment-15451008 ] Zhankun Tang commented on YARN-5428: [~shaneku...@gmail.com], thanks for the proposal. Just one

[jira] [Comment Edited] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522238#comment-15522238 ] Zhankun Tang edited comment on YARN-4266 at 9/26/16 8:47 AM: - A patch based on

[jira] [Created] (YARN-5669) Add support for Docker pull

2016-09-26 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-5669: -- Summary: Add support for Docker pull Key: YARN-5669 URL: https://issues.apache.org/jira/browse/YARN-5669 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5671) Add support for Docker image clean up

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522471#comment-15522471 ] Zhankun Tang commented on YARN-5671: Sorry for the duplicate due to the bad network. Close this. > Add

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522477#comment-15522477 ] Zhankun Tang commented on YARN-3854: Thanks a lot. Shane. > Add localization support for docker images

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522476#comment-15522476 ] Zhankun Tang commented on YARN-3854: I have created two sub-tasks which is YARN-5669 and YARN-5670.

[jira] [Created] (YARN-5671) Add support for Docker image clean up

2016-09-26 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-5671: -- Summary: Add support for Docker image clean up Key: YARN-5671 URL: https://issues.apache.org/jira/browse/YARN-5671 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-4266: --- Attachment: YARN-4266-branch-2.8.001.patch A patch based on branch-2.8 for your reference. Will add

[jira] [Comment Edited] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522238#comment-15522238 ] Zhankun Tang edited comment on YARN-4266 at 9/26/16 6:51 AM: - A patch based on

[jira] [Updated] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-09-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-4266: --- Attachment: YARN-4266_Allow_whitelisted_users_to_disable_user_re-mapping_v2.pdf Based on testings,

[jira] [Commented] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-09-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498501#comment-15498501 ] Zhankun Tang commented on YARN-4266: Thanks for the review and poiting out the GID thing. [~templedf].

[jira] [Updated] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-09-07 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-4266: --- Attachment: YARN-4266_Allow_whitelisted_users_to_disable_user_re-mapping.pdf A draft proposal

[jira] [Assigned] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-08-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang reassigned YARN-4266: -- Assignee: Zhankun Tang (was: Sidharta Seethana) > Allow whitelisted users to disable user

[jira] [Commented] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-08-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425829#comment-15425829 ] Zhankun Tang commented on YARN-4266: Not yet. I'll submit the proposal asap. Thanks. > Allow

[jira] [Commented] (YARN-5428) Allow for specifying the docker client configuration directory

2016-08-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1543#comment-1543 ] Zhankun Tang commented on YARN-5428: Exposing the admin settings in this config file seems

[jira] [Resolved] (YARN-5360) Decouple host user and Docker container user

2016-09-27 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved YARN-5360. Resolution: Duplicate Close this as we'll implement it on YARN-4266 > Decouple host user and Docker

[jira] [Updated] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-4266: --- Attachment: YARN-4266_Allow_whitelisted_users_to_disable_user_re-mapping_v3.pdf Updated the

[jira] [Resolved] (YARN-5671) Add support for Docker image clean up

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved YARN-5671. Resolution: Duplicate > Add support for Docker image clean up >

[jira] [Created] (YARN-5670) Add support for Docker image clean up

2016-09-26 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-5670: -- Summary: Add support for Docker image clean up Key: YARN-5670 URL: https://issues.apache.org/jira/browse/YARN-5670 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-11-14 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666332#comment-15666332 ] Zhankun Tang commented on YARN-4266: [~sidharta-s], Great thanks for reviewing this! {quote} Like I

[jira] [Comment Edited] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-11-14 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666332#comment-15666332 ] Zhankun Tang edited comment on YARN-4266 at 11/15/16 7:22 AM: -- [~sidharta-s],

[jira] [Updated] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-11-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-4266: --- Attachment: YARN-4266.001.patch > Allow whitelisted users to disable user re-mapping/squashing when

[jira] [Commented] (YARN-5669) Add support for Docker pull

2016-11-15 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15668968#comment-15668968 ] Zhankun Tang commented on YARN-5669: [~sidharta-s], The YARN-3854, YARN-5669 and YARN-5670 are the

[jira] [Commented] (YARN-5258) Document Use of Docker with LinuxContainerExecutor

2016-11-03 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631973#comment-15631973 ] Zhankun Tang commented on YARN-5258: +1 Great thanks for the excellent patch, Daniel! Some tips: " A

[jira] [Commented] (YARN-5428) Allow for specifying the docker client configuration directory

2016-10-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15608044#comment-15608044 ] Zhankun Tang commented on YARN-5428: Do you mean that the community won't be interested on Docker/YARN

[jira] [Commented] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15581196#comment-15581196 ] Zhankun Tang commented on YARN-4266: [~sidharta-s] Although we can alleviate it by "find / -user -exec

[jira] [Updated] (YARN-6043) [HDL] Tensorflow on YARN

2016-12-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-6043: --- Attachment: TensorFlow_on_YARN_design.pdf > [HDL] Tensorflow on YARN > > >

  1   2   3   4   5   6   7   8   9   10   >