[jira] [Commented] (YARN-5592) Add support for dynamic resource updates with multiple resource types

2018-01-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344532#comment-16344532 ] Varun Vasudev commented on YARN-5592: - [~maniraj...@gmail.com] - this ticket was created to extend

[jira] [Assigned] (YARN-5592) Add support for dynamic resource updates with multiple resource types

2018-01-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reassigned YARN-5592: --- Assignee: Manikandan R (was: Varun Vasudev) > Add support for dynamic resource updates with

[jira] [Assigned] (YARN-5590) Add support for increase and decrease of container resources with resource profiles

2018-01-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reassigned YARN-5590: --- Assignee: Manikandan R (was: Varun Vasudev) > Add support for increase and decrease of

[jira] [Commented] (YARN-5590) Add support for increase and decrease of container resources with resource profiles

2018-01-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344526#comment-16344526 ] Varun Vasudev commented on YARN-5590: - [~maniraj...@gmail.com] - please feel free to take it up. This

[jira] [Commented] (YARN-7430) Enable user re-mapping for Docker containers by default

2017-11-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262784#comment-16262784 ] Varun Vasudev commented on YARN-7430: - Backported to branch-3.0.0. Thanks for the quick repsonse

[jira] [Updated] (YARN-7430) Enable user re-mapping for Docker containers by default

2017-11-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-7430: Fix Version/s: (was: 3.0.1) 3.0.0 > Enable user re-mapping for Docker

[jira] [Commented] (YARN-7430) Enable user re-mapping for Docker containers by default

2017-11-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262435#comment-16262435 ] Varun Vasudev commented on YARN-7430: - [~andrew.wang] - given that you're cutting a new RC for 3.0 , do

[jira] [Updated] (YARN-7430) Enable user re-mapping for Docker containers by default

2017-11-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-7430: Summary: Enable user re-mapping for Docker containers by default (was: User and Group mapping are

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255005#comment-16255005 ] Varun Vasudev commented on YARN-7430: - Looks like we have consensus of making uid:gid the default

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-13 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250879#comment-16250879 ] Varun Vasudev commented on YARN-7430: - I'm fine with it. [~ebadger] - does it sounds ok to you? > User

[jira] [Commented] (YARN-7361) Improve the docker container runtime documentation

2017-11-13 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250865#comment-16250865 ] Varun Vasudev commented on YARN-7361: - +1 - I'll commit this tomorrow if no one objects. > Improve

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241947#comment-16241947 ] Varun Vasudev commented on YARN-7430: - [~eyang] - can you modify your path slightly - if the user is

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-06 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240104#comment-16240104 ] Varun Vasudev commented on YARN-7430: - [~shaneku...@gmail.com], [~ebadger] - any objections to turning

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-11-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Release Note: A change in configuration for launching Docker containers under YARN. Docker container

[jira] [Commented] (YARN-6930) Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager

2017-10-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225289#comment-16225289 ] Varun Vasudev commented on YARN-6930: - [~djp], this change turns off the Docker runtime by default. It

[jira] [Commented] (YARN-6930) Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager

2017-10-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225117#comment-16225117 ] Varun Vasudev commented on YARN-6930: - [~jlowe]/[~shaneku...@gmail.com] - should this be marked as an

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) > Add support to turn off launching

[jira] [Commented] (YARN-7376) YARN top ACLs

2017-10-24 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218080#comment-16218080 ] Varun Vasudev commented on YARN-7376: - [~jhung] -- this is implemented on the client side. The user can

[jira] [Commented] (YARN-7353) Docker permitted volumes don't properly check for directories

2017-10-23 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16216291#comment-16216291 ] Varun Vasudev commented on YARN-7353: - [~eyang] - can you please cherry-pick this patch to branch-3 and

[jira] [Commented] (YARN-7353) Docker permitted volumes don't properly check for directories

2017-10-18 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16210587#comment-16210587 ] Varun Vasudev commented on YARN-7353: - Thanks for the patch [~ebadger]. A couple of tests still fail on

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-17 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207265#comment-16207265 ] Varun Vasudev commented on YARN-6623: - [~leftnoteasy] - can you take a look at the branch-2 patch

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-17 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16207264#comment-16207264 ] Varun Vasudev commented on YARN-6623: - [~eyang] - the tests did run as part of the trunk pre-commit

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623-branch-2.015.patch New version(branch-2.015.patch) with compile fix. > Add

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623-branch-2.014.patch Uploaded a new version of the branch-2 patch to fix the

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623-branch-2.013.patch Attached a patch for branch-2. > Add support to turn off

[jira] [Commented] (YARN-5589) Update CapacitySchedulerConfiguration minimum and maximum calculations to consider all resource types

2017-10-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205236#comment-16205236 ] Varun Vasudev commented on YARN-5589: - [~lovekesh.bansal] - please feel free to take it over. > Update

[jira] [Assigned] (YARN-5589) Update CapacitySchedulerConfiguration minimum and maximum calculations to consider all resource types

2017-10-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reassigned YARN-5589: --- Assignee: (was: Varun Vasudev) > Update CapacitySchedulerConfiguration minimum and

[jira] [Commented] (YARN-7321) Backport container-executor changes from YARN-6852 to branch-2

2017-10-13 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203108#comment-16203108 ] Varun Vasudev commented on YARN-7321: - Thank for the review [~leftnoteasy]! I've verified that the

[jira] [Commented] (YARN-4943) Add support to collect actual resource usage from cgroups

2017-10-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203066#comment-16203066 ] Varun Vasudev commented on YARN-4943: - [~miklos.szeg...@cloudera.com] - please feel free to take it

[jira] [Assigned] (YARN-4943) Add support to collect actual resource usage from cgroups

2017-10-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reassigned YARN-4943: --- Assignee: (was: Varun Vasudev) > Add support to collect actual resource usage from

[jira] [Commented] (YARN-7321) Backport container-executor changes from YARN-6852 to branch-2

2017-10-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202339#comment-16202339 ] Varun Vasudev commented on YARN-7321: - [~wangda] - can you please take a look? Thanks! > Backport

[jira] [Updated] (YARN-7321) Backport container-executor changes from YARN-6852 to branch-2

2017-10-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-7321: Attachment: YARN-7321-branch-2.001.patch Attached a branch-2 version of the patch. It just drops all

[jira] [Created] (YARN-7321) Backport container-executor changes from YARN-6852 to branch-2

2017-10-12 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-7321: --- Summary: Backport container-executor changes from YARN-6852 to branch-2 Key: YARN-7321 URL: https://issues.apache.org/jira/browse/YARN-7321 Project: Hadoop YARN

[jira] [Resolved] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-10-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev resolved YARN-6852. - Resolution: Fixed > [YARN-6223] Native code changes to support isolate GPU devices by using >

[jira] [Commented] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-10-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202313#comment-16202313 ] Varun Vasudev commented on YARN-6852: - Sounds good, I'll create a new ticket for that then and close

[jira] [Reopened] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-10-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reopened YARN-6852: - [~leftnoteasy] - Any objections to backporting this to branch-2? It has changes to container-executor

[jira] [Commented] (YARN-6033) Add support for sections in container-executor configuration file

2017-10-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199968#comment-16199968 ] Varun Vasudev commented on YARN-6033: - [~leftnoteasy] - do you mind committing this to branch-2?

[jira] [Commented] (YARN-7286) Add support for docker to have no capabilities

2017-10-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16199967#comment-16199967 ] Varun Vasudev commented on YARN-7286: - The none approach makes best sense to me. The

[jira] [Updated] (YARN-6033) Add support for sections in container-executor configuration file

2017-10-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6033: Attachment: YARN-6033-branch-2.014.patch Patch for branch-2. It also takes the modifications for

[jira] [Reopened] (YARN-6033) Add support for sections in container-executor configuration file

2017-10-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reopened YARN-6033: - Re-opening for branch-2 version of the patch. > Add support for sections in container-executor

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-10-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192875#comment-16192875 ] Varun Vasudev commented on YARN-6623: - {quote} There's already a config in yarn-site.xml

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185866#comment-16185866 ] Varun Vasudev commented on YARN-6623: - Thanks for the reviews [~ebadger],

[jira] [Comment Edited] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-28 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183909#comment-16183909 ] Varun Vasudev edited comment on YARN-6623 at 9/28/17 9:33 AM: -- [~andrew.wang]

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-28 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183909#comment-16183909 ] Varun Vasudev commented on YARN-6623: - [~andrew.wang] - the one thing you should be aware of is that

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.013.patch Uploaded the wrong patch file by mistake. YARN-6623.013.patch is

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: (was: YARN-6623.001.patch) > Add support to turn off launching privileged containers

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.001.patch Thanks for the review [~ebadger]. {noformat} Hey Varun Vasudev,

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-24 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.012.patch Uploaded 012.patch to fix cc and unit test issues. > Add support to

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-24 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.011.patch Uploaded a new patch (.011). It adds support for group-add and adds

[jira] [Commented] (YARN-6504) Add support for resource profiles in MapReduce

2017-09-24 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178183#comment-16178183 ] Varun Vasudev commented on YARN-6504: - I had a bunch of conversations about whether we should support

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177577#comment-16177577 ] Varun Vasudev commented on YARN-6623: - [~andrew.wang] - YARN-4266 adds a new field for the Docker

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177578#comment-16177578 ] Varun Vasudev commented on YARN-6623: - [~andrew.wang] - YARN-4266 adds a new field for the Docker

[jira] [Comment Edited] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176346#comment-16176346 ] Varun Vasudev edited comment on YARN-6623 at 9/22/17 12:41 PM: ---

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176346#comment-16176346 ] Varun Vasudev commented on YARN-6623: - [~leftnoteasy] - please don't commit the patch tomorrow. I need

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16175201#comment-16175201 ] Varun Vasudev commented on YARN-6623: - {noformat} How would you detect the condition where the

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16175181#comment-16175181 ] Varun Vasudev commented on YARN-6623: - [~djp] - makes sense to push it into 2.8.2; [~andrew.wang] -

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-20 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.010.patch Thanks for the reviews [~miklos.szeg...@cloudera.com] and

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-18 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170280#comment-16170280 ] Varun Vasudev commented on YARN-6623: - Thanks for the feedback [~miklos.szeg...@cloudera.com],

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.009.patch bq. git apply is failing for me on DockerClient.java. It looks like

[jira] [Comment Edited] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157018#comment-16157018 ] Varun Vasudev edited comment on YARN-6623 at 9/7/17 2:37 PM: - bq. git apply is

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-04 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.008.patch {noformat} int is_docker_support_enabled() { -return

[jira] [Commented] (YARN-6504) Add support for resource profiles in MapReduce

2017-08-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147550#comment-16147550 ] Varun Vasudev commented on YARN-6504: - bq. Any progress on this? Sorry for the late reply [~templedf].

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.007.patch Thanks for the additional feedback [~ebadger] and [~leftnoteasy]!

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-24 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.006.patch Thank you for the review [~ebadger]! bq. Should we fix the no

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135245#comment-16135245 ] Varun Vasudev commented on YARN-6623: - {quote} #define EXECUTOR_PATH_MAX 131072 This is lots

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.005.patch New patch uploaded after rebasing to trunk. > Add support to turn

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.004.patch Thanks for the review [~miklos.szeg...@cloudera.com]! {quote}

[jira] [Commented] (YARN-6804) Allow custom hostname for docker containers in native services

2017-08-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128425#comment-16128425 ] Varun Vasudev commented on YARN-6804: - I would like to get this into 2.8 as well please. There's some

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.003.patch Uploaded 003.patch which fixes the failing cetest tests and has some

[jira] [Commented] (YARN-6804) Allow custom hostname for docker containers in native services

2017-08-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128329#comment-16128329 ] Varun Vasudev commented on YARN-6804: - [~jianhe] - can you backport the NM pieces to branch-2 and

[jira] [Commented] (YARN-6988) container-executor fails for docker when command length > 4096 B

2017-08-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128325#comment-16128325 ] Varun Vasudev commented on YARN-6988: - Sounds good [~ebadger]. > container-executor fails for docker

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.002.patch Uploaded a new patch to fix the test failures and findbugs warnings.

[jira] [Commented] (YARN-6988) container-executor fails for docker when command length > 4096 B

2017-08-14 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16125926#comment-16125926 ] Varun Vasudev commented on YARN-6988: - [~ebadger] - I'm increasing the EXECUTOR_PATH_MAX to 128K as

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-14 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.001.patch First cut of the patch. It's big because it moves a bunch of

[jira] [Commented] (YARN-6789) new api to get all supported resources from RM

2017-08-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123385#comment-16123385 ] Varun Vasudev commented on YARN-6789: - Strongly disagree with not having units. Today if a cluster

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-08-09 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119924#comment-16119924 ] Varun Vasudev commented on YARN-5534: - It's going to end up being a combination. Some settings have to

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16116129#comment-16116129 ] Varun Vasudev commented on YARN-6623: - To fix this, we need support for sections provided by YARN-6033.

[jira] [Commented] (YARN-4081) Add support for multiple resource types in the Resource class

2017-08-03 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112305#comment-16112305 ] Varun Vasudev commented on YARN-4081: - The reason I added units was primarily to allow the NMs, the RMs

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-03 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112271#comment-16112271 ] Varun Vasudev commented on YARN-6623: - Just to note - we should document this in the release notes

[jira] [Commented] (YARN-6033) Add support for sections in container-executor configuration file

2017-08-03 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112257#comment-16112257 ] Varun Vasudev commented on YARN-6033: - {quote} How about the name? I think we should should call trim

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-08-02 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110834#comment-16110834 ] Varun Vasudev commented on YARN-5534: - bq. Thank you for the patch Shane Kumpf. Quick question, should

[jira] [Updated] (YARN-6033) Add support for sections in container-executor configuration file

2017-08-02 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6033: Attachment: YARN-6033.007.patch bq. is_section_start_line and get_section_name should handle leading

[jira] [Updated] (YARN-6033) Add support for sections in container-executor configuration file

2017-07-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6033: Attachment: YARN-6033.006.patch Uploaded a new patch to fix the compilation error. > Add support

[jira] [Updated] (YARN-6033) Add support for sections in container-executor configuration file

2017-07-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6033: Attachment: YARN-6033.005.patch Thanks for the feedback [~wangda]! 1) I've added a null check in

[jira] [Commented] (YARN-6805) NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code

2017-07-13 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16085466#comment-16085466 ] Varun Vasudev commented on YARN-6805: - Doesn't look like the findbugs warnings are related to the

[jira] [Updated] (YARN-6033) Add support for sections in container-executor configuration file

2017-07-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6033: Attachment: YARN-6033.004.patch Uploaded a new patch to fix whitespace issue. > Add support for

[jira] [Updated] (YARN-6033) Add support for sections in container-executor configuration file

2017-07-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6033: Attachment: YARN-6033.003.patch Thanks for the reviews [~sunil.gov...@gmail.com], [~leftnoteasy]!

[jira] [Commented] (YARN-6761) Fix build for YARN-3926 branch

2017-07-03 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16072245#comment-16072245 ] Varun Vasudev commented on YARN-6761: - Since YARN-3926 is already broken, the pre-commit build the

[jira] [Updated] (YARN-6761) Fix build for YARN-3926 branch

2017-07-03 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6761: Attachment: YARN-6761-YARN-3926.001.patch This patch addresses the build break. I've kept it simple

[jira] [Created] (YARN-6761) Fix build for YARN-3926 branch

2017-07-03 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-6761: --- Summary: Fix build for YARN-3926 branch Key: YARN-6761 URL: https://issues.apache.org/jira/browse/YARN-6761 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-6630) Container worker dir could not recover when NM restart

2017-06-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045900#comment-16045900 ] Varun Vasudev commented on YARN-6630: - Assigned issue to [~fly_in_gis] and kicked off another Jenkins

[jira] [Assigned] (YARN-6630) Container worker dir could not recover when NM restart

2017-06-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reassigned YARN-6630: --- Assignee: Yang Wang > Container worker dir could not recover when NM restart >

[jira] [Commented] (YARN-6366) Refactor the NodeManager DeletionService to support additional DeletionTask types.

2017-05-26 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025911#comment-16025911 ] Varun Vasudev commented on YARN-6366: - [~shaneku...@gmail.com] - the patch doesn't compile cleanly on

[jira] [Commented] (YARN-6366) Refactor the NodeManager DeletionService to support additional DeletionTask types.

2017-05-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019584#comment-16019584 ] Varun Vasudev commented on YARN-6366: - +1 for the latest patch. I'll commit this tomorrow if no one

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-05-18 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16015582#comment-16015582 ] Varun Vasudev commented on YARN-6622: - [~chris.douglas], [~templedf], [~sidharta-s],

[jira] [Updated] (YARN-6622) Document Docker work as experimental

2017-05-18 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6622: Attachment: YARN-6622.001.patch > Document Docker work as experimental >

[jira] [Updated] (YARN-6622) Document Docker work as experimental

2017-05-18 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6622: Component/s: documentation > Document Docker work as experimental >

[jira] [Created] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-05-18 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-6623: --- Summary: Add support to turn off launching privileged containers in the container-executor Key: YARN-6623 URL: https://issues.apache.org/jira/browse/YARN-6623 Project:

[jira] [Created] (YARN-6622) Document Docker work as experimental

2017-05-18 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-6622: --- Summary: Document Docker work as experimental Key: YARN-6622 URL: https://issues.apache.org/jira/browse/YARN-6622 Project: Hadoop YARN Issue Type: Task

[jira] [Commented] (YARN-6366) Refactor the NodeManager DeletionService to support additional DeletionTask types.

2017-05-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16006699#comment-16006699 ] Varun Vasudev commented on YARN-6366: - bq. Regarding #4) Moving the conversion methods into ProtoUtils

  1   2   3   4   5   6   7   8   9   10   >