Re: [DISCUSS] Deprecating and removing DockerContainerExecutor

2016-10-12 Thread Sidharta Seethana
Apologies for the late response, Karthik. +1 on removing it. Especially given all the work going on related to YARN-3611. -Sidharta. On Wed, Oct 12, 2016 at 5:53 PM, Tsuyoshi Ozawa wrote: > +1, > > IMO, it's okay remove. I've not heard that it's used in production. > > Thanks, > - Tsuyoshi > >

[jira] [Created] (YARN-5596) TestDockerContainerRuntime fails on the mac

2016-08-30 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-5596: --- Summary: TestDockerContainerRuntime fails on the mac Key: YARN-5596 URL: https://issues.apache.org/jira/browse/YARN-5596 Project: Hadoop YARN Issue

[jira] [Created] (YARN-5704) Provide config knobs to control enabling/disabling new/work in progress features in container-executor

2016-10-03 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-5704: --- Summary: Provide config knobs to control enabling/disabling new/work in progress features in container-executor Key: YARN-5704 URL: https://issues.apache.org/jira/browse

[jira] [Created] (YARN-5717) Add tests for container-executor's is_feature_enabled function

2016-10-09 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-5717: --- Summary: Add tests for container-executor's is_feature_enabled function Key: YARN-5717 URL: https://issues.apache.org/jira/browse/YARN-5717 Project: H

[jira] [Created] (YARN-5822) Log ContainerRuntime initialization error in LinuxContainerExecutor

2016-11-02 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-5822: --- Summary: Log ContainerRuntime initialization error in LinuxContainerExecutor Key: YARN-5822 URL: https://issues.apache.org/jira/browse/YARN-5822 Project

[jira] [Created] (YARN-4553) Add cgroups support for docker containers

2016-01-06 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4553: --- Summary: Add cgroups support for docker containers Key: YARN-4553 URL: https://issues.apache.org/jira/browse/YARN-4553 Project: Hadoop YARN Issue Type

[jira] [Created] (YARN-4578) Directories that are mounted in docker containers need to be more restrictive/container-specific

2016-01-11 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4578: --- Summary: Directories that are mounted in docker containers need to be more restrictive/container-specific Key: YARN-4578 URL: https://issues.apache.org/jira/browse/YARN

[jira] [Created] (YARN-4643) Container recovery is broken with delegating container runtime

2016-01-26 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4643: --- Summary: Container recovery is broken with delegating container runtime Key: YARN-4643 URL: https://issues.apache.org/jira/browse/YARN-4643 Project: Hadoop

[jira] [Created] (YARN-4649) Add additional logging to some NM state store operations

2016-01-27 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4649: --- Summary: Add additional logging to some NM state store operations Key: YARN-4649 URL: https://issues.apache.org/jira/browse/YARN-4649 Project: Hadoop YARN

[jira] [Created] (YARN-4655) Log uncaught exceptions/errors in various thread pools in the nodemanger

2016-01-28 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4655: --- Summary: Log uncaught exceptions/errors in various thread pools in the nodemanger Key: YARN-4655 URL: https://issues.apache.org/jira/browse/YARN-4655 Project

[jira] [Created] (YARN-4669) Fix logging statements in resource manager's Application class

2016-02-03 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4669: --- Summary: Fix logging statements in resource manager's Application class Key: YARN-4669 URL: https://issues.apache.org/jira/browse/YARN-4669 Project: H

[jira] [Created] (YARN-3851) Add support for container runtimes in YARN

2015-06-25 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3851: --- Summary: Add support for container runtimes in YARN Key: YARN-3851 URL: https://issues.apache.org/jira/browse/YARN-3851 Project: Hadoop YARN Issue

[jira] [Created] (YARN-3852) Add docker container support to container-executor

2015-06-25 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3852: --- Summary: Add docker container support to container-executor Key: YARN-3852 URL: https://issues.apache.org/jira/browse/YARN-3852 Project: Hadoop YARN

[jira] [Created] (YARN-3853) Add docker container runtime support to LinuxContainterExecutor

2015-06-25 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3853: --- Summary: Add docker container runtime support to LinuxContainterExecutor Key: YARN-3853 URL: https://issues.apache.org/jira/browse/YARN-3853 Project: Hadoop

[jira] [Created] (YARN-3854) Add localization support for docker images

2015-06-25 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3854: --- Summary: Add localization support for docker images Key: YARN-3854 URL: https://issues.apache.org/jira/browse/YARN-3854 Project: Hadoop YARN Issue

[jira] [Resolved] (YARN-3851) Add support for container runtimes in YARN

2015-07-27 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana resolved YARN-3851. - Resolution: Fixed Release Note: Support for this was added as part of YARN-3853 . It

[jira] [Created] (YARN-4245) Clean up container-executor invocation interface

2015-10-09 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4245: --- Summary: Clean up container-executor invocation interface Key: YARN-4245 URL: https://issues.apache.org/jira/browse/YARN-4245 Project: Hadoop YARN

[jira] [Created] (YARN-4252) Log container-executor invocation details when exit code is non-zero

2015-10-11 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4252: --- Summary: Log container-executor invocation details when exit code is non-zero Key: YARN-4252 URL: https://issues.apache.org/jira/browse/YARN-4252 Project

[jira] [Created] (YARN-4253) Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor

2015-10-11 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4253: --- Summary: Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor Key: YARN-4253 URL: https://issues.apache.org

[jira] [Created] (YARN-4255) container-executor does not clean up docker operation command files.

2015-10-12 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4255: --- Summary: container-executor does not clean up docker operation command files. Key: YARN-4255 URL: https://issues.apache.org/jira/browse/YARN-4255 Project

[jira] [Created] (YARN-4258) Add support for controlling capabilities for docker containers

2015-10-13 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4258: --- Summary: Add support for controlling capabilities for docker containers Key: YARN-4258 URL: https://issues.apache.org/jira/browse/YARN-4258 Project: Hadoop

[jira] [Created] (YARN-4262) Allow admins to run privileged docker containers.

2015-10-14 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4262: --- Summary: Allow admins to run privileged docker containers. Key: YARN-4262 URL: https://issues.apache.org/jira/browse/YARN-4262 Project: Hadoop YARN

[jira] [Created] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2015-10-15 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4266: --- Summary: Allow whitelisted users to disable user re-mapping/squashing when launching docker containers Key: YARN-4266 URL: https://issues.apache.org/jira/browse/YARN-4266

[jira] [Created] (YARN-4267) Add additional logging to container-executor

2015-10-15 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4267: --- Summary: Add additional logging to container-executor Key: YARN-4267 URL: https://issues.apache.org/jira/browse/YARN-4267 Project: Hadoop YARN Issue

[jira] [Created] (YARN-4268) git pull failures in YARN precommit builds

2015-10-15 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4268: --- Summary: git pull failures in YARN precommit builds Key: YARN-4268 URL: https://issues.apache.org/jira/browse/YARN-4268 Project: Hadoop YARN Issue

[jira] [Created] (YARN-4749) Generalize config file handling in container-executor

2016-02-29 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4749: --- Summary: Generalize config file handling in container-executor Key: YARN-4749 URL: https://issues.apache.org/jira/browse/YARN-4749 Project: Hadoop YARN

[jira] [Created] (YARN-4759) Revisit signalContainer() for docker containers

2016-03-03 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4759: --- Summary: Revisit signalContainer() for docker containers Key: YARN-4759 URL: https://issues.apache.org/jira/browse/YARN-4759 Project: Hadoop YARN

[jira] [Created] (YARN-4782) Change signal container invocation to use a command/config file mechanism

2016-03-08 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4782: --- Summary: Change signal container invocation to use a command/config file mechanism Key: YARN-4782 URL: https://issues.apache.org/jira/browse/YARN-4782 Project

[jira] [Created] (YARN-5040) CPU Isolation with CGroups triggers kernel panics on Centos 7.1/7.2 when yarn.nodemanager.resource.percentage-physical-cpu-limit < 100

2016-05-04 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-5040: --- Summary: CPU Isolation with CGroups triggers kernel panics on Centos 7.1/7.2 when yarn.nodemanager.resource.percentage-physical-cpu-limit < 100 Key: YARN-5040 URL: ht

[jira] [Created] (YARN-5074) RM cycles through container ids for an app that is waiting for resources.

2016-05-11 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-5074: --- Summary: RM cycles through container ids for an app that is waiting for resources. Key: YARN-5074 URL: https://issues.apache.org/jira/browse/YARN-5074 Project

[jira] [Created] (YARN-3221) Applications should be able to 're-register'

2015-02-18 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3221: --- Summary: Applications should be able to 're-register' Key: YARN-3221 URL: https://issues.apache.org/jira/browse/YARN-3221 Project: Hadoop YARN

[jira] [Created] (YARN-3365) Add support for using the 'tc' tool via container-executor

2015-03-18 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3365: --- Summary: Add support for using the 'tc' tool via container-executor Key: YARN-3365 URL: https://issues.apache.org/jira/browse/YARN-3365 Project: H

[jira] [Created] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-03-18 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3366: --- Summary: Outbound network bandwidth : classify/shape traffic originating from YARN containers Key: YARN-3366 URL: https://issues.apache.org/jira/browse/YARN-3366

[jira] [Created] (YARN-3443) Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

2015-04-02 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3443: --- Summary: Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM Key: YARN-3443 URL: https://issues.apache.org/jira/b

[jira] [Created] (YARN-3462) Patches applied for YARN-2424 are inconsistent between trunk and branch-2

2015-04-07 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3462: --- Summary: Patches applied for YARN-2424 are inconsistent between trunk and branch-2 Key: YARN-3462 URL: https://issues.apache.org/jira/browse/YARN-3462 Project

[jira] [Created] (YARN-3531) Make "good" local directories available to ContainerExecutors at initialization time

2015-04-22 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3531: --- Summary: Make "good" local directories available to ContainerExecutors at initialization time Key: YARN-3531 URL: https://issues.apache.org/jira/browse

[jira] [Created] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-04-24 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3542: --- Summary: Re-factor support for CPU as a resource using the new ResourceHandler mechanism Key: YARN-3542 URL: https://issues.apache.org/jira/browse/YARN-3542

[jira] [Created] (YARN-3611) Support Docker Containers In LinuxContainerExecutor

2015-05-08 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3611: --- Summary: Support Docker Containers In LinuxContainerExecutor Key: YARN-3611 URL: https://issues.apache.org/jira/browse/YARN-3611 Project: Hadoop YARN

[jira] [Created] (YARN-3648) ContainerExecutor interface methods are too brittle

2015-05-14 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3648: --- Summary: ContainerExecutor interface methods are too brittle Key: YARN-3648 URL: https://issues.apache.org/jira/browse/YARN-3648 Project: Hadoop YARN

[jira] [Created] (YARN-3684) Change ContainerExecutor's primary lifecycle methods to use a more extensible mechanism for passing information.

2015-05-19 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3684: --- Summary: Change ContainerExecutor's primary lifecycle methods to use a more extensible mechanism for passing information. Key: YARN-3684 URL: https://issues.apach

[jira] [Created] (YARN-2653) Support an AM liveness mechanism that works for both sync/async AM-RM clients

2014-10-07 Thread sidharta seethana (JIRA)
sidharta seethana created YARN-2653: --- Summary: Support an AM liveness mechanism that works for both sync/async AM-RM clients Key: YARN-2653 URL: https://issues.apache.org/jira/browse/YARN-2653

[jira] [Created] (YARN-2826) User-Group mappings not updated by RM when a user is removed from a group.

2014-11-06 Thread sidharta seethana (JIRA)
sidharta seethana created YARN-2826: --- Summary: User-Group mappings not updated by RM when a user is removed from a group. Key: YARN-2826 URL: https://issues.apache.org/jira/browse/YARN-2826 Project