[jira] [Commented] (YARN-8833) compute shares may lock the scheduling process

2018-11-03 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673963#comment-16673963 ] Zhankun Tang commented on YARN-8833: [~cheersyang] , Could you please help to grant contributor

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8960: --- Description: +underlined text+After submitting a submarine job, we tried to get service status using

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8960: --- Description: After submitting a submarine job, we tried to get service status using the following

[jira] [Comment Edited] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-11-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16672547#comment-16672547 ] Zhankun Tang edited comment on YARN-7277 at 11/2/18 4:06 AM: - [~cheersyang].

[jira] [Commented] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-11-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16672547#comment-16672547 ] Zhankun Tang commented on YARN-7277: [~cheersyang]. The error output is quit weird. And output is

[jira] [Comment Edited] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-11-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16672547#comment-16672547 ] Zhankun Tang edited comment on YARN-7277 at 11/2/18 4:05 AM: - [~cheersyang].

[jira] [Updated] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-11-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-7277: --- Attachment: YARN-7277-trunk.005.patch > Container Launch expand environment needs to consider bracket

[jira] [Commented] (YARN-6729) Clarify documentation on how to enable cgroup support

2018-11-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671362#comment-16671362 ] Zhankun Tang commented on YARN-6729: [~shaneku...@gmail.com] , Yeah. Agree. Thanks! > Clarify

[jira] [Updated] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-10-31 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-7277: --- Attachment: YARN-7277-trunk.004.patch > Container Launch expand environment needs to consider bracket

[jira] [Commented] (YARN-8957) Add Serializable interface to ComponentContainers

2018-10-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669411#comment-16669411 ] Zhankun Tang commented on YARN-8957: [~csingh] . Thanks for the review and share its original JIRA! >

[jira] [Updated] (YARN-8957) Add Serializable interface to ComponentContainers

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8957: --- Attachment: YARN-8957-trunk.001.patch > Add Serializable interface to ComponentContainers >

[jira] [Updated] (YARN-8957) Add Serializable interface to ComponentContainers

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8957: --- Description: In YARN service API: public class ComponentContainers { private static final long

[jira] [Commented] (YARN-8957) Add Serializable interface to ComponentContainers

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668095#comment-16668095 ] Zhankun Tang commented on YARN-8957: [~aceric] , chanced to encounter this but not sure if it needs

[jira] [Created] (YARN-8957) Add Serializable interface to ComponentContainers

2018-10-29 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8957: -- Summary: Add Serializable interface to ComponentContainers Key: YARN-8957 URL: https://issues.apache.org/jira/browse/YARN-8957 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668059#comment-16668059 ] Zhankun Tang commented on YARN-8714: [~leftnoteasy] , I'd like to work on this if you're ok. >

[jira] [Updated] (YARN-8924) Refine the document or code related to Cgroups/LCE

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8924: --- Description: This is to re-think the legacy configuration/code of Cgroups in YARN like CPU resource

[jira] [Commented] (YARN-6729) NM percentage-physical-cpu-limit should be always 100 if DefaultLCEResourcesHandler is used

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668053#comment-16668053 ] Zhankun Tang commented on YARN-6729: [~shaneku...@gmail.com] , Thanks for the review. Yeah. I agree

[jira] [Updated] (YARN-8924) Refine the document or code related to Cgroups/LCE

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8924: --- Description: This is to re-think the legacy configuration/code of Cgroups in YARN like CPU resource

[jira] [Updated] (YARN-8924) Refine the document or code related to Cgroups/LCE

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8924: --- Description: This is to re-think the legacy configuration/code of Cgroups in YARN like CPU resource

[jira] [Updated] (YARN-8924) Refine the document or code related to Cgroups/LCE

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8924: --- Summary: Refine the document or code related to Cgroups/LCE (was: Refine the document or code

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667341#comment-16667341 ] Zhankun Tang edited comment on YARN-8851 at 10/29/18 3:21 PM: -- Updated the

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667341#comment-16667341 ] Zhankun Tang commented on YARN-8851: Updated the patch. # Add a sanity-check to fast fail an

[jira] [Commented] (YARN-8924) Refine the document or code related to legacy CPU isolation/enforcement

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667291#comment-16667291 ] Zhankun Tang commented on YARN-8924: Thanks for the review. [~shaneku...@gmail.com] > Refine the

[jira] [Updated] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: YARN-8851-WIP8-trunk.001.patch > [Umbrella] A new pluggable device plugin framework to

[jira] [Commented] (YARN-8915) Update the doc about the default value of "maximum-container-assignments" for capacity scheduler

2018-10-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1734#comment-1734 ] Zhankun Tang commented on YARN-8915: [~cheersyang] , Thanks! > Update the doc about the default value

[jira] [Created] (YARN-8949) Document usage of "library" in "docker.trusted.repositories" to trust local image

2018-10-28 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8949: -- Summary: Document usage of "library" in "docker.trusted.repositories" to trust local image Key: YARN-8949 URL: https://issues.apache.org/jira/browse/YARN-8949 Project:

[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1323#comment-1323 ] Zhankun Tang commented on YARN-8927: {quote}There are two docker pull strategy, pull every time vs

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-27 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16665981#comment-16665981 ] Zhankun Tang edited comment on YARN-8851 at 10/27/18 8:08 AM: -- [~csingh] , 

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-27 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16665981#comment-16665981 ] Zhankun Tang commented on YARN-8851: [~csingh] ,  {quote}However, the DevicePluginAPI can have a

[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16665934#comment-16665934 ] Zhankun Tang commented on YARN-8927: [~ebadger] , Thanks for the explanation.  {quote}One minor detail

[jira] [Created] (YARN-8946) Provide a way/a tool to do vendor plugin sanity-check outside of YARN NM

2018-10-26 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8946: -- Summary: Provide a way/a tool to do vendor plugin sanity-check outside of YARN NM Key: YARN-8946 URL: https://issues.apache.org/jira/browse/YARN-8946 Project: Hadoop

[jira] [Comment Edited] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-25 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664670#comment-16664670 ] Zhankun Tang edited comment on YARN-8927 at 10/26/18 5:19 AM: -- [~eyang] ,

[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-25 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664670#comment-16664670 ] Zhankun Tang commented on YARN-8927: [~eyang] , Sorry for the misleading. I mean we do check with

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-25 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664540#comment-16664540 ] Zhankun Tang edited comment on YARN-8851 at 10/26/18 2:22 AM: -- [~csingh] ,

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-25 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664540#comment-16664540 ] Zhankun Tang edited comment on YARN-8851 at 10/26/18 2:13 AM: -- [~csingh] ,

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-25 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16664540#comment-16664540 ] Zhankun Tang commented on YARN-8851: [~csingh] , Thanks for the review! {quote}1. {code:java}

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-25 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663495#comment-16663495 ] Zhankun Tang commented on YARN-8851: Sorry that I missed your comments. Thanks [~cheersyang] . :) >

[jira] [Updated] (YARN-8884) Support NM monitoring of device resource through plugin API

2018-10-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8884: --- Description: In the current design, the device resource count is reported by plugin when NM starts 

[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663236#comment-16663236 ] Zhankun Tang commented on YARN-8927: [~eyang] , Thanks. That works. Configure like below means we

[jira] [Updated] (YARN-8884) Support NM monitoring of device resource through plugin API

2018-10-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8884: --- Summary: Support NM monitoring of device resource through plugin API (was: Support monitoring of

[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662052#comment-16662052 ] Zhankun Tang commented on YARN-8927: [~eyang] , I don't quite understand. What

[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661951#comment-16661951 ] Zhankun Tang commented on YARN-8927: [~leftnoteasy] , Yeah. I've figured out these and refine document

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661657#comment-16661657 ] Zhankun Tang edited comment on YARN-8851 at 10/24/18 3:12 AM: --

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661657#comment-16661657 ] Zhankun Tang commented on YARN-8851: [~leftnoteasy], Thanks for the review. Answer as below: {quote}1)

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660804#comment-16660804 ] Zhankun Tang edited comment on YARN-8851 at 10/23/18 3:17 PM: --

[jira] [Comment Edited] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660813#comment-16660813 ] Zhankun Tang edited comment on YARN-8927 at 10/23/18 3:16 PM: -- [~eyang],

[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660813#comment-16660813 ] Zhankun Tang commented on YARN-8927: [~eyang], Thanks for mentioning this. Is the value "libraries"

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16660804#comment-16660804 ] Zhankun Tang commented on YARN-8851: [~leftnoteasy], Agree and updated the patch. Please review: 1.

[jira] [Updated] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-23 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: YARN-8851-WIP7-trunk.001.patch > [Umbrella] A new pluggable device plugin framework to

[jira] [Updated] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8927: --- Issue Type: Improvement (was: Bug) > Better handling of "docker.trusted.registries" in

[jira] [Updated] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8927: --- Description: There are some missing cases that we need to catch when handling

[jira] [Updated] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8927: --- Description: There are some missing cases that we need to catch when handling

[jira] [Updated] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8927: --- Description: There are some missing cases that we need to catch when handling

[jira] [Updated] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8927: --- Description: There is some missing cases that we need to catch when handling

[jira] [Created] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-22 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8927: -- Summary: Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function Key: YARN-8927 URL: https://issues.apache.org/jira/browse/YARN-8927

[jira] [Updated] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: YARN-8851-WIP6-trunk.001.patch > [Umbrella] A new pluggable device plugin framework to

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658763#comment-16658763 ] Zhankun Tang commented on YARN-8851: [~leftnoteasy], [~sunilg], [~cheersyang]. Updated the patch for

[jira] [Updated] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: YARN-8851-WIP5-trunk.001.patch > [Umbrella] A new pluggable device plugin framework to

[jira] [Updated] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-10-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-7277: --- Attachment: YARN-7277-trunk.003.patch > Container Launch expand environment needs to consider bracket

[jira] [Updated] (YARN-8354) SingleConstraintAppPlacementAllocator's allocate does not decPendingResource

2018-10-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8354: --- Description: SingleConstraintAppPlacementAllocator.allocate()  does not decPendingResource,only 

[jira] [Updated] (YARN-8354) SingleConstraintAppPlacementAllocator's allocate does not decPendingResource

2018-10-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8354: --- Description: colored textSingleConstraintAppPlacementAllocator.allocate()  does not

[jira] [Updated] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-10-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-7277: --- Attachment: YARN-7277-trunk.002.patch > Container Launch expand environment needs to consider bracket

[jira] [Commented] (YARN-8688) Duplicate queue names in fair scheduler allocation file

2018-10-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658154#comment-16658154 ] Zhankun Tang commented on YARN-8688: [~shenyinjie], can you show a example of the allocation file? >

[jira] [Updated] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-10-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-7277: --- Attachment: YARN-7277-trunk.001.patch > Container Launch expand environment needs to consider bracket

[jira] [Comment Edited] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-10-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657016#comment-16657016 ] Zhankun Tang edited comment on YARN-7277 at 10/21/18 8:26 AM: -- [~balloons] ,

[jira] [Commented] (YARN-6729) NM percentage-physical-cpu-limit should be always 100 if DefaultLCEResourcesHandler is used

2018-10-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658081#comment-16658081 ] Zhankun Tang commented on YARN-6729: Updated the document of cgroups. Please review. [~cheersyang]

[jira] [Updated] (YARN-6729) NM percentage-physical-cpu-limit should be always 100 if DefaultLCEResourcesHandler is used

2018-10-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-6729: --- Attachment: YARN-6729-trunk.001.patch > NM percentage-physical-cpu-limit should be always 100 if >

[jira] [Updated] (YARN-8924) Refine the document or code related to legacy CPU isolation/enforcement

2018-10-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8924: --- Description: This is to re-think the legacy configuration/code of CPU resource isolation. In 

[jira] [Updated] (YARN-8924) Refine the document or code related to legacy CPU isolation/enforcement

2018-10-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8924: --- Description: This is to re-think the legacy configuration/code of CPU resource isolation. In 

[jira] [Updated] (YARN-8924) Refine the document or code related to legacy CPU isolation/enforcement

2018-10-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8924: --- Description: This is to re-think the legacy configuration/code of CPU resource isolation. In 

[jira] [Comment Edited] (YARN-6729) NM percentage-physical-cpu-limit should be always 100 if DefaultLCEResourcesHandler is used

2018-10-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658068#comment-16658068 ] Zhankun Tang edited comment on YARN-6729 at 10/21/18 4:55 AM: -- [~yufeigu] ,

[jira] [Commented] (YARN-6729) NM percentage-physical-cpu-limit should be always 100 if DefaultLCEResourcesHandler is used

2018-10-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658077#comment-16658077 ] Zhankun Tang commented on YARN-6729: And I create YARN-8924 for handling the legacy problem. Feel free

[jira] [Assigned] (YARN-6729) NM percentage-physical-cpu-limit should be always 100 if DefaultLCEResourcesHandler is used

2018-10-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang reassigned YARN-6729: -- Assignee: Zhankun Tang > NM percentage-physical-cpu-limit should be always 100 if >

[jira] [Comment Edited] (YARN-6729) NM percentage-physical-cpu-limit should be always 100 if DefaultLCEResourcesHandler is used

2018-10-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658068#comment-16658068 ] Zhankun Tang edited comment on YARN-6729 at 10/21/18 4:43 AM: -- [~yufeigu] ,

[jira] [Created] (YARN-8924) Refine the document or code related to legacy CPU isolation/enforcement

2018-10-20 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8924: -- Summary: Refine the document or code related to legacy CPU isolation/enforcement Key: YARN-8924 URL: https://issues.apache.org/jira/browse/YARN-8924 Project: Hadoop YARN

[jira] [Commented] (YARN-6729) NM percentage-physical-cpu-limit should be always 100 if DefaultLCEResourcesHandler is used

2018-10-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658068#comment-16658068 ] Zhankun Tang commented on YARN-6729: [~yufeigu] , Thanks for reporting this. This a legacy

[jira] [Commented] (YARN-6913) Some cgroup settings are not documented in yarn-default.xml

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657732#comment-16657732 ] Zhankun Tang commented on YARN-6913: [~miklos.szeg...@cloudera.com] , I just checked that the first

[jira] [Updated] (YARN-8918) [Submarine] Correct method usage of str.subString in CliUtils

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8918: --- Description: In CliUtils.java (line 74), there's uncorrect code block,: {code:java} if

[jira] [Updated] (YARN-8918) [Submarine] Correct method usage of str.subString(0, str.length()) in CliUtils

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8918: --- Summary: [Submarine] Correct method usage of str.subString(0, str.length()) in CliUtils (was:

[jira] [Updated] (YARN-8918) [Submarine] Correct method usage of str.subString in CliUtils

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8918: --- Summary: [Submarine] Correct method usage of str.subString in CliUtils (was: [Submarine] Correct

[jira] [Updated] (YARN-8918) [Submarine] Remove redundant method of str.subString(0, str.length())

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8918: --- Attachment: YARN-8918-trunk.003.patch > [Submarine] Remove redundant method of str.subString(0,

[jira] [Updated] (YARN-8918) [Submarine] Remove redundant method of str.subString(0, str.length())

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8918: --- Attachment: YARN-8918-trunk.002.patch > [Submarine] Remove redundant method of str.subString(0,

[jira] [Assigned] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang reassigned YARN-7277: -- Assignee: Zhankun Tang > Container Launch expand environment needs to consider bracket

[jira] [Comment Edited] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657016#comment-16657016 ] Zhankun Tang edited comment on YARN-7277 at 10/19/18 4:20 PM: -- [~balloons] ,

[jira] [Commented] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657016#comment-16657016 ] Zhankun Tang commented on YARN-7277: [~balloons] , Thanks for reporting this. I'd like to check it. >

[jira] [Commented] (YARN-8833) compute shares may lock the scheduling process

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656972#comment-16656972 ] Zhankun Tang commented on YARN-8833: [~yoelee] , could you please elaborate the problem, or how to

[jira] [Commented] (YARN-8916) Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656936#comment-16656936 ] Zhankun Tang commented on YARN-8916: [~ebadger] , Thanks for the review! > Define a constant "docker"

[jira] [Updated] (YARN-8918) [Submarine] Remove redundant method of str.subString(0, str.length())

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8918: --- Attachment: YARN-8918-trunk.001.patch > [Submarine] Remove redundant method of str.subString(0,

[jira] [Created] (YARN-8918) [Submarine] Remove redundant method of str.subString(0, str.length())

2018-10-19 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8918: -- Summary: [Submarine] Remove redundant method of str.subString(0, str.length()) Key: YARN-8918 URL: https://issues.apache.org/jira/browse/YARN-8918 Project: Hadoop YARN

[jira] [Assigned] (YARN-8918) [Submarine] Remove redundant method of str.subString(0, str.length())

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang reassigned YARN-8918: -- Assignee: Zhankun Tang > [Submarine] Remove redundant method of str.subString(0, str.length())

[jira] [Commented] (YARN-8916) Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656844#comment-16656844 ] Zhankun Tang commented on YARN-8916: Attached a patch. Please review. [~sunilg],

[jira] [Updated] (YARN-8916) Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability

2018-10-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8916: --- Attachment: YARN-8916-trunk.001.patch > Define a constant "docker" string in

[jira] [Created] (YARN-8916) Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability

2018-10-19 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8916: -- Summary: Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability Key: YARN-8916 URL: https://issues.apache.org/jira/browse/YARN-8916

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656188#comment-16656188 ] Zhankun Tang edited comment on YARN-8851 at 10/19/18 3:07 AM: -- [~leftnoteasy]

[jira] [Commented] (YARN-8915) Update "maximum-container-assignments" default value in CapacityScheduler.md

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656205#comment-16656205 ] Zhankun Tang commented on YARN-8915: [~weiweiyagn666] , Yeah. Thanks for the review. Updated the

[jira] [Updated] (YARN-8915) Update "maximum-container-assignments" default value in CapacityScheduler.md

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8915: --- Attachment: YARN-8915-trunk.002.patch > Update "maximum-container-assignments" default value in

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656188#comment-16656188 ] Zhankun Tang commented on YARN-8851: [~leftnoteasy] , a lot thanks for the offline discussion. Agreed

[jira] [Updated] (YARN-8915) Update "maximum-container-assignments" default value in CapacityScheduler.md

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8915: --- Description: Update default value of "maximum-container-assignments" from "-1" to 100. > Update

[jira] [Commented] (YARN-8915) Update "maximum-container-assignments" default value in CapacityScheduler.md

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656176#comment-16656176 ] Zhankun Tang commented on YARN-8915: [~weiweiyagn666] , please review. > Update

[jira] [Updated] (YARN-8915) Update "maximum-container-assignments" default value in CapacityScheduler.md

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8915: --- Attachment: YARN-8915-trunk.001.patch > Update "maximum-container-assignments" default value in

<    2   3   4   5   6   7   8   9   10   11   >