[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-29 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667627#comment-16667627 ] Eric Badger commented on YARN-8927: --- [~eyang], that sounds good to me. Good idea to open up separate

[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667676#comment-16667676 ] Eric Yang commented on YARN-8927: - [~ebadger] Thanks, YARN-8955 is opened for the third issue. > Better

[jira] [Updated] (YARN-8776) Container Executor change to create stdin/stdout pipeline

2018-10-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8776: Attachment: YARN-8776.004.patch > Container Executor change to create stdin/stdout pipeline >

[jira] [Updated] (YARN-8936) Update ATSv2 hbase.two.version to 2.0.2

2018-10-29 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-8936: - Attachment: YARN-8936.0002.patch > Update ATSv2 hbase.two.version to 2.0.2 >

[jira] [Commented] (YARN-8776) Container Executor change to create stdin/stdout pipeline

2018-10-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667687#comment-16667687 ] Eric Yang commented on YARN-8776: - Patch 004 fixed some checkstyle and whitespace issues. > Container

[jira] [Commented] (YARN-8954) Reservations list field in ReservationListInfo is not accessible

2018-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667633#comment-16667633 ] Hadoop QA commented on YARN-8954: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8936) Update ATSv2 hbase.two.version to 2.0.2

2018-10-29 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1666#comment-1666 ] Vrushali C commented on YARN-8936: -- Added patch for updating hbase server 1 to 1.4.8 as well > Update

[jira] [Comment Edited] (YARN-6729) NM percentage-physical-cpu-limit should be always 100 if DefaultLCEResourcesHandler is used

2018-10-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667780#comment-16667780 ] Shane Kumpf edited comment on YARN-6729 at 10/29/18 9:34 PM: - Thanks for the

[jira] [Created] (YARN-8955) Add a flag to use local docker image instead of getting latest from registry

2018-10-29 Thread Eric Yang (JIRA)
Eric Yang created YARN-8955: --- Summary: Add a flag to use local docker image instead of getting latest from registry Key: YARN-8955 URL: https://issues.apache.org/jira/browse/YARN-8955 Project: Hadoop YARN

[jira] [Updated] (YARN-8778) Add Command Line interface to invoke interactive docker shell

2018-10-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8778: Attachment: YARN-8778.006.patch > Add Command Line interface to invoke interactive docker shell >

[jira] [Commented] (YARN-8776) Container Executor change to create stdin/stdout pipeline

2018-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667749#comment-16667749 ] Hadoop QA commented on YARN-8776: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6729) NM percentage-physical-cpu-limit should be always 100 if DefaultLCEResourcesHandler is used

2018-10-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667780#comment-16667780 ] Shane Kumpf commented on YARN-6729: --- Thanks for the patch, [~tangzhankun]! The update looks good to me

[jira] [Updated] (YARN-8776) Container Executor change to create stdin/stdout pipeline

2018-10-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8776: Attachment: YARN-8776.005.patch > Container Executor change to create stdin/stdout pipeline >

[jira] [Commented] (YARN-8936) Update ATSv2 hbase.two.version to 2.0.2

2018-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667860#comment-16667860 ] Hadoop QA commented on YARN-8936: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8913) Add helper scripts to launch MaWo App to run Hadoop unit tests on Hadoop Cluster

2018-10-29 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8913: - Attachment: YARN-8913.003.patch > Add helper scripts to launch MaWo App to run Hadoop unit tests on

[jira] [Updated] (YARN-8914) Add xtermjs to YARN UI2

2018-10-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8914: Attachment: YARN-8914.004.patch > Add xtermjs to YARN UI2 > --- > >

[jira] [Commented] (YARN-8913) Add helper scripts to launch MaWo App to run Hadoop unit tests on Hadoop Cluster

2018-10-29 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667888#comment-16667888 ] Yesha Vora commented on YARN-8913: -- [~eyang], Thanks for feedback. Please find attached patch#3

[jira] [Updated] (YARN-8838) Add security check for container user is same as websocket user

2018-10-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8838: Attachment: YARN-8838.001.patch > Add security check for container user is same as websocket user >

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

2018-10-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667885#comment-16667885 ] Eric Yang commented on YARN-8914: - The failed unit tests were not related to this JIRA. They failed due

[jira] [Assigned] (YARN-8950) Compilation fails for hadoop-yarn-server-timelineservice-hbase-client package for hbase.profile=2.0

2018-10-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S reassigned YARN-8950: --- Assignee: Rohith Sharma K S > Compilation fails for

[jira] [Updated] (YARN-8950) Compilation fails for hadoop-yarn-server-timelineservice-hbase-client package for hbase.profile=2.0

2018-10-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8950: Attachment: without-patch-compile-fail.out with-patch-compile-pass.out >

[jira] [Updated] (YARN-3879) [Storage implementation] Create HDFS backing storage implementation for ATS reads

2018-10-29 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-3879: Fix Version/s: (was: 3.1.2) (was: 3.0.3) (was:

[jira] [Commented] (YARN-8950) Compilation fails for hadoop-yarn-server-timelineservice-hbase-client package for hbase.profile=2.0

2018-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1989#comment-1989 ] Hadoop QA commented on YARN-8950: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8833) compute shares may lock the scheduling process

2018-10-29 Thread liyakun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyakun updated YARN-8833: -- Description: When use w2rRatio compute fair share, there may be a chance triggering the problem of Int

[jira] [Commented] (YARN-8833) compute shares may lock the scheduling process

2018-10-29 Thread liyakun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1792#comment-1792 ] liyakun commented on YARN-8833: --- [~tangzhankun], I have elaborated the problem in the description. Thanks

[jira] [Updated] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: YARN-8851-WIP8-trunk.001.patch > [Umbrella] A new pluggable device plugin framework to

[jira] [Commented] (YARN-7754) [Atsv2] Update document for running v1 and v2 TS

2018-10-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1999#comment-1999 ] Rohith Sharma K S commented on YARN-7754: - +1 lgtm > [Atsv2] Update document for running v1 and

[jira] [Updated] (YARN-8950) Compilation fails for hadoop-yarn-server-timelineservice-hbase-client package for hbase.profile=2.0

2018-10-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8950: Attachment: YARN-8950.01.patch > Compilation fails for

[jira] [Updated] (YARN-8950) Compilation fails for hadoop-yarn-server-timelineservice-hbase-client package for hbase.profile=2.0

2018-10-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8950: Attachment: YARN-8950.01.patch > Compilation fails for

[jira] [Commented] (YARN-8503) Add unit test for FINISHED_CONTAINERS_PULLED_BY_AM event on DECOMMISSIONING

2018-10-29 Thread Amiya Chakraborty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1791#comment-1791 ] Amiya Chakraborty commented on YARN-8503: - Hi [~snemeth], thank you for the information! Let me

[jira] [Updated] (YARN-8833) compute shares may lock the scheduling process

2018-10-29 Thread liyakun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyakun updated YARN-8833: -- Description: When use w2rRatio compute fair share, there may be a chance triggering the problem of Int

[jira] [Commented] (YARN-8404) Timeline event publish need to be async to avoid Dispatcher thread leak in case ATS is down

2018-10-29 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667945#comment-16667945 ] Akira Ajisaka commented on YARN-8404: - IMO, this issue should be backported to branch-2.9. Hi

[jira] [Commented] (YARN-7765) [Atsv2] GSSException: No valid credentials provided - Failed to find any Kerberos tgt thrown by Timelinev2Client & HBaseClient in NM

2018-10-29 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667949#comment-16667949 ] Akira Ajisaka commented on YARN-7765: - IMO, it should be backported to branch-2.9. Hi [~rohithsharma]

[jira] [Updated] (YARN-8924) Refine the document or code related to Cgroups/LCE

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8924: --- Summary: Refine the document or code related to Cgroups/LCE (was: Refine the document or code

[jira] [Assigned] (YARN-4404) Typo in comment in SchedulerUtils

2018-10-29 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora reassigned YARN-4404: Assignee: Yesha Vora (was: Devon Michaels) > Typo in comment in SchedulerUtils >

[jira] [Commented] (YARN-6729) NM percentage-physical-cpu-limit should be always 100 if DefaultLCEResourcesHandler is used

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668053#comment-16668053 ] Zhankun Tang commented on YARN-6729: [~shaneku...@gmail.com] , Thanks for the review. Yeah. I agree

[jira] [Updated] (YARN-8924) Refine the document or code related to Cgroups/LCE

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8924: --- Description: This is to re-think the legacy configuration/code of Cgroups in YARN like CPU resource

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

2018-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668065#comment-16668065 ] Hadoop QA commented on YARN-8914: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8871) Document behavior of YARN-5742

2018-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668064#comment-16668064 ] Hadoop QA commented on YARN-8871: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8957) Add Serializable interface to ComponentContainers

2018-10-29 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8957: -- Summary: Add Serializable interface to ComponentContainers Key: YARN-8957 URL: https://issues.apache.org/jira/browse/YARN-8957 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-8957) Add Serializable interface to ComponentContainers

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8957: --- Attachment: YARN-8957-trunk.001.patch > Add Serializable interface to ComponentContainers >

[jira] [Commented] (YARN-8957) Add Serializable interface to ComponentContainers

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668095#comment-16668095 ] Zhankun Tang commented on YARN-8957: [~aceric] , chanced to encounter this but not sure if it needs

[jira] [Updated] (YARN-8957) Add Serializable interface to ComponentContainers

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8957: --- Description: In YARN service API: public class ComponentContainers { private static final long

[jira] [Commented] (YARN-8867) Retrieve the progress of resource localization

2018-10-29 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668000#comment-16668000 ] Chandni Singh commented on YARN-8867: - The work in progress patch has the new API which retrieves the

[jira] [Updated] (YARN-8924) Refine the document or code related to Cgroups/LCE

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8924: --- Description: This is to re-think the legacy configuration/code of Cgroups in YARN like CPU resource

[jira] [Updated] (YARN-8924) Refine the document or code related to Cgroups/LCE

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8924: --- Description: This is to re-think the legacy configuration/code of Cgroups in YARN like CPU resource

[jira] [Commented] (YARN-8776) Container Executor change to create stdin/stdout pipeline

2018-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667955#comment-16667955 ] Hadoop QA commented on YARN-8776: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8871) Document behavior of YARN-5742

2018-10-29 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667956#comment-16667956 ] Suma Shivaprasad commented on YARN-8871: Removed references to ATS1.5 > Document behavior of

[jira] [Updated] (YARN-8871) Document behavior of YARN-5742

2018-10-29 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8871: --- Attachment: YARN-8871.3.patch > Document behavior of YARN-5742 >

[jira] [Updated] (YARN-8956) Fix findbugs warnings in RegistryDNS.java

2018-10-29 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8956: Attachment: YARN-8956.01.patch > Fix findbugs warnings in RegistryDNS.java >

[jira] [Assigned] (YARN-8956) Fix findbugs warnings in RegistryDNS.java

2018-10-29 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned YARN-8956: --- Assignee: Akira Ajisaka > Fix findbugs warnings in RegistryDNS.java >

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668059#comment-16668059 ] Zhankun Tang commented on YARN-8714: [~leftnoteasy] , I'd like to work on this if you're ok. >

[jira] [Commented] (YARN-8778) Add Command Line interface to invoke interactive docker shell

2018-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668060#comment-16668060 ] Hadoop QA commented on YARN-8778: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8956) Fix findbugs warnings in RegistryDNS.java

2018-10-29 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created YARN-8956: --- Summary: Fix findbugs warnings in RegistryDNS.java Key: YARN-8956 URL: https://issues.apache.org/jira/browse/YARN-8956 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-8867) Retrieve the progress of resource localization

2018-10-29 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8867: Attachment: YARN-8867.wip.patch > Retrieve the progress of resource localization >

[jira] [Updated] (YARN-4404) Typo in comment in SchedulerUtils

2018-10-29 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-4404: - Attachment: YARN-4404.001.patch > Typo in comment in SchedulerUtils > - >

[jira] [Updated] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-10-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8948: --- Attachment: YARN-8948.002.patch > PlacementRule interface should be for all YarnSchedulers >

[jira] [Created] (YARN-8952) [UI2] Improvements in YARN Tools page

2018-10-29 Thread Akhil PB (JIRA)
Akhil PB created YARN-8952: -- Summary: [UI2] Improvements in YARN Tools page Key: YARN-8952 URL: https://issues.apache.org/jira/browse/YARN-8952 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-10-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-5106: - Attachment: YARN-5106.002.patch > Provide a builder interface for FairScheduler allocations for

[jira] [Comment Edited] (YARN-8952) [UI2] Improvements in YARN UI2 Tools page

2018-10-29 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667151#comment-16667151 ] Akhil PB edited comment on YARN-8952 at 10/29/18 12:48 PM: --- Attaching v1 patch.

[jira] [Comment Edited] (YARN-8951) Defining default queue placement rule in allocations file with create="false" throws an NPE

2018-10-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667173#comment-16667173 ] Szilard Nemeth edited comment on YARN-8951 at 10/29/18 1:05 PM: Thanks

[jira] [Updated] (YARN-8952) [UI2] Improvements in YARN UI2 Tools page

2018-10-29 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-8952: --- Attachment: YARN-8952.001.patch > [UI2] Improvements in YARN UI2 Tools page >

[jira] [Updated] (YARN-8952) [UI2] Improvements in YARN UI2 Tools page

2018-10-29 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-8952: --- Attachment: (was: Screen Shot 2018-10-29 at 6.15.26 PM.png) > [UI2] Improvements in YARN UI2 Tools page >

[jira] [Updated] (YARN-8952) [UI2] Improvements in YARN UI2 Tools page

2018-10-29 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-8952: --- Attachment: (was: Screen Shot 2018-10-29 at 6.15.08 PM.png) > [UI2] Improvements in YARN UI2 Tools page >

[jira] [Updated] (YARN-8952) [UI2] Improvements in YARN UI2 Tools page

2018-10-29 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-8952: --- Attachment: YARN_UI2_Tools_Page_Improved_2.png YARN_UI2_Tools_Page_Improved_1.png > [UI2]

[jira] [Commented] (YARN-8951) Defining default queue placement rule in allocations file with create="false" throws an NPE

2018-10-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667173#comment-16667173 ] Szilard Nemeth commented on YARN-8951: -- Thanks [~jlowe] for your opinion. Adding [~wilfreds] and

[jira] [Commented] (YARN-8924) Refine the document or code related to legacy CPU isolation/enforcement

2018-10-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667223#comment-16667223 ] Shane Kumpf commented on YARN-8924: --- Sorry for the delay. As mentioned, {{LCEResourcesHandler}} and the

[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-10-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667138#comment-16667138 ] Szilard Nemeth commented on YARN-5106: -- About the test failures: 1.

[jira] [Updated] (YARN-8952) [UI2] Improvements in YARN UI2 Tools page

2018-10-29 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-8952: --- Summary: [UI2] Improvements in YARN UI2 Tools page (was: [UI2] Improvements in YARN Tools page) > [UI2]

[jira] [Commented] (YARN-8951) Defining default queue placement rule in allocations file with create="false" throws an NPE

2018-10-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667162#comment-16667162 ] Jason Lowe commented on YARN-8951: -- I am not an expert in FairScheduler or its placement rule policies,

[jira] [Updated] (YARN-8951) Defining default queue placement rule in allocations file with create="false" throws an NPE

2018-10-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8951: - Attachment: default-placement-rule-with-create-false.patch > Defining default queue placement

[jira] [Commented] (YARN-8951) Defining default queue placement rule in allocations file with create="false" throws an NPE

2018-10-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667131#comment-16667131 ] Szilard Nemeth commented on YARN-8951: -- See the attached patch for a testcase that reproduces the

[jira] [Created] (YARN-8951) Defining default queue placement rule in allocations file with create="false" throws an NPE

2018-10-29 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-8951: Summary: Defining default queue placement rule in allocations file with create="false" throws an NPE Key: YARN-8951 URL: https://issues.apache.org/jira/browse/YARN-8951

[jira] [Comment Edited] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-10-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667138#comment-16667138 ] Szilard Nemeth edited comment on YARN-5106 at 10/29/18 12:41 PM: - About

[jira] [Commented] (YARN-8952) [UI2] Improvements in YARN UI2 Tools page

2018-10-29 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667151#comment-16667151 ] Akhil PB commented on YARN-8952: Attaching v1 patch. See screenshots for the !Screen Shot 2018-10-29 at

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667341#comment-16667341 ] Zhankun Tang edited comment on YARN-8851 at 10/29/18 3:21 PM: -- Updated the

[jira] [Created] (YARN-8954) Reservations list field in ReservationListInfo is not accessible

2018-10-29 Thread Oleksandr Shevchenko (JIRA)
Oleksandr Shevchenko created YARN-8954: -- Summary: Reservations list field in ReservationListInfo is not accessible Key: YARN-8954 URL: https://issues.apache.org/jira/browse/YARN-8954 Project:

[jira] [Commented] (YARN-8924) Refine the document or code related to legacy CPU isolation/enforcement

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667291#comment-16667291 ] Zhankun Tang commented on YARN-8924: Thanks for the review. [~shaneku...@gmail.com] > Refine the

[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-29 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667381#comment-16667381 ] Eric Badger commented on YARN-8927: --- Given the risk that's involved with privileged containers, I think

[jira] [Commented] (YARN-8950) Compilation fails for hadoop-yarn-server-timelineservice-hbase-client package for hbase.profile=2.0

2018-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667082#comment-16667082 ] Hadoop QA commented on YARN-8950: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8952) [UI2] Improvements in YARN UI2 Tools page

2018-10-29 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-8952: --- Attachment: Screen Shot 2018-10-29 at 6.15.26 PM.png Screen Shot 2018-10-29 at 6.15.08 PM.png

[jira] [Comment Edited] (YARN-8952) [UI2] Improvements in YARN UI2 Tools page

2018-10-29 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667151#comment-16667151 ] Akhil PB edited comment on YARN-8952 at 10/29/18 12:48 PM: --- Attaching v1 patch.

[jira] [Commented] (YARN-8952) [UI2] Improvements in YARN UI2 Tools page

2018-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667286#comment-16667286 ] Hadoop QA commented on YARN-8952: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8950) Compilation fails for hadoop-yarn-server-timelineservice-hbase-client package for hbase.profile=2.0

2018-10-29 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8950: - Attachment: YARN-8950.01.patch > Compilation fails for

[jira] [Updated] (YARN-8953) Add CSI driver adaptor module

2018-10-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8953: -- Summary: Add CSI driver adaptor module (was: Add CSI adaptor module) > Add CSI driver adaptor module >

[jira] [Commented] (YARN-8950) Compilation fails for hadoop-yarn-server-timelineservice-hbase-client package for hbase.profile=2.0

2018-10-29 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667320#comment-16667320 ] Sunil Govindan commented on YARN-8950: -- Attached same patch again to run jenkins > Compilation fails

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667341#comment-16667341 ] Zhankun Tang commented on YARN-8851: Updated the patch. # Add a sanity-check to fast fail an

[jira] [Created] (YARN-8953) Add CSI adaptor module

2018-10-29 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8953: - Summary: Add CSI adaptor module Key: YARN-8953 URL: https://issues.apache.org/jira/browse/YARN-8953 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-8951) Defining default queue placement rule in allocations file with create="false" throws an NPE

2018-10-29 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667328#comment-16667328 ] Wilfred Spiegelenburg commented on YARN-8951: - You should not be able to pass the last rule

[jira] [Commented] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667339#comment-16667339 ] Hadoop QA commented on YARN-8948: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8303) YarnClient should contact TimelineReader for application/attempt/container report

2018-10-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667495#comment-16667495 ] Rohith Sharma K S commented on YARN-8303: - [~abmodi] Any update on this? > YarnClient should

[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667532#comment-16667532 ] Hadoop QA commented on YARN-5106: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8895) Improve YARN Error diagnostics

2018-10-29 Thread Young Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667544#comment-16667544 ] Young Chen commented on YARN-8895: -- Hi [~leftnoteasy] - 1 - I agree that we should make this a new field

[jira] [Commented] (YARN-8503) Add unit test for FINISHED_CONTAINERS_PULLED_BY_AM event on DECOMMISSIONING

2018-10-29 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667439#comment-16667439 ] Robert Kanter commented on YARN-8503: - I've given [~AmiyaChakraborty] permissions. > Add unit test

[jira] [Comment Edited] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667455#comment-16667455 ] Eric Yang edited comment on YARN-8927 at 10/29/18 5:02 PM: --- {quote}Basically,

[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667455#comment-16667455 ] Eric Yang commented on YARN-8927: - {quote}Basically, the mode I'm talking about is allowing users to run

[jira] [Commented] (YARN-8950) Compilation fails for hadoop-yarn-server-timelineservice-hbase-client package for hbase.profile=2.0

2018-10-29 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667456#comment-16667456 ] Sunil Govindan commented on YARN-8950: -- +1. Committing shortly [~rohithsharma] has already compiled

[jira] [Commented] (YARN-8950) Compilation fails for hadoop-yarn-server-timelineservice-hbase-client package for hbase.profile=2.0

2018-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667453#comment-16667453 ] Hadoop QA commented on YARN-8950: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||