[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-10-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651405#comment-16651405 ] Weiwei Yang commented on YARN-8468: --- Still same issue on branch-3.1, but recent trunk build seems fine.

[jira] [Commented] (YARN-8877) Extend service spec to allow setting resource attributes

2018-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651500#comment-16651500 ] Hadoop QA commented on YARN-8877: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7756) AMRMProxyService cann't enable ’hadoop.security.authorization‘

2018-10-16 Thread leiqiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leiqiang reassigned YARN-7756: -- Assignee: leiqiang > AMRMProxyService cann't enable ’hadoop.security.authorization‘ >

[jira] [Updated] (YARN-8873) Add CSI java-based client library

2018-10-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8873: -- Attachment: YARN-8873.004.PATCH > Add CSI java-based client library > -

[jira] [Commented] (YARN-8875) [Submarine] Add documentation for submarine installation script details

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651181#comment-16651181 ] Wangda Tan commented on YARN-8875: -- Thanks [~liuxun323]. More comments: 1) Inside Index.md, should

[jira] [Updated] (YARN-8879) Kerberos principal is needed when submitting a submarine job

2018-10-16 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8879: --- Attachment: YARN-8879.002.patch > Kerberos principal is needed when submitting a submarine job >

[jira] [Updated] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: YARN-8851-WIP4-trunk.001.patch > [Umbrella] A new pluggable device plugin framework to

[jira] [Commented] (YARN-8879) Kerberos principal is needed when submitting a submarine job

2018-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651487#comment-16651487 ] Hadoop QA commented on YARN-8879: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8879) Kerberos principal is needed when submitting a submarine job

2018-10-16 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651242#comment-16651242 ] Sunil Govindan commented on YARN-8879: -- [~yuan_zac] With this, we will double validate that the

[jira] [Updated] (YARN-8826) Fix lingering timeline collector after serviceStop in TimelineCollectorManager

2018-10-16 Thread Prabha Manepalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabha Manepalli updated YARN-8826: --- Attachment: YARN-8826.v2.patch > Fix lingering timeline collector after serviceStop in

[jira] [Commented] (YARN-8873) Add CSI java-based client library

2018-10-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651273#comment-16651273 ] Weiwei Yang commented on YARN-8873: --- UT failure was not caused by this patch, see YARN-8856 for more

[jira] [Updated] (YARN-8873) Add CSI java-based client library

2018-10-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8873: -- Attachment: YARN-8873.003.patch > Add CSI java-based client library > -

[jira] [Commented] (YARN-8879) Kerberos principal is needed when submitting a submarine job

2018-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651286#comment-16651286 ] Hadoop QA commented on YARN-8879: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8887) Support isolation in pluggable device framework

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8887: -- Summary: Support isolation in pluggable device framework Key: YARN-8887 URL: https://issues.apache.org/jira/browse/YARN-8887 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Summary: [Umbrella] A new pluggable device plugin framework to ease vendor plugin development (was:

[jira] [Created] (YARN-8883) Provide an example of fake vendor plugin

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8883: -- Summary: Provide an example of fake vendor plugin Key: YARN-8883 URL: https://issues.apache.org/jira/browse/YARN-8883 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-8890) Port existing GPU module into pluggable device framework

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8890: -- Summary: Port existing GPU module into pluggable device framework Key: YARN-8890 URL: https://issues.apache.org/jira/browse/YARN-8890 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8880: --- Description: Added two configurations for the pluggable device framework. {code:java}

[jira] [Updated] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8880: --- Description: Added two configurations for the pluggable device framework. {code:java}

[jira] [Created] (YARN-8891) Documentation of the pluggable device framework

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8891: -- Summary: Documentation of the pluggable device framework Key: YARN-8891 URL: https://issues.apache.org/jira/browse/YARN-8891 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-8879) Kerberos principal is needed when submitting a submarine job

2018-10-16 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8879: --- Attachment: (was: YARN-8879.patch) > Kerberos principal is needed when submitting a submarine job >

[jira] [Updated] (YARN-8879) Kerberos principal is needed when submitting a submarine job

2018-10-16 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8879: --- Attachment: YARN-8879.001.patch > Kerberos principal is needed when submitting a submarine job >

[jira] [Created] (YARN-8881) Add basic pluggable device plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8881: -- Summary: Add basic pluggable device plugin framework Key: YARN-8881 URL: https://issues.apache.org/jira/browse/YARN-8881 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8826) Fix lingering timeline collector after serviceStop in TimelineCollectorManager

2018-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651290#comment-16651290 ] Hadoop QA commented on YARN-8826: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8879) Kerberos principal is needed when submitting a submarine job

2018-10-16 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651307#comment-16651307 ] Zac Zhou commented on YARN-8879: Thanks,  [~sunilg],  There is logic for kerberosPrincipal.getKeytab()

[jira] [Created] (YARN-8885) Support NM APIs to query device resource allocation

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8885: -- Summary: Support NM APIs to query device resource allocation Key: YARN-8885 URL: https://issues.apache.org/jira/browse/YARN-8885 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-8877) Extend service spec to allow setting resource attributes

2018-10-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8877: -- Attachment: YARN-8877.001.patch > Extend service spec to allow setting resource attributes >

[jira] [Commented] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

2018-10-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651349#comment-16651349 ] Weiwei Yang commented on YARN-8513: --- Hi [~leftnoteasy]/[~cyfdecyf]/[~hustnn]/[~Tao Yang] When this

[jira] [Created] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8880: -- Summary: Add configurations for pluggable plugin framework Key: YARN-8880 URL: https://issues.apache.org/jira/browse/YARN-8880 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-8884) Support monitoring of device resource through plugin API

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8884: -- Summary: Support monitoring of device resource through plugin API Key: YARN-8884 URL: https://issues.apache.org/jira/browse/YARN-8884 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8888) Support device topology scheduling

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-: -- Summary: Support device topology scheduling Key: YARN- URL: https://issues.apache.org/jira/browse/YARN- Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-8889) Added well-defined interface in container-executor to support vendor plugins isolation request

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8889: -- Summary: Added well-defined interface in container-executor to support vendor plugins isolation request Key: YARN-8889 URL: https://issues.apache.org/jira/browse/YARN-8889

[jira] [Updated] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8880: --- Description: Added two configurations for the pluggable device framework. {code:java}

[jira] [Updated] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8880: --- Description: Added two configurations for the pluggable device framework. {code:java}

[jira] [Commented] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

2018-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652044#comment-16652044 ] Hadoop QA commented on YARN-8798: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8798: - Target Version/s: 3.2.0 Priority: Critical (was: Major) > [Submarine] Job should not be

[jira] [Updated] (YARN-8892) YARN UI2 doc improvement to update security status

2018-10-16 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8892: - Attachment: YARN-8892.001.patch > YARN UI2 doc improvement to update security status >

[jira] [Updated] (YARN-8892) YARN UI2 doc improvement to update security status

2018-10-16 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8892: - Fix Version/s: (was: 3.2.0) > YARN UI2 doc improvement to update security status >

[jira] [Updated] (YARN-8892) YARN UI2 doc improvement to update security status

2018-10-16 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8892: - Target Version/s: 3.2.0 > YARN UI2 doc improvement to update security status >

[jira] [Updated] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-16 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8862: --- Attachment: YARN-8862-YARN-7402.v4.patch > [GPG] add Yarn Registry cleanup in ApplicationCleaner >

[jira] [Comment Edited] (YARN-7086) Release all containers aynchronously

2018-10-16 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652065#comment-16652065 ] Manikandan R edited comment on YARN-7086 at 10/16/18 4:57 PM: --   [~jlowe]

[jira] [Updated] (YARN-8875) [Submarine] Add documentation for submarine installation script details

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8875: - Attachment: YARN-8875.005.patch > [Submarine] Add documentation for submarine installation script details

[jira] [Commented] (YARN-8875) [Submarine] Add documentation for submarine installation script details

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652101#comment-16652101 ] Wangda Tan commented on YARN-8875: -- Fixed doc issues I mentioned above. (005)  > [Submarine] Add

[jira] [Commented] (YARN-8647) Add a flag to disable move app between queues

2018-10-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652189#comment-16652189 ] Eric Payne commented on YARN-8647: -- {quote}{quote}Addition flag to disable required {quote} {quote}IMO we

[jira] [Updated] (YARN-8481) AMRMProxyPolicies should accept heartbeat response from new/unknown subclusters

2018-10-16 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8481: --- Issue Type: Sub-task (was: Bug) Parent: YARN-5597 > AMRMProxyPolicies should accept

[jira] [Comment Edited] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652271#comment-16652271 ] Wangda Tan edited comment on YARN-8489 at 10/16/18 7:41 PM: [~eyang],

[jira] [Comment Edited] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652271#comment-16652271 ] Wangda Tan edited comment on YARN-8489 at 10/16/18 7:42 PM: [~eyang],

[jira] [Updated] (YARN-8879) Kerberos principal is needed when submitting a submarine job

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8879: - Priority: Critical (was: Major) > Kerberos principal is needed when submitting a submarine job >

[jira] [Updated] (YARN-8879) Kerberos principal is needed when submitting a submarine job

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8879: - Target Version/s: 3.2.0 > Kerberos principal is needed when submitting a submarine job >

[jira] [Commented] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652046#comment-16652046 ] Wangda Tan commented on YARN-8798: -- +1, thanks [~tangzhankun]. [~sunilg], please let me know if you have

[jira] [Commented] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

2018-10-16 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652060#comment-16652060 ] Sunil Govindan commented on YARN-8798: -- Thanks [~leftnoteasy]. I think its better to put it to 3.2 as

[jira] [Commented] (YARN-8892) YARN UI2 doc improvement to update security status

2018-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652136#comment-16652136 ] Hadoop QA commented on YARN-8892: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652163#comment-16652163 ] Wangda Tan commented on YARN-8489: -- [~eyang],  I have thought about this, but it seems to me both

[jira] [Commented] (YARN-8862) [GPG] add Yarn Registry cleanup in ApplicationCleaner

2018-10-16 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652313#comment-16652313 ] Giovanni Matteo Fumarola commented on YARN-8862: Thanks [~botong] for the patch. NIT: 

[jira] [Commented] (YARN-8875) [Submarine] Add documentation for submarine installation script details

2018-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652173#comment-16652173 ] Hadoop QA commented on YARN-8875: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652271#comment-16652271 ] Wangda Tan commented on YARN-8489: -- [~eyang], Basically there're four models in submarine for training

[jira] [Commented] (YARN-8892) YARN UI2 doc improvement to update security status

2018-10-16 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652053#comment-16652053 ] Sunil Govindan commented on YARN-8892: -- cc [~leftnoteasy] cud u pls review > YARN UI2 doc

[jira] [Commented] (YARN-7086) Release all containers aynchronously

2018-10-16 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652065#comment-16652065 ] Manikandan R commented on YARN-7086:   [~jlowe] Reduced I/O's by removing unnecessary stdout printing

[jira] [Commented] (YARN-8875) [Submarine] Add documentation for submarine installation script details

2018-10-16 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652121#comment-16652121 ] Sunil Govindan commented on YARN-8875: -- +1. > [Submarine] Add documentation for submarine

[jira] [Commented] (YARN-8448) AM HTTPS Support

2018-10-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652181#comment-16652181 ] Robert Kanter commented on YARN-8448: - {{TestCapacityOverTimePolicy}} failure is unrelated.  I'm not

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-10-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652248#comment-16652248 ] Eric Yang commented on YARN-8489: - [~leftnoteasy] {quote}master and ps are not depends on each other for

[jira] [Updated] (YARN-8868) Set HTTPOnly attribute to Cookie

2018-10-16 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8868: Attachment: YARN-8810.002.patch > Set HTTPOnly attribute to Cookie >

[jira] [Updated] (YARN-8868) Set HTTPOnly attribute to Cookie

2018-10-16 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8868: Attachment: (was: YARN-8810.002.patch) > Set HTTPOnly attribute to Cookie >

[jira] [Created] (YARN-8892) YARN UI2 doc improvement to update security status

2018-10-16 Thread Sunil Govindan (JIRA)
Sunil Govindan created YARN-8892: Summary: YARN UI2 doc improvement to update security status Key: YARN-8892 URL: https://issues.apache.org/jira/browse/YARN-8892 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-8810) Yarn Service: discrepancy between hashcode and equals of ConfigFile

2018-10-16 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8810: Attachment: YARN-8810.002.patch > Yarn Service: discrepancy between hashcode and equals of

[jira] [Commented] (YARN-8879) Kerberos principal is needed when submitting a submarine job

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652036#comment-16652036 ] Wangda Tan commented on YARN-8879: -- +1, thanks [~sunilg], please go ahead and get it committed. >

[jira] [Commented] (YARN-8879) Kerberos principal is needed when submitting a submarine job

2018-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652090#comment-16652090 ] Hudson commented on YARN-8879: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15225 (See

[jira] [Commented] (YARN-8810) Yarn Service: discrepancy between hashcode and equals of ConfigFile

2018-10-16 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652263#comment-16652263 ] Chandni Singh commented on YARN-8810: - Added a unit test and a fix to {{DefaultComponentsFinder}} in

[jira] [Updated] (YARN-8449) RM HA for AM HTTPS Support

2018-10-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-8449: Attachment: YARN-8449.001.patch > RM HA for AM HTTPS Support > -- > >

[jira] [Commented] (YARN-8870) [Submarine] Add submarine installation scripts

2018-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652469#comment-16652469 ] Hudson commented on YARN-8870: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15231 (See

[jira] [Commented] (YARN-8875) [Submarine] Add documentation for submarine installation script details

2018-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652468#comment-16652468 ] Hudson commented on YARN-8875: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15231 (See

[jira] [Commented] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

2018-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652470#comment-16652470 ] Hudson commented on YARN-8798: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15231 (See

[jira] [Commented] (YARN-8892) YARN UI2 doc changes to update security status (verified under security environment)

2018-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652471#comment-16652471 ] Hudson commented on YARN-8892: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15231 (See

[jira] [Commented] (YARN-8892) YARN UI2 doc improvement to update security status

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652405#comment-16652405 ] Wangda Tan commented on YARN-8892: -- +1, committing, thanks [~sunilg]. > YARN UI2 doc improvement to

[jira] [Updated] (YARN-8892) YARN UI2 doc improvement to update security status

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8892: - Priority: Blocker (was: Major) > YARN UI2 doc improvement to update security status >

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-10-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652420#comment-16652420 ] Eric Yang commented on YARN-8489: - [~leftnoteasy] {quote}We will not support notebook and distributed TF

[jira] [Comment Edited] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-10-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652420#comment-16652420 ] Eric Yang edited comment on YARN-8489 at 10/16/18 8:49 PM: --- [~leftnoteasy]

[jira] [Updated] (YARN-8893) [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client

2018-10-16 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8893: --- Component/s: federation amrmproxy > [AMRMProxy] Fix thread leak in AMRMClientRelayer

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652443#comment-16652443 ] Haibo Chen commented on YARN-8842: -- +1 on the latest patch. I'll fix the one minor indentation checkstyle

[jira] [Updated] (YARN-8892) YARN UI2 doc changes to update security status (verified under security environment)

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8892: - Target Version/s: 3.2.0, 3.1.2 (was: 3.2.0) > YARN UI2 doc changes to update security status (verified

[jira] [Updated] (YARN-8868) Set HTTPOnly attribute to Cookie

2018-10-16 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8868: Attachment: old_rm_ui.png new_rm_ui.png > Set HTTPOnly attribute to Cookie >

[jira] [Commented] (YARN-8868) Set HTTPOnly attribute to Cookie

2018-10-16 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652651#comment-16652651 ] Chandni Singh commented on YARN-8868: - [~sunilg] I checked the patch in a kerberized cluster. Both new

[jira] [Updated] (YARN-8448) AM HTTPS Support for AM communication with RMWeb proxy

2018-10-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8448: - Summary: AM HTTPS Support for AM communication with RMWeb proxy (was: AM HTTPS Support) > AM HTTPS

[jira] [Commented] (YARN-8448) AM HTTPS Support for AM communication with RMWeb proxy

2018-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652431#comment-16652431 ] Hudson commented on YARN-8448: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #15230 (See

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-10-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652547#comment-16652547 ] Eric Yang commented on YARN-8489: - [~leftnoteasy] Notebook can communicate to ps or workers via grpc the

[jira] [Updated] (YARN-8778) Add Command Line interface to invoke interactive docker shell

2018-10-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8778: Attachment: YARN-8778.003.patch > Add Command Line interface to invoke interactive docker shell >

[jira] [Updated] (YARN-8893) [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client

2018-10-16 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8893: --- Issue Type: Sub-task (was: Task) Parent: YARN-5597 > [AMRMProxy] Fix thread leak in

[jira] [Commented] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652645#comment-16652645 ] Wangda Tan commented on YARN-8513: -- Sounds like a plan, default value set to 100 may make more sense.

[jira] [Commented] (YARN-8810) Yarn Service: discrepancy between hashcode and equals of ConfigFile

2018-10-16 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652662#comment-16652662 ] Chandni Singh commented on YARN-8810: - [~eyang] thanks for reviewing and merging the patch > Yarn

[jira] [Updated] (YARN-8582) Documentation for AM HTTPS Support

2018-10-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-8582: Attachment: YARN-8582.004.patch > Documentation for AM HTTPS Support >

[jira] [Commented] (YARN-8582) Documentation for AM HTTPS Support

2018-10-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652681#comment-16652681 ] Robert Kanter commented on YARN-8582: - The 004 patch: - Update doc patch with config property

[jira] [Commented] (YARN-8810) Yarn Service: discrepancy between hashcode and equals of ConfigFile

2018-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652386#comment-16652386 ] Hadoop QA commented on YARN-8810: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8448) AM HTTPS Support

2018-10-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652392#comment-16652392 ] Haibo Chen commented on YARN-8448: -- I ran the cestest locally and it did not fail for me either. +1 on

[jira] [Updated] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

2018-10-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8842: - Summary: Expose metrics for custom resource types in QueueMetrics (was: Update QueueMetrics with custom

[jira] [Updated] (YARN-8893) [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client

2018-10-16 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8893: --- Attachment: YARN-8893.v1.patch > [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client >

[jira] [Commented] (YARN-8449) RM HA for AM HTTPS Support

2018-10-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652461#comment-16652461 ] Robert Kanter commented on YARN-8449: - The 001 patch adds the code for storing and retrieving the CA

[jira] [Commented] (YARN-8810) Yarn Service: discrepancy between hashcode and equals of ConfigFile

2018-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652631#comment-16652631 ] Hudson commented on YARN-8810: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15234 (See

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-10-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652684#comment-16652684 ] Eric Yang commented on YARN-8489: - {quote}If it is never, dominant field will be ignored. Otherwise

[jira] [Created] (YARN-8893) [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client

2018-10-16 Thread Botong Huang (JIRA)
Botong Huang created YARN-8893: -- Summary: [AMRMProxy] Fix thread leak in AMRMClientRelayer and UAM client Key: YARN-8893 URL: https://issues.apache.org/jira/browse/YARN-8893 Project: Hadoop YARN

[jira] [Updated] (YARN-8892) YARN UI2 doc changes to update security status (verified under security environment)

2018-10-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8892: - Summary: YARN UI2 doc changes to update security status (verified under security environment) (was: YARN

  1   2   >