[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-20 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112648#comment-17112648 ] Jonathan Hung edited comment on YARN-6492 at 5/20/20, 10:59 PM: Thank you

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-20 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112648#comment-17112648 ] Jonathan Hung edited comment on YARN-6492 at 5/20/20, 10:58 PM: Thank you

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-20 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112648#comment-17112648 ] Jonathan Hung edited comment on YARN-6492 at 5/20/20, 10:57 PM: Thank you

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-20 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112648#comment-17112648 ] Jonathan Hung edited comment on YARN-6492 at 5/20/20, 10:57 PM: Thank you

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-20 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112648#comment-17112648 ] Jonathan Hung commented on YARN-6492: - Thank you [~maniraj...@gmail.com]. Looks fine at a high level.

[jira] [Commented] (YARN-10269) SchedConfCLI and LogWebService should reuse util class WebServiceClient

2020-05-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112517#comment-17112517 ] Hadoop QA commented on YARN-10269: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112496#comment-17112496 ] Hadoop QA commented on YARN-6492: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10228) Yarn Service fails if am java opts contains ZK authentication file path

2020-05-20 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-10228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112429#comment-17112429 ] Hudson commented on YARN-10228: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18281 (See

[jira] [Updated] (YARN-10228) Yarn Service fails if am java opts contains ZK authentication file path

2020-05-20 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-10228: - Fix Version/s: 3.4.0 Target Version/s: 3.4.0 Affects Version/s: 3.3.0 > Yarn Service fails

[jira] [Updated] (YARN-10269) SchedConfCLI and LogWebService should reuse util class WebServiceClient

2020-05-20 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-10269: - Attachment: YARN-10269.003.patch > SchedConfCLI and LogWebService should reuse util class

[jira] [Updated] (YARN-10269) SchedConfCLI and LogWebService should reuse util class WebServiceClient

2020-05-20 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-10269: - Attachment: (was: YARN-10269.003.patch) > SchedConfCLI and LogWebService should reuse util class

[jira] [Commented] (YARN-10108) FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping

2020-05-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112375#comment-17112375 ] Hadoop QA commented on YARN-10108: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2020-05-20 Thread Manikandan R (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6492: --- Attachment: YARN-6492.009.WIP.patch > Generate queue metrics for each partition >

[jira] [Commented] (YARN-8047) RMWebApp make external class pluggable

2020-05-20 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-8047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112370#comment-17112370 ] Bilwa S T commented on YARN-8047: - Hi [~sunilg] We can configure external webapp classes like below

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-20 Thread Manikandan R (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112371#comment-17112371 ] Manikandan R commented on YARN-6492: [~jhung]  [~epayne]  Attached .009 patch based on our

[jira] [Commented] (YARN-10269) SchedConfCLI and LogWebService should reuse util class WebServiceClient

2020-05-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112367#comment-17112367 ] Hadoop QA commented on YARN-10269: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10254) CapacityScheduler incorrect User Group Mapping after leaf queue change

2020-05-20 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112345#comment-17112345 ] Gergely Pollak commented on YARN-10254: --- [~pbacsko] thank you for the feedbacks, the additional

[jira] [Updated] (YARN-10254) CapacityScheduler incorrect User Group Mapping after leaf queue change

2020-05-20 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10254: -- Attachment: YARN-10254.004.patch > CapacityScheduler incorrect User Group Mapping after leaf

[jira] [Commented] (YARN-8047) RMWebApp make external class pluggable

2020-05-20 Thread Sunil G (Jira)
[ https://issues.apache.org/jira/browse/YARN-8047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112329#comment-17112329 ] Sunil G commented on YARN-8047: --- [~BilwaST] cud u pls help to explain how to use an external class ?  and we

[jira] [Commented] (YARN-8047) RMWebApp make external class pluggable

2020-05-20 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-8047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112317#comment-17112317 ] Bilwa S T commented on YARN-8047: - cc [~inigoiri] [~aajisaka] > RMWebApp make external class pluggable >

[jira] [Commented] (YARN-10284) Add lazy initialization of LogAggregationFileControllerFactory in LogServlet

2020-05-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112243#comment-17112243 ] Hadoop QA commented on YARN-10284: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10269) SchedConfCLI and LogWebService should reuse util class WebServiceClient

2020-05-20 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-10269: - Attachment: YARN-10269.003.patch > SchedConfCLI and LogWebService should reuse util class

[jira] [Commented] (YARN-10108) FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping

2020-05-20 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112183#comment-17112183 ] Gergely Pollak commented on YARN-10108: --- After rebase a clean build compiled without issues,

[jira] [Updated] (YARN-10108) FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping

2020-05-20 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10108: -- Attachment: YARN-10108.004.patch > FS-CS converter: nestedUserQueue with default rule results

[jira] [Assigned] (YARN-10276) Check and improve memory footprint of CapacityScheduler CSQueueStore

2020-05-20 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak reassigned YARN-10276: - Assignee: Gergely Pollak > Check and improve memory footprint of CapacityScheduler

[jira] [Commented] (YARN-10284) Add lazy initialization of LogAggregationFileControllerFactory in LogServlet

2020-05-20 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112166#comment-17112166 ] Adam Antal commented on YARN-10284: --- I'll test the patch on a deployed cluster, and will probably need

[jira] [Updated] (YARN-10284) Add lazy initialization of LogAggregationFileControllerFactory in LogServlet

2020-05-20 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-10284: -- Attachment: YARN-10284.001.patch > Add lazy initialization of LogAggregationFileControllerFactory in

[jira] [Updated] (YARN-10284) Add lazy initialization of LogAggregationFileControllerFactory in LogServlet

2020-05-20 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-10284: -- Parent: YARN-10025 Issue Type: Sub-task (was: Bug) > Add lazy initialization of

[jira] [Created] (YARN-10284) Add lazy initialization of LogAggregationFileControllerFactory in LogServlet

2020-05-20 Thread Adam Antal (Jira)
Adam Antal created YARN-10284: - Summary: Add lazy initialization of LogAggregationFileControllerFactory in LogServlet Key: YARN-10284 URL: https://issues.apache.org/jira/browse/YARN-10284 Project: Hadoop

[jira] [Updated] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels are used

2020-05-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10283: Description: Recently we've been investigating a scenario where applications submitted to a lower

[jira] [Updated] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels are used

2020-05-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10283: Summary: Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels

[jira] [Comment Edited] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full a and node labels are used

2020-05-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112051#comment-17112051 ] Peter Bacsko edited comment on YARN-10283 at 5/20/20, 11:00 AM: Quick

[jira] [Comment Edited] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full a and node labels are used

2020-05-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112051#comment-17112051 ] Peter Bacsko edited comment on YARN-10283 at 5/20/20, 10:59 AM: Quick

[jira] [Commented] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full a and node labels are used

2020-05-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112051#comment-17112051 ] Peter Bacsko commented on YARN-10283: - Quick workaround: {noformat} if (null ==

[jira] [Created] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full a and node labels are used

2020-05-20 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10283: --- Summary: Capacity Scheduler: starvation occurs if a higher priority queue is full a and node labels are used Key: YARN-10283 URL: https://issues.apache.org/jira/browse/YARN-10283

[jira] [Created] (YARN-10282) CLONE - hadoop-yarn-server-nodemanager build failed: make failed with error code 2

2020-05-20 Thread lynsey (Jira)
lynsey created YARN-10282: - Summary: CLONE - hadoop-yarn-server-nodemanager build failed: make failed with error code 2 Key: YARN-10282 URL: https://issues.apache.org/jira/browse/YARN-10282 Project: Hadoop

[jira] [Commented] (YARN-9606) Set sslfactory for AuthenticatedURL() while creating LogsCLI#webServiceClient

2020-05-20 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-9606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111817#comment-17111817 ] Hudson commented on YARN-9606: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18279 (See

[jira] [Commented] (YARN-9606) Set sslfactory for AuthenticatedURL() while creating LogsCLI#webServiceClient

2020-05-20 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111806#comment-17111806 ] Prabhu Joseph commented on YARN-9606: - Have committed to trunk, will resolve this Jira. > Set

[jira] [Updated] (YARN-9606) Set sslfactory for AuthenticatedURL() while creating LogsCLI#webServiceClient

2020-05-20 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9606: Fix Version/s: 3.4.0 > Set sslfactory for AuthenticatedURL() while creating

[jira] [Commented] (YARN-9606) Set sslfactory for AuthenticatedURL() while creating LogsCLI#webServiceClient

2020-05-20 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111801#comment-17111801 ] Prabhu Joseph commented on YARN-9606: - Thanks [~BilwaST] for the patch and [~aajisaka] for the review.