[jira] [Assigned] (YARN-9512) [JDK11] TestAuxServices#testCustomizedAuxServiceClassPath ClassCastException: class jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to class java.net.URLCl

2020-01-14 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned YARN-9512: --- Assignee: Akira Ajisaka (was: Szilard Nemeth) > [JDK11]

[jira] [Commented] (YARN-9879) Allow multiple leaf queues with the same name in CS

2020-01-14 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YARN-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015701#comment-17015701 ] Wilfred Spiegelenburg commented on YARN-9879: - A per queue flag looks very strange. I am also

[jira] [Updated] (YARN-10083) Provide utility to ask whether an application is in final status

2020-01-14 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-10083: -- Attachment: YARN-10083.002.patch > Provide utility to ask whether an application is in final status >

[jira] [Commented] (YARN-7913) Improve error handling when application recovery fails with exception

2020-01-14 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YARN-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015435#comment-17015435 ] Wilfred Spiegelenburg commented on YARN-7913: - Thank you [~snemeth] for looking at the patch

[jira] [Comment Edited] (YARN-9879) Allow multiple leaf queues with the same name in CS

2020-01-14 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015404#comment-17015404 ] Wangda Tan edited comment on YARN-9879 at 1/14/20 10:01 PM: [~snemeth], most

[jira] [Commented] (YARN-9879) Allow multiple leaf queues with the same name in CS

2020-01-14 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015404#comment-17015404 ] Wangda Tan commented on YARN-9879: -- [~snemeth], most of the explanation looks reasonable to me. Regarding

[jira] [Updated] (YARN-7913) Improve error handling when application recovery fails with exception

2020-01-14 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YARN-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-7913: Description: There are edge cases when the application recovery fails with an

[jira] [Resolved] (YARN-8470) Fair scheduler exception with SLS

2020-01-14 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YARN-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YARN-8470. - Assignee: Wilfred Spiegelenburg (was: Szilard Nemeth) Resolution: Duplicate

[jira] [Commented] (YARN-8470) Fair scheduler exception with SLS

2020-01-14 Thread Wilfred Spiegelenburg (Jira)
[ https://issues.apache.org/jira/browse/YARN-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015344#comment-17015344 ] Wilfred Spiegelenburg commented on YARN-8470: - [~Steven Rand] this has been fixed via

[jira] [Commented] (YARN-9970) Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015337#comment-17015337 ] Hadoop QA commented on YARN-9970: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015333#comment-17015333 ] Hadoop QA commented on YARN-9892: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8529) Add timeout to RouterWebServiceUtil#invokeRMWebService

2020-01-14 Thread Jira
[ https://issues.apache.org/jira/browse/YARN-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015232#comment-17015232 ] Íñigo Goiri commented on YARN-8529: --- We should fix most of the checkstyle issues. I still think that

[jira] [Commented] (YARN-10029) Add option to UIv2 to get container logs from the new JHS API

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015219#comment-17015219 ] Hadoop QA commented on YARN-10029: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10083) Provide utility to ask whether an application is in final status

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015207#comment-17015207 ] Hadoop QA commented on YARN-10083: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9970) Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping

2020-01-14 Thread Manikandan R (Jira)
[ https://issues.apache.org/jira/browse/YARN-9970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-9970: --- Attachment: YARN-9970.009.patch > Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping >

[jira] [Commented] (YARN-9970) Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping

2020-01-14 Thread Manikandan R (Jira)
[ https://issues.apache.org/jira/browse/YARN-9970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015195#comment-17015195 ] Manikandan R commented on YARN-9970: [~snemeth] Thanks for your review. Attached .009.patch. >

[jira] [Commented] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2020-01-14 Thread Manikandan R (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015194#comment-17015194 ] Manikandan R commented on YARN-9892: [~pbacsko] Sorry for the delay. Addressed all comments in

[jira] [Updated] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2020-01-14 Thread Manikandan R (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-9892: --- Attachment: YARN-9892.002.patch > Capacity scheduler: support DRF ordering policy on queue level >

[jira] [Commented] (YARN-10082) FS-CS converter: disable terminal placement rule checking

2020-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015184#comment-17015184 ] Peter Bacsko commented on YARN-10082: - [~snemeth] please review this patch. > FS-CS converter:

[jira] [Commented] (YARN-10082) FS-CS converter: disable terminal placement rule checking

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015180#comment-17015180 ] Hadoop QA commented on YARN-10082: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10029) Add option to UIv2 to get container logs from the new JHS API

2020-01-14 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015177#comment-17015177 ] Adam Antal commented on YARN-10029: --- Uploaded WIP patch v1. Added models and adapters for JHS health,

[jira] [Updated] (YARN-10029) Add option to UIv2 to get container logs from the new JHS API

2020-01-14 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-10029: -- Attachment: YARN-10029.001.patch > Add option to UIv2 to get container logs from the new JHS API >

[jira] [Commented] (YARN-10070) NPE if no rule is defined and application-tag-based-placement is enabled

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015140#comment-17015140 ] Hadoop QA commented on YARN-10070: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10028) Integrate the new abstract log servlet to the JobHistory server

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015120#comment-17015120 ] Hadoop QA commented on YARN-10028: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10028) Integrate the new abstract log servlet to the JobHistory server

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015101#comment-17015101 ] Hadoop QA commented on YARN-10028: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-6592) [Umbrella] Rich placement constraints in YARN

2020-01-14 Thread Panagiotis Garefalakis (Jira)
[ https://issues.apache.org/jira/browse/YARN-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-6592: - Attachment: [YARN-5468] Scheduling of long-running applications - ASF JIRA.pdf >

[jira] [Updated] (YARN-6592) [Umbrella] Rich placement constraints in YARN

2020-01-14 Thread Panagiotis Garefalakis (Jira)
[ https://issues.apache.org/jira/browse/YARN-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-6592: - Attachment: [YARN-7812] Improvements to Rich Placement Constraints in YARN - ASF

[jira] [Commented] (YARN-8529) Add timeout to RouterWebServiceUtil#invokeRMWebService

2020-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015087#comment-17015087 ] Hadoop QA commented on YARN-8529: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10082) FS-CS converter: disable terminal placement rule checking

2020-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10082: Attachment: YARN-10082-002.patch > FS-CS converter: disable terminal placement rule checking >

[jira] [Commented] (YARN-10028) Integrate the new abstract log servlet to the JobHistory server

2020-01-14 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015049#comment-17015049 ] Hudson commented on YARN-10028: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17861 (See

[jira] [Commented] (YARN-9788) Queue Management API does not support parallel updates

2020-01-14 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-9788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015050#comment-17015050 ] Hudson commented on YARN-9788: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17861 (See

[jira] [Commented] (YARN-10070) NPE if no rule is defined and application-tag-based-placement is enabled

2020-01-14 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015034#comment-17015034 ] Adam Antal commented on YARN-10070: --- Hi [~kmarton]! Thanks for the patch. It looks good to me overall,

[jira] [Commented] (YARN-10083) Provide utility to ask whether an application is in final status

2020-01-14 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015031#comment-17015031 ] Adam Antal commented on YARN-10083: --- Uploaded patch v2 - fixing checkstyles (supposedly), and added

[jira] [Updated] (YARN-10083) Provide utility to ask whether an application is in final status

2020-01-14 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-10083: -- Attachment: YARN-10083.002.patch > Provide utility to ask whether an application is in final status >

[jira] [Commented] (YARN-8903) when NM becomes unhealthy due to local disk usage, have option to kill application using most space instead of releasing all containers on node

2020-01-14 Thread Mor Mayr (Jira)
[ https://issues.apache.org/jira/browse/YARN-8903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015027#comment-17015027 ] Mor Mayr commented on YARN-8903: Hi, we are facing this issue and thought about implementing such a

[jira] [Commented] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2020-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015023#comment-17015023 ] Peter Bacsko commented on YARN-9892: [~maniraj...@gmail.com] have you had the chance to look at my

[jira] [Updated] (YARN-9788) Queue Management API does not support parallel updates

2020-01-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9788: - Fix Version/s: 3.3.0 > Queue Management API does not support parallel updates >

[jira] [Commented] (YARN-9788) Queue Management API does not support parallel updates

2020-01-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015021#comment-17015021 ] Szilard Nemeth commented on YARN-9788: -- Hi [~prabhujoseph], Latest patch LGTM, committed to trunk.

[jira] [Comment Edited] (YARN-10070) NPE if no rule is defined and application-tag-based-placement is enabled

2020-01-14 Thread Kinga Marton (Jira)
[ https://issues.apache.org/jira/browse/YARN-10070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015012#comment-17015012 ] Kinga Marton edited comment on YARN-10070 at 1/14/20 11:19 AM: --- Thank you

[jira] [Updated] (YARN-10070) NPE if no rule is defined and application-tag-based-placement is enabled

2020-01-14 Thread Kinga Marton (Jira)
[ https://issues.apache.org/jira/browse/YARN-10070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kinga Marton updated YARN-10070: Attachment: YARN-10070.002.patch > NPE if no rule is defined and application-tag-based-placement

[jira] [Commented] (YARN-10070) NPE if no rule is defined and application-tag-based-placement is enabled

2020-01-14 Thread Kinga Marton (Jira)
[ https://issues.apache.org/jira/browse/YARN-10070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015012#comment-17015012 ] Kinga Marton commented on YARN-10070: - Thank you [~prabhujoseph] for the review! I have uploaded a

[jira] [Commented] (YARN-9462) TestResourceTrackerService.testNodeRemovalGracefully fails sporadically

2020-01-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015010#comment-17015010 ] Szilard Nemeth commented on YARN-9462: -- Hi [~prabhujoseph], What are the next steps on this? Only a

[jira] [Comment Edited] (YARN-7913) Improve error handling when application recovery fails with exception

2020-01-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015009#comment-17015009 ] Szilard Nemeth edited comment on YARN-7913 at 1/14/20 11:06 AM: Hi

[jira] [Commented] (YARN-7913) Improve error handling when application recovery fails with exception

2020-01-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015009#comment-17015009 ] Szilard Nemeth commented on YARN-7913: -- Hi [~wilfreds], Has read through all comments and checked

[jira] [Commented] (YARN-10028) Integrate the new abstract log servlet to the JobHistory server

2020-01-14 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014982#comment-17014982 ] Adam Antal commented on YARN-10028: --- Thanks, attached patch branch-3.2 (it was a clean cherry-pick). >

[jira] [Updated] (YARN-10028) Integrate the new abstract log servlet to the JobHistory server

2020-01-14 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-10028: -- Attachment: YARN-10028.branch-3.2.001.patch > Integrate the new abstract log servlet to the JobHistory

[jira] [Updated] (YARN-10028) Integrate the new abstract log servlet to the JobHistory server

2020-01-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10028: -- Fix Version/s: 3.3.0 > Integrate the new abstract log servlet to the JobHistory server >

[jira] [Commented] (YARN-10028) Integrate the new abstract log servlet to the JobHistory server

2020-01-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014978#comment-17014978 ] Szilard Nemeth commented on YARN-10028: --- Thanks [~adam.antal] for this patch, latest patch LGTM,

[jira] [Commented] (YARN-9970) Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping

2020-01-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014920#comment-17014920 ] Szilard Nemeth commented on YARN-9970: -- Hi [~maniraj...@gmail.com], 1. Please remove unused