[jira] [Commented] (YARN-10269) SchedConfCLI and LogWebService should reuse util class WebServiceClient

2020-05-22 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114552#comment-17114552 ] Bilwa S T commented on YARN-10269: -- Thanks [~elgoiri] for taking a look at it. > SchedConfCLI and

[jira] [Commented] (YARN-10269) SchedConfCLI and LogWebService should reuse util class WebServiceClient

2020-05-22 Thread Jira
[ https://issues.apache.org/jira/browse/YARN-10269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114464#comment-17114464 ] Íñigo Goiri commented on YARN-10269: I took a look a couple of days ago and to be honest, I don't

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-22 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114350#comment-17114350 ] Jonathan Hung edited comment on YARN-6492 at 5/22/20, 11:34 PM: Thank you

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-22 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114350#comment-17114350 ] Jonathan Hung edited comment on YARN-6492 at 5/22/20, 10:50 PM: Thank you

[jira] [Commented] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels are used

2020-05-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114382#comment-17114382 ] Hadoop QA commented on YARN-10283: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-22 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114350#comment-17114350 ] Jonathan Hung commented on YARN-6492: - Thank you [~maniraj...@gmail.com]. Some more comments: * Delete

[jira] [Commented] (YARN-10286) PendingContainers bugs in the scheduler outputs

2020-05-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114351#comment-17114351 ] Hadoop QA commented on YARN-10286: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9941) Opportunistic scheduler metrics should be reset during fail-over.

2020-05-22 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-9941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114343#comment-17114343 ] Bilwa S T commented on YARN-9941: - Hi [~abmodi] Can i work on this? > Opportunistic scheduler metrics

[jira] [Commented] (YARN-9971) YARN Native Service HttpProbe logs THIS_HOST in error messages

2020-05-22 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-9971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114330#comment-17114330 ] Bilwa S T commented on YARN-9971: - Hi [~tarunparimi] Can i take this over if you are not working on this?

[jira] [Commented] (YARN-10000) Code cleanup in FSSchedulerConfigurationStore

2020-05-22 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114326#comment-17114326 ] Bilwa S T commented on YARN-1: -- can i take this over [~sahuja]? > Code cleanup in

[jira] [Assigned] (YARN-10279) Avoid unnecessary QueueMappingEntity creations

2020-05-22 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T reassigned YARN-10279: Assignee: Bilwa S T > Avoid unnecessary QueueMappingEntity creations >

[jira] [Assigned] (YARN-8671) Container Launch failed stating "TaskAttempt killed because it ran on unusable node , Container released on a *lost* node"

2020-05-22 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T reassigned YARN-8671: --- Assignee: Bilwa S T > Container Launch failed stating "TaskAttempt killed because it ran on >

[jira] [Comment Edited] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels are used

2020-05-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114298#comment-17114298 ] Peter Bacsko edited comment on YARN-10283 at 5/22/20, 6:06 PM: --- I uploaded

[jira] [Commented] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels are used

2020-05-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114298#comment-17114298 ] Peter Bacsko commented on YARN-10283: - I uploaded a new repro test patch. I was able to prove my

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114292#comment-17114292 ] Hadoop QA commented on YARN-6492: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels are used

2020-05-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10283: Attachment: YARN-10283-ReproTest2.patch > Capacity Scheduler: starvation occurs if a higher

[jira] [Commented] (YARN-10269) SchedConfCLI and LogWebService should reuse util class WebServiceClient

2020-05-22 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114289#comment-17114289 ] Bilwa S T commented on YARN-10269: -- [~inigoiri] can you please review this? > SchedConfCLI and

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2020-05-22 Thread Manikandan R (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6492: --- Attachment: YARN-6492.010.WIP.patch > Generate queue metrics for each partition >

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-22 Thread Manikandan R (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114129#comment-17114129 ] Manikandan R commented on YARN-6492: [~jhung] Thanks for your quick turnaround. Addressed all points

[jira] [Updated] (YARN-10288) InvalidStateTransitionException: LAUNCH_FAILED at FAILED

2020-05-22 Thread YCozy (Jira)
[ https://issues.apache.org/jira/browse/YARN-10288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YCozy updated YARN-10288: - Description: We encountered the following exception when testing YARN (2.10.0) under network partition:

[jira] [Created] (YARN-10288) InvalidStateTransitionException: LAUNCH_FAILED at FAILED

2020-05-22 Thread YCozy (Jira)
YCozy created YARN-10288: Summary: InvalidStateTransitionException: LAUNCH_FAILED at FAILED Key: YARN-10288 URL: https://issues.apache.org/jira/browse/YARN-10288 Project: Hadoop YARN Issue Type: Bug

[jira] [Issue Comment Deleted] (YARN-9194) Invalid event: REGISTERED and LAUNCH_FAILED at FAILED, and NullPointerException happens in RM while shutdown a NM

2020-05-22 Thread YCozy (Jira)
[ https://issues.apache.org/jira/browse/YARN-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YCozy updated YARN-9194: Comment: was deleted (was: Hi, we were able to trigger the same bug (LAUNCH_FAILED at FAILED) in 2.10.0. Can we

[jira] [Commented] (YARN-9194) Invalid event: REGISTERED and LAUNCH_FAILED at FAILED, and NullPointerException happens in RM while shutdown a NM

2020-05-22 Thread YCozy (Jira)
[ https://issues.apache.org/jira/browse/YARN-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114123#comment-17114123 ] YCozy commented on YARN-9194: - Hi, we were able to trigger the same bug (LAUNCH_FAILED at FAILED) in 2.10.0.

[jira] [Updated] (YARN-10287) Update scheduler-conf corrupts the CS configuration when removing queue which is referred in queue mapping

2020-05-22 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-10287: - Description: Update scheduler-conf corrupts the CS configuration when removing queue which is

[jira] [Created] (YARN-10287) Update scheduler-conf corrupts the CS configuration when removing queue which is referred in queue mapping

2020-05-22 Thread Prabhu Joseph (Jira)
Prabhu Joseph created YARN-10287: Summary: Update scheduler-conf corrupts the CS configuration when removing queue which is referred in queue mapping Key: YARN-10287 URL:

[jira] [Updated] (YARN-10287) Update scheduler-conf corrupts the CS configuration when removing queue which is referred in queue mapping

2020-05-22 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-10287: - Description: Update scheduler-conf corrupts the CS configuration when removing queue which is

[jira] [Updated] (YARN-10194) YARN RMWebServices /scheduler-conf/validate leaks ZK Connections

2020-05-22 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-10194: - Parent: YARN-5734 Issue Type: Sub-task (was: Bug) > YARN RMWebServices

[jira] [Updated] (YARN-10022) Create RM Rest API to validate a CapacityScheduler Configuration

2020-05-22 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-10022: - Parent: YARN-5734 Issue Type: Sub-task (was: New Feature) > Create RM Rest API to

[jira] [Updated] (YARN-10139) ValidateAndGetSchedulerConfiguration API fails when cluster max allocation > default 8GB

2020-05-22 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-10139: - Parent: YARN-5734 Issue Type: Sub-task (was: Bug) >

[jira] [Commented] (YARN-7145) Identify potential flaky unit tests

2020-05-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114012#comment-17114012 ] Hadoop QA commented on YARN-7145: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10108) FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping

2020-05-22 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114008#comment-17114008 ] Szilard Nemeth commented on YARN-10108: --- Hi [~shuzirra], Pushed to branch-3.3 as well. Thanks for

[jira] [Updated] (YARN-10108) FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping

2020-05-22 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10108: -- Fix Version/s: 3.3.1 > FS-CS converter: nestedUserQueue with default rule results in invalid

[jira] [Assigned] (YARN-10286) PendingContainers bugs in the scheduler outputs

2020-05-22 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-10286: - Assignee: Andras Gyori (was: Adam Antal) > PendingContainers bugs in the scheduler outputs >

[jira] [Commented] (YARN-10108) FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping

2020-05-22 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113949#comment-17113949 ] Hadoop QA commented on YARN-10108: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (YARN-10286) PendingContainers bugs in the scheduler outputs

2020-05-22 Thread Adam Antal (Jira)
Adam Antal created YARN-10286: - Summary: PendingContainers bugs in the scheduler outputs Key: YARN-10286 URL: https://issues.apache.org/jira/browse/YARN-10286 Project: Hadoop YARN Issue Type:

[jira] [Assigned] (YARN-9097) Investigate why GpuDiscoverer methods are synchronized

2020-05-22 Thread Kinga Marton (Jira)
[ https://issues.apache.org/jira/browse/YARN-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kinga Marton reassigned YARN-9097: -- Assignee: (was: Kinga Marton) > Investigate why GpuDiscoverer methods are synchronized >

[jira] [Assigned] (YARN-9371) Better logging for initialization of cgroups in CGroupsHandlerImpl

2020-05-22 Thread Kinga Marton (Jira)
[ https://issues.apache.org/jira/browse/YARN-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kinga Marton reassigned YARN-9371: -- Assignee: (was: Kinga Marton) > Better logging for initialization of cgroups in

[jira] [Assigned] (YARN-7145) Identify potential flaky unit tests

2020-05-22 Thread Kinga Marton (Jira)
[ https://issues.apache.org/jira/browse/YARN-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kinga Marton reassigned YARN-7145: -- Assignee: (was: Kinga Marton) > Identify potential flaky unit tests >

[jira] [Assigned] (YARN-10100) [CS] Separate config validation steps from the update part

2020-05-22 Thread Kinga Marton (Jira)
[ https://issues.apache.org/jira/browse/YARN-10100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kinga Marton reassigned YARN-10100: --- Assignee: (was: Kinga Marton) > [CS] Separate config validation steps from the update

[jira] [Commented] (YARN-10108) FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping

2020-05-22 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113861#comment-17113861 ] Szilard Nemeth commented on YARN-10108: --- [~shuzirra] Can you check the UT failures, please? >