[jira] [Commented] (YARN-9941) Opportunistic scheduler metrics should be reset during fail-over.

2020-07-20 Thread Abhishek Modi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161710#comment-17161710 ] Abhishek Modi commented on YARN-9941: - Sure [~BilwaST]. Feel free to take over. Thanks >

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2020-07-20 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161699#comment-17161699 ] Wangda Tan commented on YARN-10352: --- Also, we need to systematically handle the node heartbeat interval

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2020-07-20 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161696#comment-17161696 ] Wangda Tan commented on YARN-10352: --- Thanks [~prabhujoseph],  Then it makes sense, but the original

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2020-07-20 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161682#comment-17161682 ] Prabhu Joseph commented on YARN-10352: -- [~wangda] For each node in the list given by

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2020-07-20 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161615#comment-17161615 ] Wangda Tan commented on YARN-10352: --- [~prabhujoseph], I'm trying to understand this logic, why we have

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2020-07-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161556#comment-17161556 ] Hadoop QA commented on YARN-10352: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10353) Log vcores used and cumulative cpu in containers monitor

2020-07-20 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161450#comment-17161450 ] Hudson commented on YARN-10353: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18456 (See

[jira] [Commented] (YARN-10353) Log vcores used and cumulative cpu in containers monitor

2020-07-20 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161448#comment-17161448 ] Jim Brennan commented on YARN-10353: Thanks [~ebadger]! > Log vcores used and cumulative cpu in

[jira] [Updated] (YARN-10353) Log vcores used and cumulative cpu in containers monitor

2020-07-20 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-10353: --- Fix Version/s: 3.4.0 > Log vcores used and cumulative cpu in containers monitor >

[jira] [Commented] (YARN-10315) Avoid sending RMNodeResourceupdate event if resource is same

2020-07-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161439#comment-17161439 ] Hadoop QA commented on YARN-10315: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2020-07-20 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-10352: - Attachment: YARN-10352-003.patch > Skip schedule on not heartbeated nodes in Multi Node

[jira] [Updated] (YARN-10355) Refactor NM ContainerLaunch.java#orderEnvByDependencies

2020-07-20 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10355: - Description: The 

[jira] [Created] (YARN-10355) Refactor NM ContainerLaunch.java#orderEnvByDependencies

2020-07-20 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10355: Summary: Refactor NM ContainerLaunch.java#orderEnvByDependencies Key: YARN-10355 URL: https://issues.apache.org/jira/browse/YARN-10355 Project: Hadoop YARN

[jira] [Commented] (YARN-9136) getNMResourceInfo NodeManager REST API method is not documented

2020-07-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161342#comment-17161342 ] Hadoop QA commented on YARN-9136: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10315) Avoid sending RMNodeResourceupdate event if resource is same

2020-07-20 Thread Sushil Ks (Jira)
[ https://issues.apache.org/jira/browse/YARN-10315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks updated YARN-10315: - Attachment: YARN-10315.002.patch > Avoid sending RMNodeResourceupdate event if resource is same >

[jira] [Commented] (YARN-10106) Yarn logs CLI filtering by application attempt

2020-07-20 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161306#comment-17161306 ] Adam Antal commented on YARN-10106: --- +1 from me. > Yarn logs CLI filtering by application attempt >

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2020-07-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161295#comment-17161295 ] Hadoop QA commented on YARN-10352: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10343) Legacy RM UI should include labeled metrics for allocated, total, and reserved resources.

2020-07-20 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161286#comment-17161286 ] Jim Brennan commented on YARN-10343: Thanks for the updates and explanations [~epayne]!  I am +1

[jira] [Commented] (YARN-9136) getNMResourceInfo NodeManager REST API method is not documented

2020-07-20 Thread Jira
[ https://issues.apache.org/jira/browse/YARN-9136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161266#comment-17161266 ] Hudáky Márton Gyula commented on YARN-9136: --- Patch 1 only contains the description of the API,

[jira] [Commented] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-07-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161254#comment-17161254 ] Hadoop QA commented on YARN-10278: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-10315) Avoid sending RMNodeResourceupdate event if resource is same

2020-07-20 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10315: -- Summary: Avoid sending RMNodeResourceupdate event if resource is same (was: Avoid sending

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2020-07-20 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161163#comment-17161163 ] Prabhu Joseph commented on YARN-10352: -- Thanks [~bibinchundatt] for the inputs. 1. Removed

[jira] [Updated] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2020-07-20 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-10352: - Attachment: YARN-10352-002.patch > Skip schedule on not heartbeated nodes in Multi Node

[jira] [Commented] (YARN-10315) Avoid sending RMNodeResoureupdate event if resource is same

2020-07-20 Thread Bibin Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-10315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161114#comment-17161114 ] Bibin Chundatt commented on YARN-10315: --- Thank you [~Sushil-K-S] for the patch. Over all patch

[jira] [Comment Edited] (YARN-10315) Avoid sending RMNodeResoureupdate event if resource is same

2020-07-20 Thread Bibin Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-10315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161114#comment-17161114 ] Bibin Chundatt edited comment on YARN-10315 at 7/20/20, 10:17 AM: -- Thank

[jira] [Commented] (YARN-10315) Avoid sending RMNodeResoureupdate event if resource is same

2020-07-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161100#comment-17161100 ] Hadoop QA commented on YARN-10315: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-07-20 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10278: -- Attachment: YARN-10278.branch-3.3.001.patch > CapacityScheduler test framework >

[jira] [Commented] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-07-20 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17161040#comment-17161040 ] Szilard Nemeth commented on YARN-10278: --- Hi [~epayne], Thanks for taking care of reviewing the

[jira] [Updated] (YARN-9016) DocumentStore as a backend for ATSv2

2020-07-20 Thread Sushil Ks (Jira)
[ https://issues.apache.org/jira/browse/YARN-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks updated YARN-9016: Description: h1. Document Store for ATSv2                The Document Store for ATSv2 is a framework for

[jira] [Comment Edited] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2020-07-20 Thread Bibin Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160936#comment-17160936 ] Bibin Chundatt edited comment on YARN-10352 at 7/20/20, 6:27 AM: -

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2020-07-20 Thread Bibin Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160936#comment-17160936 ] Bibin Chundatt commented on YARN-10352: --- [~prabhujoseph] With current approach we are iterating