[jira] [Updated] (YARN-10319) Record Last N Scheduler Activities from ActivitiesManager

2020-06-23 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-10319: - Attachment: YARN-10319-004.patch > Record Last N Scheduler Activities from ActivitiesManager >

[jira] [Comment Edited] (YARN-10315) Avoid sending RMNodeResoureupdate event if resource is same

2020-06-23 Thread yehuanhuan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143537#comment-17143537 ] yehuanhuan edited comment on YARN-10315 at 6/24/20, 5:33 AM: - hi

[jira] [Commented] (YARN-10315) Avoid sending RMNodeResoureupdate event if resource is same

2020-06-23 Thread yehuanhuan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143537#comment-17143537 ] yehuanhuan commented on YARN-10315: --- Can it be solved by comparing node resource usage before and after

[jira] [Commented] (YARN-10319) Record Last N Scheduler Activities from ActivitiesManager

2020-06-23 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143416#comment-17143416 ] Tao Yang commented on YARN-10319: - Thanks [~prabhujoseph] for this improvement. I agree that it may be

[jira] [Commented] (YARN-10229) [Federation] Client should be able to submit application to RM directly using normal client conf

2020-06-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143308#comment-17143308 ] Hadoop QA commented on YARN-10229: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10229) [Federation] Client should be able to submit application to RM directly using normal client conf

2020-06-23 Thread Young Chen (Jira)
[ https://issues.apache.org/jira/browse/YARN-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143294#comment-17143294 ] Young Chen commented on YARN-10229: --- Two thoughts: * We're checking both the amrmProxyEnabled flag and

[jira] [Updated] (YARN-10229) [Federation] Client should be able to submit application to RM directly using normal client conf

2020-06-23 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-10229: - Attachment: YARN-10229.004.patch > [Federation] Client should be able to submit application to RM

[jira] [Commented] (YARN-10229) [Federation] Client should be able to submit application to RM directly using normal client conf

2020-06-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143252#comment-17143252 ] Hadoop QA commented on YARN-10229: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10229) [Federation] Client should be able to submit application to RM directly using normal client conf

2020-06-23 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143177#comment-17143177 ] Bilwa S T commented on YARN-10229: -- fixed checkstyle issues in .003 patch > [Federation] Client should

[jira] [Updated] (YARN-10229) [Federation] Client should be able to submit application to RM directly using normal client conf

2020-06-23 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-10229: - Attachment: YARN-10229.003.patch > [Federation] Client should be able to submit application to RM

[jira] [Commented] (YARN-10229) [Federation] Client should be able to submit application to RM directly using normal client conf

2020-06-23 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143172#comment-17143172 ] Bilwa S T commented on YARN-10229: -- [~elgoiri] do i need to add  

[jira] [Commented] (YARN-10229) [Federation] Client should be able to submit application to RM directly using normal client conf

2020-06-23 Thread Jira
[ https://issues.apache.org/jira/browse/YARN-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143163#comment-17143163 ] Íñigo Goiri commented on YARN-10229: Not all the checkstyles are solvable but the one with the

[jira] [Commented] (YARN-10229) [Federation] Client should be able to submit application to RM directly using normal client conf

2020-06-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143159#comment-17143159 ] Hadoop QA commented on YARN-10229: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-06-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143099#comment-17143099 ] Szilard Nemeth commented on YARN-10278: --- Ok. We have a green build so the latest patch fixed the

[jira] [Commented] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-06-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143095#comment-17143095 ] Hadoop QA commented on YARN-10278: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10229) [Federation] Client should be able to submit application to RM directly using normal client conf

2020-06-23 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143079#comment-17143079 ] Bilwa S T commented on YARN-10229: -- [~elgoiri] Thanks for reviewing. Updated patch. Handled removing

[jira] [Updated] (YARN-10229) [Federation] Client should be able to submit application to RM directly using normal client conf

2020-06-23 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-10229: - Attachment: YARN-10229.002.patch > [Federation] Client should be able to submit application to RM

[jira] [Commented] (YARN-10277) CapacityScheduler test TestUserGroupMappingPlacementRule should build proper hierarchy

2020-06-23 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143035#comment-17143035 ] Gergely Pollak commented on YARN-10277: --- Thank you for the fix [~snemeth] , the patch seems fine to

[jira] [Commented] (YARN-10316) FS-CS converter: convert maxAppsDefault, maxRunningApps settings

2020-06-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142988#comment-17142988 ] Szilard Nemeth commented on YARN-10316: --- Thanks [~pbacsko], Committed branch-3.3 patch as well.

[jira] [Updated] (YARN-10316) FS-CS converter: convert maxAppsDefault, maxRunningApps settings

2020-06-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10316: -- Fix Version/s: 3.3.1 > FS-CS converter: convert maxAppsDefault, maxRunningApps settings >

[jira] [Commented] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-06-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142962#comment-17142962 ] Szilard Nemeth commented on YARN-10278: --- Found one issue with patch001, it was a tricky one,

[jira] [Updated] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-06-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10278: -- Attachment: YARN-10277.002.patch > CapacityScheduler test framework >

[jira] [Updated] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-06-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10278: -- Attachment: YARN-10278.002.patch > CapacityScheduler test framework >

[jira] [Updated] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-06-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10278: -- Attachment: (was: YARN-10277.002.patch) > CapacityScheduler test framework >

[jira] [Commented] (YARN-10304) Create an endpoint for remote application log directory path query

2020-06-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142948#comment-17142948 ] Hadoop QA commented on YARN-10304: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10316) FS-CS converter: convert maxAppsDefault, maxRunningApps settings

2020-06-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142941#comment-17142941 ] Hadoop QA commented on YARN-10316: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10166) Add detail log for ApplicationAttemptNotFoundException

2020-06-23 Thread Youquan Lin (Jira)
[ https://issues.apache.org/jira/browse/YARN-10166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142908#comment-17142908 ] Youquan Lin commented on YARN-10166: Could you please take a look? [~sunilg] > Add detail log for

[jira] [Commented] (YARN-10325) Document max-parallel-apps for Capacity Scheduler

2020-06-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142871#comment-17142871 ] Hadoop QA commented on YARN-10325: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10304) Create an endpoint for remote application log directory path query

2020-06-23 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142847#comment-17142847 ] Andras Gyori commented on YARN-10304: - Thank you [~adam.antal] for the review. I have addressed all

[jira] [Updated] (YARN-10304) Create an endpoint for remote application log directory path query

2020-06-23 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10304: Attachment: YARN-10304.006.patch > Create an endpoint for remote application log directory path

[jira] [Updated] (YARN-10325) Document max-parallel-apps for Capacity Scheduler

2020-06-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10325: Attachment: YARN-10325-branch-3.3.001.patch > Document max-parallel-apps for Capacity Scheduler >

[jira] [Commented] (YARN-10316) FS-CS converter: convert maxAppsDefault, maxRunningApps settings

2020-06-23 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-10316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142824#comment-17142824 ] Hudson commented on YARN-10316: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18376 (See

[jira] [Updated] (YARN-10316) FS-CS converter: convert maxAppsDefault, maxRunningApps settings

2020-06-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10316: Attachment: YARN-10316-branch-3.3.001.patch > FS-CS converter: convert maxAppsDefault,

[jira] [Commented] (YARN-10316) FS-CS converter: convert maxAppsDefault, maxRunningApps settings

2020-06-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142812#comment-17142812 ] Szilard Nemeth commented on YARN-10316: --- Hi [~pbacsko], Thanks for working on this. Latest patch

[jira] [Updated] (YARN-10316) FS-CS converter: convert maxAppsDefault, maxRunningApps settings

2020-06-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10316: -- Fix Version/s: 3.4.0 > FS-CS converter: convert maxAppsDefault, maxRunningApps settings >

[jira] [Commented] (YARN-8047) RMWebApp make external class pluggable

2020-06-23 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-8047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142799#comment-17142799 ] Prabhu Joseph commented on YARN-8047: - [~BilwaST] Thanks for the patch. Below are some of the

[jira] [Commented] (YARN-10279) Avoid unnecessary QueueMappingEntity creations

2020-06-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142789#comment-17142789 ] Szilard Nemeth commented on YARN-10279: --- [~mhudaky], [~shuzirra], I think it's worth to file a jira

[jira] [Commented] (YARN-10279) Avoid unnecessary QueueMappingEntity creations

2020-06-23 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142786#comment-17142786 ] Gergely Pollak commented on YARN-10279: --- [~mhudaky] thank you for the patch, LGTM+1 (non-binding),

[jira] [Commented] (YARN-10279) Avoid unnecessary QueueMappingEntity creations

2020-06-23 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142690#comment-17142690 ] Adam Antal commented on YARN-10279: --- Thanks for the patch [~mhudaky]. The unit test failures seem

[jira] [Commented] (YARN-10325) Document max-parallel-apps for Capacity Scheduler

2020-06-23 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142649#comment-17142649 ] Andras Gyori commented on YARN-10325: - The patch LGTM, +1. > Document max-parallel-apps for Capacity