[jira] [Created] (YARN-10306) Create copy log aggregation file controller

2020-06-03 Thread Adam Antal (Jira)
Adam Antal created YARN-10306: - Summary: Create copy log aggregation file controller Key: YARN-10306 URL: https://issues.apache.org/jira/browse/YARN-10306 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-10274) Merge QueueMapping and QueueMappingEntity

2020-06-03 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10274: -- Attachment: YARN-10274.003.patch > Merge QueueMapping and QueueMappingEntity >

[jira] [Commented] (YARN-10279) Avoid unnecessary QueueMappingEntity creations

2020-06-03 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124908#comment-17124908 ] Bilwa S T commented on YARN-10279: -- [~adam.antal] you can take it over > Avoid unnecessary

[jira] [Updated] (YARN-10306) Create simple copy log aggregation file controller

2020-06-03 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-10306: -- Summary: Create simple copy log aggregation file controller (was: Create copy log aggregation file

[jira] [Commented] (YARN-6857) Support REST for Node Attributes configurations

2020-06-03 Thread Naganarasimha G R (Jira)
[ https://issues.apache.org/jira/browse/YARN-6857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124842#comment-17124842 ] Naganarasimha G R commented on YARN-6857: - [~prabhujoseph], Glad that you and [~bilwa_st]  can

[jira] [Commented] (YARN-10303) One yarn rest api example of yarn document is error

2020-06-03 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124870#comment-17124870 ] Adam Antal commented on YARN-10303: --- Thanks for raising this [~zgw]! I see that it is currently

[jira] [Commented] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124911#comment-17124911 ] Hadoop QA commented on YARN-10281: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6857) Support REST for Node Attributes configurations

2020-06-03 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-6857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124798#comment-17124798 ] Prabhu Joseph commented on YARN-6857: - [~Naganarasimha] Would like to have these changes in Hadoop,

[jira] [Commented] (YARN-6857) Support REST for Node Attributes configurations

2020-06-03 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-6857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124861#comment-17124861 ] Prabhu Joseph commented on YARN-6857: - Thanks [~Naganarasimha]. > Support REST for Node Attributes

[jira] [Assigned] (YARN-6857) Support REST for Node Attributes configurations

2020-06-03 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-6857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph reassigned YARN-6857: --- Assignee: Bilwa S T (was: Naganarasimha G R) > Support REST for Node Attributes

[jira] [Commented] (YARN-10181) Managing Centralized Node Attribute via RMWebServices.

2020-06-03 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124741#comment-17124741 ] Prabhu Joseph commented on YARN-10181: -- [~BilwaST] Yes, we will close this Jira as duplicate. Can

[jira] [Resolved] (YARN-10181) Managing Centralized Node Attribute via RMWebServices.

2020-06-03 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph resolved YARN-10181. -- Resolution: Duplicate > Managing Centralized Node Attribute via RMWebServices. >

[jira] [Assigned] (YARN-10031) Create a general purpose log request with additional query parameters

2020-06-03 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-10031: - Assignee: Andras Gyori (was: Adam Antal) > Create a general purpose log request with

[jira] [Commented] (YARN-10303) One yarn rest api example of yarn document is error

2020-06-03 Thread bright.zhou (Jira)
[ https://issues.apache.org/jira/browse/YARN-10303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124878#comment-17124878 ] bright.zhou commented on YARN-10303: hi [~adam.antal] , I'm glad you did > One yarn rest api example

[jira] [Updated] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-03 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10281: -- Attachment: YARN-10281.001.patch > Redundant QueuePath usage in UserGroupMappingPlacementRule

[jira] [Commented] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-03 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124905#comment-17124905 ] Gergely Pollak commented on YARN-10281: --- This probably will fail, since the dependency is not

[jira] [Commented] (YARN-10181) Managing Centralized Node Attribute via RMWebServices.

2020-06-03 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124776#comment-17124776 ] Prabhu Joseph commented on YARN-10181: -- Yes after notifying the JIRA owner. > Managing Centralized

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124801#comment-17124801 ] Peter Bacsko commented on YARN-9903: [~Jim_Brennan] thanks for the patch. From your comment, I assume

[jira] [Commented] (YARN-10279) Avoid unnecessary QueueMappingEntity creations

2020-06-03 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124876#comment-17124876 ] Adam Antal commented on YARN-10279: --- Hi [~BilwaST], Do you plan to work on this on the near future? >

[jira] [Commented] (YARN-10181) Managing Centralized Node Attribute via RMWebServices.

2020-06-03 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124773#comment-17124773 ] Bilwa S T commented on YARN-10181: -- [~prabhujoseph] ok will do it today. can i reassign that jira? >

[jira] [Commented] (YARN-10293) Reserved Containers not allocated from available space of other nodes in CandidateNodeSet in MultiNodePlacement (YARN-10259)

2020-06-03 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124807#comment-17124807 ] Prabhu Joseph commented on YARN-10293: -- Thanks [~Tao Yang] for the comments. If you are fine, will

[jira] [Commented] (YARN-9971) YARN Native Service HttpProbe logs THIS_HOST in error messages

2020-06-03 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-9971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124817#comment-17124817 ] Bilwa S T commented on YARN-9971: - [~prabhujoseph] can i assign this jira as there is no update on this?

[jira] [Updated] (YARN-10303) One yarn rest api example of yarn document is error

2020-06-03 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-10303: -- Labels: documentation newbie (was: ) > One yarn rest api example of yarn document is error >

[jira] [Assigned] (YARN-10303) One yarn rest api example of yarn document is error

2020-06-03 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-10303: - Assignee: Hudáky Márton Gyula > One yarn rest api example of yarn document is error >

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125136#comment-17125136 ] Eric Payne commented on YARN-9903: -- As [~Jim_Brennan] pointed out, our usage of node labels is somewhat

[jira] [Commented] (YARN-9930) Support max running app logic for CapacityScheduler

2020-06-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124932#comment-17124932 ] Peter Bacsko commented on YARN-9930: Attached POC v4 with a new unit tests which verifies the new

[jira] [Comment Edited] (YARN-9930) Support max running app logic for CapacityScheduler

2020-06-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124932#comment-17124932 ] Peter Bacsko edited comment on YARN-9930 at 6/3/20, 1:02 PM: - Attached POC v4

[jira] [Comment Edited] (YARN-9930) Support max running app logic for CapacityScheduler

2020-06-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124947#comment-17124947 ] Peter Bacsko edited comment on YARN-9930 at 6/3/20, 1:20 PM: - [~epayne]

[jira] [Commented] (YARN-9930) Support max running app logic for CapacityScheduler

2020-06-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124947#comment-17124947 ] Peter Bacsko commented on YARN-9930: [~epayne] [~cane] [~snemeth] [~sunilg] could you guys share your

[jira] [Comment Edited] (YARN-9930) Support max running app logic for CapacityScheduler

2020-06-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124947#comment-17124947 ] Peter Bacsko edited comment on YARN-9930 at 6/3/20, 1:20 PM: - [~epayne]

[jira] [Commented] (YARN-10292) FS-CS converter: add an option to enable asynchronous scheduling in CapacityScheduler

2020-06-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125192#comment-17125192 ] Hadoop QA commented on YARN-10292: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-10300) appMasterHost not set in RM ApplicationSummary when AM fails before first heartbeat

2020-06-03 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125139#comment-17125139 ] Eric Badger edited comment on YARN-10300 at 6/3/20, 5:09 PM: - Thanks for the

[jira] [Commented] (YARN-10300) appMasterHost not set in RM ApplicationSummary when AM fails before first heartbeat

2020-06-03 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125139#comment-17125139 ] Eric Badger commented on YARN-10300: [~epayne], would you mind looking at this patch as well to give

[jira] [Commented] (YARN-10296) Make ContainerPBImpl#getId/setId synchronized

2020-06-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125132#comment-17125132 ] Hadoop QA commented on YARN-10296: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9930) Support max running app logic for CapacityScheduler

2020-06-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9930: --- Attachment: YARN-9930-POC04.patch > Support max running app logic for CapacityScheduler >

[jira] [Commented] (YARN-10274) Merge QueueMapping and QueueMappingEntity

2020-06-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124964#comment-17124964 ] Hadoop QA commented on YARN-10274: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10300) appMasterHost not set in RM ApplicationSummary when AM fails before first heartbeat

2020-06-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124994#comment-17124994 ] Jim Brennan commented on YARN-10300: Thanks [~ebadger]! Patch 002 looks good to me. I verified it

[jira] [Comment Edited] (YARN-9930) Support max running app logic for CapacityScheduler

2020-06-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124932#comment-17124932 ] Peter Bacsko edited comment on YARN-9930 at 6/3/20, 4:02 PM: - Attached POC v4

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124985#comment-17124985 ] Jim Brennan commented on YARN-9903: --- We have been running with this patch in branch-2.8 for years on

[jira] [Commented] (YARN-9930) Support max running app logic for CapacityScheduler

2020-06-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125058#comment-17125058 ] Hadoop QA commented on YARN-9930: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10296) Make ContainerPBImpl#getId/setId synchronized

2020-06-03 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10296: - Attachment: YARN-10296.002.patch > Make ContainerPBImpl#getId/setId synchronized >

[jira] [Updated] (YARN-10292) FS-CS converter: add an option to enable asynchronous scheduling in CapacityScheduler

2020-06-03 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10292: - Attachment: YARN-10292.001.patch > FS-CS converter: add an option to enable asynchronous

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125351#comment-17125351 ] Eric Payne commented on YARN-9903: -- [~Jim_Brennan], The code changes in the latest patch look good. Can

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125358#comment-17125358 ] Jim Brennan commented on YARN-9903: --- Thanks [~epayne]! I will work on adding a unit test for this. >

[jira] [Commented] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels are used

2020-06-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125342#comment-17125342 ] Eric Payne commented on YARN-10283: --- bq. Please feel free to pull in the additional changes from