[jira] [Commented] (YARN-10234) FS-CS converter: don't enable auto-create queue property for root

2020-04-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083594#comment-17083594 ] Peter Bacsko commented on YARN-10234: - [~sunilg] [~snemeth] please review & commit. > FS-CS

[jira] [Comment Edited] (YARN-10102) Capacity scheduler: add support for %specified mapping

2020-04-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17084989#comment-17084989 ] Peter Bacsko edited comment on YARN-10102 at 4/16/20, 3:33 PM: --- So, did

[jira] [Commented] (YARN-10102) Capacity scheduler: add support for %specified mapping

2020-04-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17084989#comment-17084989 ] Peter Bacsko commented on YARN-10102: - So, did review the patch, some comments. 1. I can see that

[jira] [Comment Edited] (YARN-10102) Capacity scheduler: add support for %specified mapping

2020-04-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17084989#comment-17084989 ] Peter Bacsko edited comment on YARN-10102 at 4/16/20, 3:31 PM: --- So, did

[jira] [Comment Edited] (YARN-10102) Capacity scheduler: add support for %specified mapping

2020-04-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17084989#comment-17084989 ] Peter Bacsko edited comment on YARN-10102 at 4/16/20, 3:32 PM: --- So, did

[jira] [Updated] (YARN-10234) FS-CS converter: don't enable auto-create queue property for root

2020-04-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10234: Summary: FS-CS converter: don't enable auto-create queue property for root (was: FS-CS converter:

[jira] [Created] (YARN-10234) FS-CS converter: don't enale auto-create queue property for root

2020-04-14 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10234: --- Summary: FS-CS converter: don't enale auto-create queue property for root Key: YARN-10234 URL: https://issues.apache.org/jira/browse/YARN-10234 Project: Hadoop YARN

[jira] [Updated] (YARN-10234) FS-CS converter: don't enable auto-create queue property for root

2020-04-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10234: Attachment: YARN-10234-001.patch > FS-CS converter: don't enable auto-create queue property for

[jira] [Updated] (YARN-10226) NPE in Capacity Scheduler while using %primary_group queue mapping

2020-04-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10226: Attachment: YARN-10234-002.patch > NPE in Capacity Scheduler while using %primary_group queue

[jira] [Updated] (YARN-10234) FS-CS converter: don't enable auto-create queue property for root

2020-04-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10234: Attachment: YARN-10234-002.patch > FS-CS converter: don't enable auto-create queue property for

[jira] [Commented] (YARN-10102) Capacity scheduler: add support for %specified mapping

2020-04-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17084080#comment-17084080 ] Peter Bacsko commented on YARN-10102: - Thanks for the patch [~tanu.ajmera] I'll review it as soon as

[jira] [Created] (YARN-10197) FS-CS converter: fix emitted ordering policy string and max-am-resource percent value

2020-03-13 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10197: --- Summary: FS-CS converter: fix emitted ordering policy string and max-am-resource percent value Key: YARN-10197 URL: https://issues.apache.org/jira/browse/YARN-10197

[jira] [Updated] (YARN-10197) FS-CS converter: fix emitted ordering policy string and max-am-resource percent value

2020-03-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10197: Description: There are two problems that have to be addressed in the converter: 1) For

[jira] [Updated] (YARN-10197) FS-CS converter: fix emitted ordering policy string and max-am-resource percent value

2020-03-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10197: Description: There are two problems that have to be addressed in the converter: 1) For

[jira] [Updated] (YARN-10197) FS-CS converter: fix emitted ordering policy string and max-am-resource percent value

2020-03-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10197: Description: There are two problems that have to be addressed in the converter: 1) For

[jira] [Updated] (YARN-10197) FS-CS converter: fix emitted ordering policy string and max-am-resource percent value

2020-03-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10197: Description: There are two problems that have to be addressed in the converter: 1) For

[jira] [Created] (YARN-10198) [managedParent].%primary_group placement doesn't work after YARN-9868

2020-03-13 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10198: --- Summary: [managedParent].%primary_group placement doesn't work after YARN-9868 Key: YARN-10198 URL: https://issues.apache.org/jira/browse/YARN-10198 Project: Hadoop

[jira] [Commented] (YARN-10198) [managedParent].%primary_group placement doesn't work after YARN-9868

2020-03-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058808#comment-17058808 ] Peter Bacsko commented on YARN-10198: - cc [~prabhujoseph] [~sunilg] > [managedParent].%primary_group

[jira] [Updated] (YARN-10198) [managedParent].%primary_group mapping rule doesn't work after YARN-9868

2020-03-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10198: Summary: [managedParent].%primary_group mapping rule doesn't work after YARN-9868 (was:

[jira] [Updated] (YARN-10197) FS-CS converter: fix emitted ordering policy string and max-am-resource percent value

2020-03-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10197: Attachment: YARN-10197-001.patch > FS-CS converter: fix emitted ordering policy string and

[jira] [Updated] (YARN-10197) FS-CS converter: fix emitted ordering policy string and max-am-resource percent value

2020-03-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10197: Attachment: YARN-10197-002.patch > FS-CS converter: fix emitted ordering policy string and

[jira] [Updated] (YARN-10197) FS-CS converter: fix emitted ordering policy string and max-am-resource percent value

2020-03-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10197: Description: There are three problems that have to be addressed in the converter: 1) For

[jira] [Commented] (YARN-10197) FS-CS converter: fix emitted ordering policy string and max-am-resource percent value

2020-03-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17058767#comment-17058767 ] Peter Bacsko commented on YARN-10197: - Note: patch v1 will be extended later with some more unit

[jira] [Updated] (YARN-10197) FS-CS converter: fix emitted ordering policy string and max-am-resource percent value

2020-03-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10197: Attachment: YARN-10197-003.patch > FS-CS converter: fix emitted ordering policy string and

[jira] [Commented] (YARN-10198) [managedParent].%primary_group mapping rule doesn't work after YARN-9868

2020-03-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060409#comment-17060409 ] Peter Bacsko commented on YARN-10198: - [~maniraj...@gmail.com] I think so. YARN-9868 introduced a

[jira] [Comment Edited] (YARN-10199) Simplify UserGroupMappingPlacementRule#getPlacementForUser

2020-03-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068568#comment-17068568 ] Peter Bacsko edited comment on YARN-10199 at 3/27/20, 11:07 AM:

[jira] [Commented] (YARN-10199) Simplify UserGroupMappingPlacementRule#getPlacementForUser

2020-03-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068568#comment-17068568 ] Peter Bacsko commented on YARN-10199: - [~gandras] some minor nits: 1. in {{getPlacementForUser()}}:

[jira] [Commented] (YARN-10049) FIFOOrderingPolicy Improvements

2020-03-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068678#comment-17068678 ] Peter Bacsko commented on YARN-10049: - Just minor nits: 1. {{if(res == 0)}} whitespace after "if" 2.

[jira] [Commented] (YARN-10108) FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping

2020-04-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17091757#comment-17091757 ] Peter Bacsko commented on YARN-10108: - Update: after YARN-9879, the issue still persists. Will have a

[jira] [Commented] (YARN-10199) Simplify UserGroupMappingPlacementRule#getPlacementForUser

2020-04-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090622#comment-17090622 ] Peter Bacsko commented on YARN-10199: - [~gandras] in the meantime, YARN-10226 went in because there

[jira] [Created] (YARN-10257) FS-CS converter: check deprecated increment properties for mem/vcores and fix DRF check

2020-05-03 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10257: --- Summary: FS-CS converter: check deprecated increment properties for mem/vcores and fix DRF check Key: YARN-10257 URL: https://issues.apache.org/jira/browse/YARN-10257

[jira] [Updated] (YARN-10257) FS-CS converter: check deprecated increment properties for mem/vcores and fix DRF check

2020-05-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10257: Description: Two issues have been discovered during fs2cs testing: 1. The value of two properties

[jira] [Updated] (YARN-10257) FS-CS converter: skip increment properties for mem/vcores and fix DRF check

2020-05-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10257: Attachment: YARN-10257-001.patch > FS-CS converter: skip increment properties for mem/vcores and

[jira] [Updated] (YARN-10257) FS-CS converter: skip increment properties for mem/vcores and fix DRF check

2020-05-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10257: Summary: FS-CS converter: skip increment properties for mem/vcores and fix DRF check (was: FS-CS

[jira] [Updated] (YARN-10257) FS-CS converter: skip increment properties for mem/vcores and fix DRF check

2020-05-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10257: Description: Two issues have been discovered during fs2cs testing: 1. The conversion of

[jira] [Commented] (YARN-10257) FS-CS converter: skip increment properties for mem/vcores and fix DRF check

2020-05-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099216#comment-17099216 ] Peter Bacsko commented on YARN-10257: - Checkstyle is not relevant. [~snemeth] please review. > FS-CS

[jira] [Commented] (YARN-10257) FS-CS converter: skip increment properties for mem/vcores and fix DRF check

2020-05-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099218#comment-17099218 ] Peter Bacsko commented on YARN-10257: - Note: I modified how we call {{System.exit()}} from the tests.

[jira] [Updated] (YARN-10257) FS-CS converter: skip increment properties for mem/vcores and fix DRF check

2020-05-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10257: Attachment: YARN-10257-002.patch > FS-CS converter: skip increment properties for mem/vcores and

[jira] [Assigned] (YARN-10108) FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping

2020-04-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-10108: --- Assignee: Gergely Pollak (was: Peter Bacsko) > FS-CS converter: nestedUserQueue with

[jira] [Updated] (YARN-10226) NPE in Capacity Scheduler while using %primary_group queue mapping

2020-04-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10226: Attachment: (was: YARN-10234-002.patch) > NPE in Capacity Scheduler while using %primary_group

[jira] [Resolved] (YARN-10158) FS-CS converter: convert property yarn.scheduler.fair.update-interval-ms

2020-05-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko resolved YARN-10158. - Resolution: Won't Do > FS-CS converter: convert property yarn.scheduler.fair.update-interval-ms

[jira] [Commented] (YARN-10158) FS-CS converter: convert property yarn.scheduler.fair.update-interval-ms

2020-05-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106045#comment-17106045 ] Peter Bacsko commented on YARN-10158: - As discussed offline with [~leftnoteasy], it's a very low

[jira] [Comment Edited] (YARN-10254) CapacityScheduler incorrect User Group Mapping after leaf queue change

2020-05-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106252#comment-17106252 ] Peter Bacsko edited comment on YARN-10254 at 5/13/20, 12:16 PM: Thanks

[jira] [Commented] (YARN-10254) CapacityScheduler incorrect User Group Mapping after leaf queue change

2020-05-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106252#comment-17106252 ] Peter Bacsko commented on YARN-10254: - Thanks for the latest patch [~shuzirra] I don't really

[jira] [Comment Edited] (YARN-10254) CapacityScheduler incorrect User Group Mapping after leaf queue change

2020-05-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102597#comment-17102597 ] Peter Bacsko edited comment on YARN-10254 at 5/8/20, 1:39 PM: -- Regarding #2

[jira] [Commented] (YARN-10254) CapacityScheduler incorrect User Group Mapping after leaf queue change

2020-05-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102597#comment-17102597 ] Peter Bacsko commented on YARN-10254: - Regarding #2 I would vot for throwing an exception. For

[jira] [Comment Edited] (YARN-10254) CapacityScheduler incorrect User Group Mapping after leaf queue change

2020-05-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102597#comment-17102597 ] Peter Bacsko edited comment on YARN-10254 at 5/8/20, 1:38 PM: -- Regarding #2

[jira] [Comment Edited] (YARN-10254) CapacityScheduler incorrect User Group Mapping after leaf queue change

2020-05-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102597#comment-17102597 ] Peter Bacsko edited comment on YARN-10254 at 5/8/20, 1:42 PM: -- Regarding #2

[jira] [Commented] (YARN-9863) Randomize List of Resources to Localize

2020-05-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17107386#comment-17107386 ] Peter Bacsko commented on YARN-9863: I would involve active people in the YARN community like

[jira] [Commented] (YARN-9930) Support max running app logic for CapacityScheduler

2020-05-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106183#comment-17106183 ] Peter Bacsko commented on YARN-9930: [~cane] any updates here? Do you have a patch? > Support max

[jira] [Commented] (YARN-10108) FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping

2020-05-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106208#comment-17106208 ] Peter Bacsko commented on YARN-10108: - Thanks for the patch [~shuzirra]. Just one comment - this

[jira] [Commented] (YARN-10198) [managedParent].%primary_group mapping rule doesn't work after YARN-9868

2020-03-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062414#comment-17062414 ] Peter Bacsko commented on YARN-10198: - [~sunilg] the patch needs to be extended. In its current form,

[jira] [Comment Edited] (YARN-10198) [managedParent].%primary_group mapping rule doesn't work after YARN-9868

2020-03-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062531#comment-17062531 ] Peter Bacsko edited comment on YARN-10198 at 3/19/20, 12:39 PM: I

[jira] [Updated] (YARN-10198) [managedParent].%primary_group mapping rule doesn't work after YARN-9868

2020-03-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10198: Attachment: YARN-10198-002.patch > [managedParent].%primary_group mapping rule doesn't work after

[jira] [Commented] (YARN-10198) [managedParent].%primary_group mapping rule doesn't work after YARN-9868

2020-03-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062531#comment-17062531 ] Peter Bacsko commented on YARN-10198: - I uploaded patch v2. Couple of things: 1. I was reasoning

[jira] [Commented] (YARN-10198) [managedParent].%primary_group mapping rule doesn't work after YARN-9868

2020-03-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060958#comment-17060958 ] Peter Bacsko commented on YARN-10198: - Test failure is unrelated. > [managedParent].%primary_group

[jira] [Commented] (YARN-10197) FS-CS converter: fix emitted ordering policy string and max-am-resource percent value

2020-03-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060874#comment-17060874 ] Peter Bacsko commented on YARN-10197: - [~prabhujoseph] could you review & commit this patch? >

[jira] [Comment Edited] (YARN-10199) Simplify UserGroupMappingPlacementRule#getPlacementForUser

2020-03-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060876#comment-17060876 ] Peter Bacsko edited comment on YARN-10199 at 3/17/20, 12:26 PM:

[jira] [Commented] (YARN-10199) Simplify UserGroupMappingPlacementRule#getPlacementForUser

2020-03-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060876#comment-17060876 ] Peter Bacsko commented on YARN-10199: - [~gandras] I'm wondering whether it makes sense to create a

[jira] [Commented] (YARN-10198) [managedParent].%primary_group mapping rule doesn't work after YARN-9868

2020-03-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060857#comment-17060857 ] Peter Bacsko commented on YARN-10198: - Thanks [~akhilpb]. [~prabhujoseph] could you please review

[jira] [Updated] (YARN-10198) [managedParent].%primary_group mapping rule doesn't work after YARN-9868

2020-03-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10198: Attachment: YARN-10198-003.patch > [managedParent].%primary_group mapping rule doesn't work after

[jira] [Commented] (YARN-10198) [managedParent].%primary_group mapping rule doesn't work after YARN-9868

2020-03-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17063433#comment-17063433 ] Peter Bacsko commented on YARN-10198: - [~maniraj...@gmail.com] I was thinking about adding a comment

[jira] [Commented] (YARN-10198) [managedParent].%primary_group mapping rule doesn't work after YARN-9868

2020-03-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064750#comment-17064750 ] Peter Bacsko commented on YARN-10198: - Due to infra issues, we can't see the comment about the

[jira] [Updated] (YARN-10168) FS-CS Converter: tool doesn't handle min/max resource conversion correctly

2020-03-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10168: Attachment: YARN-10168-005.patch > FS-CS Converter: tool doesn't handle min/max resource

[jira] [Updated] (YARN-10198) [managedParent].%primary_group mapping rule doesn't work after YARN-9868

2020-03-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10198: Attachment: YARN-10198-001.patch > [managedParent].%primary_group mapping rule doesn't work after

[jira] [Commented] (YARN-10257) FS-CS converter: skip increment properties for mem/vcores and fix DRF check

2020-05-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099767#comment-17099767 ] Peter Bacsko commented on YARN-10257: - [~adam.antal] 1. "Do you plan to do something with regards to

[jira] [Commented] (YARN-10254) CapacityScheduler incorrect User Group Mapping after leaf queue change

2020-05-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101749#comment-17101749 ] Peter Bacsko commented on YARN-10254: - Thanks for the fix [~shuzirra]. Some comments: #1 {noformat}

[jira] [Updated] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels are used

2020-05-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10283: Attachment: YARN-10283-POC01.patch > Capacity Scheduler: starvation occurs if a higher priority

[jira] [Commented] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels are used

2020-05-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113054#comment-17113054 ] Peter Bacsko commented on YARN-10283: - Created a POC which _might_ work. I have no idea.

[jira] [Commented] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels are used

2020-05-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113536#comment-17113536 ] Peter Bacsko commented on YARN-10283: - [~tarunparimi] It's very interesting what you're saying. In

[jira] [Commented] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels are used

2020-05-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113294#comment-17113294 ] Peter Bacsko commented on YARN-10283: - Added repro test patch. Took me a solid 5-6 hours to figure

[jira] [Comment Edited] (YARN-10372) Create MappingRule class to represent each CS mapping rule

2020-09-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190126#comment-17190126 ] Peter Bacsko edited comment on YARN-10372 at 9/3/20, 1:08 PM: -- Thanks

[jira] [Updated] (YARN-10413) Change fs2cs to generate mapping rules in the new format

2020-09-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10413: Attachment: YARN-10413-003.patch > Change fs2cs to generate mapping rules in the new format >

[jira] [Commented] (YARN-10376) Create a class that covers the functionality of UserGroupMappingPlacementRule and AppNameMappingPlacementRule using the new mapping rules

2020-09-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17191008#comment-17191008 ] Peter Bacsko commented on YARN-10376: - +1. I've just committed this to trunk! Thanks [~shuzirra] for

[jira] [Commented] (YARN-10375) CS Mapping rule config parser should return MappingRule objects

2020-09-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190299#comment-17190299 ] Peter Bacsko commented on YARN-10375: - Change has been committed to trunk. Thanks [~shuzirra] for the

[jira] [Commented] (YARN-10375) CS Mapping rule config parser should return MappingRule objects

2020-09-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190297#comment-17190297 ] Peter Bacsko commented on YARN-10375: - +1 LGTM. Committing soon. > CS Mapping rule config parser

[jira] [Commented] (YARN-10386) Create new JSON schema for Placement Rules

2020-08-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187504#comment-17187504 ] Peter Bacsko commented on YARN-10386: - [~brahmareddy] I'll upload an addendum patch to solve this. >

[jira] [Commented] (YARN-10372) Create MappingRule class to represent each CS mapping rule

2020-09-01 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188401#comment-17188401 ] Peter Bacsko commented on YARN-10372: - Ok, this latch LGTM, pending on YARN-10374. > Create

[jira] [Commented] (YARN-10374) Create Actions for CS mapping rules

2020-09-01 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188399#comment-17188399 ] Peter Bacsko commented on YARN-10374: - [~shuzirra] thanks for fixing the issues, unfortunately there

[jira] [Reopened] (YARN-10386) Create new JSON schema for Placement Rules

2020-08-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reopened YARN-10386: - > Create new JSON schema for Placement Rules > -- > >

[jira] [Updated] (YARN-10386) Create new JSON schema for Placement Rules

2020-08-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10386: Attachment: YARN-10386-appendum.patch > Create new JSON schema for Placement Rules >

[jira] [Updated] (YARN-10386) Create new JSON schema for Placement Rules

2020-08-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10386: Attachment: YARN-10386-appendum.patch > Create new JSON schema for Placement Rules >

[jira] [Updated] (YARN-10386) Create new JSON schema for Placement Rules

2020-08-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10386: Attachment: (was: YARN-10386-appendum.patch) > Create new JSON schema for Placement Rules >

[jira] [Commented] (YARN-10386) Create new JSON schema for Placement Rules

2020-08-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187674#comment-17187674 ] Peter Bacsko commented on YARN-10386: - The JSON schema now contains the license string. The two

[jira] [Updated] (YARN-10386) Create new JSON schema for Placement Rules

2020-08-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10386: Attachment: YARN-10386-appendum2.patch > Create new JSON schema for Placement Rules >

[jira] [Updated] (YARN-10386) Create new JSON schema for Placement Rules

2020-08-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10386: Attachment: YARN-10386-appendum2.patch > Create new JSON schema for Placement Rules >

[jira] [Updated] (YARN-10386) Create new JSON schema for Placement Rules

2020-08-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10386: Attachment: (was: YARN-10386-appendum2.patch) > Create new JSON schema for Placement Rules >

[jira] [Updated] (YARN-10413) Change fs2cs to generate mapping rules in the new format

2020-09-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10413: Attachment: YARN-10413-002.patch > Change fs2cs to generate mapping rules in the new format >

[jira] [Updated] (YARN-10387) Implement logic which returns MappingRule objects based on mapping rules

2020-09-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10387: Attachment: YARN-10387-005.patch > Implement logic which returns MappingRule objects based on

[jira] [Commented] (YARN-10426) Cleanup CSMappingPlacementRule remaining minor issues

2020-09-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192874#comment-17192874 ] Peter Bacsko commented on YARN-10426: - Small change: TestCSMappingPlacementRule.java: {{import

[jira] [Comment Edited] (YARN-10426) Cleanup CSMappingPlacementRule remaining minor issues

2020-09-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192874#comment-17192874 ] Peter Bacsko edited comment on YARN-10426 at 9/9/20, 1:33 PM: -- Small change:

[jira] [Commented] (YARN-9333) TestFairSchedulerPreemption.testRelaxLocalityPreemptionWithNoLessAMInRemainingNodes fails intermittent

2020-09-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194046#comment-17194046 ] Peter Bacsko commented on YARN-9333: [~adam.antal], [~snemeth], [~prabhujoseph] can we agree that

[jira] [Commented] (YARN-10415) Create a group matcher which checks ALL groups of the user

2020-09-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192053#comment-17192053 ] Peter Bacsko commented on YARN-10415: - +1 LGTM, committing it shortly. > Create a group matcher

[jira] [Commented] (YARN-10415) Create a group matcher which checks ALL groups of the user

2020-09-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192054#comment-17192054 ] Peter Bacsko commented on YARN-10415: - Thanks [~shuzirra] for the patch and [~snemeth], the change

[jira] [Assigned] (YARN-9333) TestFairSchedulerPreemption.testRelaxLocalityPreemptionWithNoLessAMInRemainingNodes fails intermittent

2020-09-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9333: -- Assignee: Peter Bacsko (was: Prabhu Joseph) >

[jira] [Commented] (YARN-9333) TestFairSchedulerPreemption.testRelaxLocalityPreemptionWithNoLessAMInRemainingNodes fails intermittent

2020-09-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192904#comment-17192904 ] Peter Bacsko commented on YARN-9333: Taking this over from [~prabhujoseph], I think I have a solution

[jira] [Commented] (YARN-9333) TestFairSchedulerPreemption.testRelaxLocalityPreemptionWithNoLessAMInRemainingNodes fails intermittent

2020-09-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192914#comment-17192914 ] Peter Bacsko commented on YARN-9333: Quick explanation: if the testcase is executing slowly, then

[jira] [Updated] (YARN-9333) TestFairSchedulerPreemption.testRelaxLocalityPreemptionWithNoLessAMInRemainingNodes fails intermittent

2020-09-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9333: --- Attachment: YARN-9333-001.patch >

[jira] [Updated] (YARN-9333) TestFairSchedulerPreemption.testRelaxLocalityPreemptionWithNoLessAMInRemainingNodes fails intermittent

2020-09-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9333: --- Attachment: YARN-9333-002.patch >

[jira] [Updated] (YARN-10387) Implement logic which returns MappingRule objects based on mapping rules

2020-09-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10387: Attachment: YARN-10387-003.patch > Implement logic which returns MappingRule objects based on

<    5   6   7   8   9   10   11   12   13   14   >