[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-10-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952024#comment-16952024 ] Peter Bacsko commented on YARN-9841: It still applies cleanly - [~snemeth] could you review & commit

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-10-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952017#comment-16952017 ] Peter Bacsko commented on YARN-9840: Test failure seems unrelated. > Capacity scheduler: add support

[jira] [Comment Edited] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951013#comment-16951013 ] Peter Bacsko edited comment on YARN-9899 at 10/14/19 8:28 PM: -- [~snemeth] my

[jira] [Comment Edited] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951013#comment-16951013 ] Peter Bacsko edited comment on YARN-9899 at 10/14/19 8:29 PM: -- [~snemeth] my

[jira] [Updated] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-10-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9841: --- Attachment: YARN-9899-001.patch > Capacity scheduler: add support for combined %user + %primary_group

[jira] [Updated] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-10-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9841: --- Attachment: (was: YARN-9899-001.patch) > Capacity scheduler: add support for combined %user +

[jira] [Commented] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952833#comment-16952833 ] Peter Bacsko commented on YARN-9899: Uploaded a preliminary patch v1 to see what build result it

[jira] [Updated] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9899: --- Attachment: YARN-9899-001.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951841#comment-16951841 ] Peter Bacsko commented on YARN-9899: # Framework uploader has been built into the {{mapred}} command.

[jira] [Commented] (YARN-9887) Capacity scheduler: add support for limiting maxRunningApps per user

2019-10-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956688#comment-16956688 ] Peter Bacsko commented on YARN-9887: [~wangda] that's correct, but are you saying that we should not

[jira] [Commented] (YARN-9781) SchedConfCli to get current stored scheduler configuration

2019-10-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956934#comment-16956934 ] Peter Bacsko commented on YARN-9781: LGTM +1 (non-binding) > SchedConfCli to get current stored

[jira] [Commented] (YARN-9780) SchedulerConf Mutation Api does not Allow Stop and Remove Queue in a single call

2019-10-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956941#comment-16956941 ] Peter Bacsko commented on YARN-9780: [~Prabhu Joseph] I have some minor comments: #1 Nit: pay

[jira] [Comment Edited] (YARN-9887) Capacity scheduler: add support for limiting maxRunningApps per user

2019-10-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956688#comment-16956688 ] Peter Bacsko edited comment on YARN-9887 at 10/22/19 5:21 AM: -- [~wangda] 

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-10-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961879#comment-16961879 ] Peter Bacsko commented on YARN-9011: _"1. Why do we need a lazy update?"_ Please see details in my

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-10-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961897#comment-16961897 ] Peter Bacsko commented on YARN-9011: Ok, actually we always call the

[jira] [Comment Edited] (YARN-9011) Race condition during decommissioning

2019-10-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961897#comment-16961897 ] Peter Bacsko edited comment on YARN-9011 at 10/29/19 11:03 AM: --- Ok, actually

[jira] [Comment Edited] (YARN-9011) Race condition during decommissioning

2019-10-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961879#comment-16961879 ] Peter Bacsko edited comment on YARN-9011 at 10/29/19 10:48 AM: --- _"1. Why do

[jira] [Comment Edited] (YARN-9011) Race condition during decommissioning

2019-10-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961879#comment-16961879 ] Peter Bacsko edited comment on YARN-9011 at 10/29/19 10:48 AM: --- _"1. Why do

[jira] [Comment Edited] (YARN-9011) Race condition during decommissioning

2019-10-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961879#comment-16961879 ] Peter Bacsko edited comment on YARN-9011 at 10/29/19 11:10 AM: --- _"1. Why do

[jira] [Updated] (YARN-9011) Race condition during decommissioning

2019-10-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9011: --- Attachment: YARN-9011-008.patch > Race condition during decommissioning >

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-10-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961988#comment-16961988 ] Peter Bacsko commented on YARN-9011: Thanks [~tangzhankun] for the comments - glad we're on the same

[jira] [Commented] (YARN-9865) Capacity scheduler: add support for combined %user + %secondary_group mapping

2019-10-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962111#comment-16962111 ] Peter Bacsko commented on YARN-9865: Thanks for the update. I just realized two things: 1) The two

[jira] [Commented] (YARN-9789) Disable Option for Write Ahead Logs of LogMutation

2019-10-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957015#comment-16957015 ] Peter Bacsko commented on YARN-9789: Patch looks straightforward, +1 non-binding. > Disable Option

[jira] [Commented] (YARN-9788) Queue Management API - does not support parallel updates

2019-10-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956957#comment-16956957 ] Peter Bacsko commented on YARN-9788: Thanks for the patch [~Prabhu Joseph]. I think the patch looks

[jira] [Commented] (YARN-9923) Detect missing Docker binary or not running Docker daemon

2019-10-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956995#comment-16956995 ] Peter Bacsko commented on YARN-9923: _"NONE (default): preserving the current behaviour [...]"_ Even

[jira] [Comment Edited] (YARN-9923) Detect missing Docker binary or not running Docker daemon

2019-10-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956995#comment-16956995 ] Peter Bacsko edited comment on YARN-9923 at 10/22/19 12:16 PM: --- _"NONE

[jira] [Updated] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9899: --- Attachment: YARN-9899-002.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-9865) Capacity scheduler: add support for combined %user + %secondary_group mapping

2019-10-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953944#comment-16953944 ] Peter Bacsko commented on YARN-9865: [~maniraj...@gmail.com] I'll ask [~snemeth] to review YARN-9841

[jira] [Updated] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9899: --- Description: YARN-9699 laid down the groundworks of a converter from FS to CS config. During the

[jira] [Updated] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-10-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9840: --- Attachment: YARN-9840-004.patch > Capacity scheduler: add support for Secondary Group rule mapping >

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-10-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951883#comment-16951883 ] Peter Bacsko commented on YARN-9840: I've taken the liberty of updating patch v3 with some docs

[jira] [Updated] (YARN-9011) Race condition during decommissioning

2019-11-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9011: --- Attachment: YARN-9011-branch-3.1.001.patch > Race condition during decommissioning >

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-11-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977527#comment-16977527 ] Peter Bacsko commented on YARN-9011: [~snemeth] I think we're good to go with branch-3.2 and

[jira] [Updated] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-11-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9899: --- Attachment: YARN-9899-007.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-9938) Validate Parent Queue for QueueMapping contains dynamic group as parent queue

2019-11-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983493#comment-16983493 ] Peter Bacsko commented on YARN-9938: [~maniraj...@gmail.com] looks good at first sight. Two comments:

[jira] [Commented] (YARN-9925) CapacitySchedulerQueueManager allows unsupported Queue hierarchy

2019-11-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983530#comment-16983530 ] Peter Bacsko commented on YARN-9925: I just have a question. I can see what we currently throw

[jira] [Comment Edited] (YARN-9938) Validate Parent Queue for QueueMapping contains dynamic group as parent queue

2019-11-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983493#comment-16983493 ] Peter Bacsko edited comment on YARN-9938 at 11/27/19 1:10 PM: --

[jira] [Commented] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2019-11-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984262#comment-16984262 ] Peter Bacsko commented on YARN-9892: [~maniraj...@gmail.com] yes, feel free to assign this to

[jira] [Comment Edited] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2019-11-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985033#comment-16985033 ] Peter Bacsko edited comment on YARN-5106 at 11/29/19 1:50 PM: -- Thanks for

[jira] [Comment Edited] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2019-11-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985033#comment-16985033 ] Peter Bacsko edited comment on YARN-5106 at 11/29/19 1:50 PM: -- Thanks for

[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2019-11-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985033#comment-16985033 ] Peter Bacsko commented on YARN-5106: Thanks for picking up the patch [~adam.antal]. Just minor a

[jira] [Comment Edited] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2019-11-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985033#comment-16985033 ] Peter Bacsko edited comment on YARN-5106 at 11/29/19 1:51 PM: -- Thanks for

[jira] [Commented] (YARN-9925) CapacitySchedulerQueueManager allows unsupported Queue hierarchy

2019-11-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984890#comment-16984890 ] Peter Bacsko commented on YARN-9925: [~prabhujoseph] could you create a follow-up Jira about changing

[jira] [Commented] (YARN-9938) Validate Parent Queue for QueueMapping contains dynamic group as parent queue

2019-11-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984888#comment-16984888 ] Peter Bacsko commented on YARN-9938: +1 (non-binding) [~snemeth] please review > Validate Parent

[jira] [Commented] (YARN-9877) Intermittent TIME_OUT of LogAggregationReport

2019-11-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985055#comment-16985055 ] Peter Bacsko commented on YARN-9877: [~adam.antal] is there are way to test this?

[jira] [Comment Edited] (YARN-9920) YarnAuthorizationProvider AccessRequest gets Null RemoteAddress from FairScheduler

2019-10-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963715#comment-16963715 ] Peter Bacsko edited comment on YARN-9920 at 10/31/19 7:08 AM: -- Thanks for

[jira] [Updated] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9899: --- Attachment: YARN-9899-003.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-9920) YarnAuthorizationProvider AccessRequest gets Null RemoteAddress from FairScheduler

2019-10-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963715#comment-16963715 ] Peter Bacsko commented on YARN-9920: Thanks for patch [~prabhujoseph], looks pretty good. I have only

[jira] [Comment Edited] (YARN-9866) u:user2:%primary_group is not working as expected

2019-11-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984494#comment-16984494 ] Peter Bacsko edited comment on YARN-9866 at 11/28/19 3:29 PM: -- +1

[jira] [Commented] (YARN-9866) u:user2:%primary_group is not working as expected

2019-11-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984494#comment-16984494 ] Peter Bacsko commented on YARN-9866: +1 (non-binding) > u:user2:%primary_group is not working as

[jira] [Commented] (YARN-9938) Validate Parent Queue for QueueMapping contains dynamic group as parent queue

2019-11-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984500#comment-16984500 ] Peter Bacsko commented on YARN-9938: # Please address checkstyle issues (if they're addressabble, not

[jira] [Commented] (YARN-9969) Improve yarn.scheduler.capacity.queue-mappings documentation

2019-11-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984493#comment-16984493 ] Peter Bacsko commented on YARN-9969: [~snemeth] please check if this is good for commit. +1

[jira] [Commented] (YARN-9970) Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping

2019-11-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984508#comment-16984508 ] Peter Bacsko commented on YARN-9970: Wow, checkstyle is complaining like crazy. Well, what can we do?

[jira] [Commented] (YARN-9969) Improve yarn.scheduler.capacity.queue-mappings documentation

2019-11-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983380#comment-16983380 ] Peter Bacsko commented on YARN-9969: Thanks [~maniraj...@gmail.com]. Just one final request: I would

[jira] [Commented] (YARN-9970) Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping

2019-11-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983450#comment-16983450 ] Peter Bacsko commented on YARN-9970: 1. Please write or generate a proper {{hashCode()}} method for

[jira] [Commented] (YARN-9866) u:user2:%primary_group is not working as expected

2019-11-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983483#comment-16983483 ] Peter Bacsko commented on YARN-9866: [~maniraj...@gmail.com] just one thing: in the testcase, you

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-branch-3.2.002.patch > FairScheduler: NODE_UPDATE can cause

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: (was: YARN-9552-branch-3.2.002.patch) > FairScheduler: NODE_UPDATE can cause

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-branch-3.2.002.patch > FairScheduler: NODE_UPDATE can cause

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-branch-3.1.002.patch > FairScheduler: NODE_UPDATE can cause

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937163#comment-16937163 ] Peter Bacsko commented on YARN-9841: Thanks [~maniraj...@gmail.com], looks very interesting. I'll

[jira] [Commented] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935862#comment-16935862 ] Peter Bacsko commented on YARN-9552: [~giovanni.fumarola] [~sunilg] could you guys review & commit the

[jira] [Commented] (YARN-9717) Add more logging to container-executor about issues with directory creation or permissions

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935885#comment-16935885 ] Peter Bacsko commented on YARN-9717: As discussed with [~snemeth], the problem that we faced had

[jira] [Resolved] (YARN-9717) Add more logging to container-executor about issues with directory creation or permissions

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko resolved YARN-9717. Resolution: Won't Fix > Add more logging to container-executor about issues with directory creation

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935844#comment-16935844 ] Peter Bacsko commented on YARN-9840: One more thing - this enhancement should be documented. Please

[jira] [Updated] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Attachment: YARN-6715-branch-3.1.001.patch > Fix documentation about NodeHealthScriptRunner >

[jira] [Updated] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Attachment: YARN-6715-branch-3.2.001.patch > Fix documentation about NodeHealthScriptRunner >

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937696#comment-16937696 ] Peter Bacsko commented on YARN-9011: So I uploaded patch v6 which is contains a completely new

[jira] [Updated] (YARN-9011) Race condition during decommissioning

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9011: --- Attachment: YARN-9011-006.patch > Race condition during decommissioning >

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937707#comment-16937707 ] Peter Bacsko commented on YARN-9011: ping [~bibinchundatt], [~adam.antal], [~tangzhankun] > Race

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16945906#comment-16945906 ] Peter Bacsko commented on YARN-9699: Thanks [~snemeth], [~shuzirra] for the comments. I addressed

[jira] [Updated] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9699: --- Attachment: YARN-9699-003.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946536#comment-16946536 ] Peter Bacsko commented on YARN-9699: Patch v4: unit tests failure are now hopefully resolved + fixed

[jira] [Updated] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9699: --- Attachment: YARN-9699-004.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946495#comment-16946495 ] Peter Bacsko commented on YARN-9699: Unit test failures are related. I'm fixing those. > Migration

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948314#comment-16948314 ] Peter Bacsko commented on YARN-9699: Attached patch v14 to address the unit test failure, relevant

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948285#comment-16948285 ] Peter Bacsko commented on YARN-9699: This is the problematic part: {noformat} public void setUp() {

[jira] [Updated] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9699: --- Attachment: YARN-9699-014.patch > Migration tool that help to generate CS config based on FS config

[jira] [Updated] (YARN-9699) [Phase 1] Migration tool that help to generate CS config based on FS config

2019-10-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9699: --- Attachment: YARN-9699-015.patch > [Phase 1] Migration tool that help to generate CS config based on

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948476#comment-16948476 ] Peter Bacsko commented on YARN-9699: Ok, now the patch is in a very good condition I believe. * XML

[jira] [Updated] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9699: --- Attachment: YARN-9699-005.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946987#comment-16946987 ] Peter Bacsko commented on YARN-9699: _"Fixed this, added the printing of the output files to an

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947461#comment-16947461 ] Peter Bacsko commented on YARN-9699: Ok, here are my comments - I collected these when patch v2 was

[jira] [Updated] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9699: --- Attachment: YARN-9699-011.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-10-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947654#comment-16947654 ] Peter Bacsko commented on YARN-9841: Thanks for the patch [~maniraj...@gmail.com]. I'm not sure

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-10-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947650#comment-16947650 ] Peter Bacsko commented on YARN-9840: +1 (non-binding). [~snemeth] please review & commit patch v3 if

[jira] [Commented] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-10-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947862#comment-16947862 ] Peter Bacsko commented on YARN-9552: It's been on trunk since May, so it should be okay there. >

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-10-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944419#comment-16944419 ] Peter Bacsko commented on YARN-9840: [~maniraj...@gmail.com] as Prabhu asked above, pls check and fix

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-10-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944418#comment-16944418 ] Peter Bacsko commented on YARN-9841: [~maniraj...@gmail.com] could you please fix the checkstyle

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config

2019-10-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944423#comment-16944423 ] Peter Bacsko commented on YARN-9699: Patch version 1 is almost ready, [~snemeth] is doing some

[jira] [Assigned] (YARN-9699) Migration tool that help to generate CS config based on FS config

2019-10-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9699: -- Assignee: Peter Bacsko (was: Gergely Pollak) > Migration tool that help to generate CS config

[jira] [Assigned] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9899: -- Assignee: Peter Bacsko (was: Szilard Nemeth) > Migration tool that help to generate CS config

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950863#comment-16950863 ] Peter Bacsko commented on YARN-9840: [~snemeth]: I think so - this is an enhancement. A couple of

[jira] [Commented] (YARN-9290) Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951018#comment-16951018 ] Peter Bacsko commented on YARN-9290: Thanks [~Prabhu Joseph], last patch LGTM. So +1 (non-binding)

[jira] [Comment Edited] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951013#comment-16951013 ] Peter Bacsko edited comment on YARN-9899 at 10/14/19 2:40 PM: -- [~snemeth] my

[jira] [Commented] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951013#comment-16951013 ] Peter Bacsko commented on YARN-9899: [~snemeth] my proposal is: # Modify

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-10-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949358#comment-16949358 ] Peter Bacsko commented on YARN-9841: +1 (non-binding) from me.  Let's wait for YARN-9840 and then try

[jira] [Created] (YARN-9891) Capacity scheduler: enhance capacity / maximum-capacity setting

2019-10-11 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-9891: -- Summary: Capacity scheduler: enhance capacity / maximum-capacity setting Key: YARN-9891 URL: https://issues.apache.org/jira/browse/YARN-9891 Project: Hadoop YARN

[jira] [Created] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2019-10-11 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-9892: -- Summary: Capacity scheduler: support DRF ordering policy on queue level Key: YARN-9892 URL: https://issues.apache.org/jira/browse/YARN-9892 Project: Hadoop YARN

[jira] [Updated] (YARN-9888) Capacity scheduler: add support for default maxRunningApps limit per user

2019-10-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9888: --- Component/s: capacity scheduler > Capacity scheduler: add support for default maxRunningApps limit

<    2   3   4   5   6   7   8   9   10   11   >