[jira] [Commented] (YARN-9865) Capacity scheduler: add support for combined %user + %secondary_group mapping

2019-10-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953944#comment-16953944 ] Peter Bacsko commented on YARN-9865: [~maniraj...@gmail.com] I'll ask [~snemeth] to review YARN-9841

[jira] [Updated] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9899: --- Attachment: YARN-9899-002.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952833#comment-16952833 ] Peter Bacsko commented on YARN-9899: Uploaded a preliminary patch v1 to see what build result it

[jira] [Updated] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9899: --- Attachment: YARN-9899-001.patch > Migration tool that help to generate CS config based on FS config

[jira] [Updated] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-10-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9841: --- Attachment: YARN-9899-001.patch > Capacity scheduler: add support for combined %user + %primary_group

[jira] [Updated] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-10-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9841: --- Attachment: (was: YARN-9899-001.patch) > Capacity scheduler: add support for combined %user +

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-10-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952024#comment-16952024 ] Peter Bacsko commented on YARN-9841: It still applies cleanly - [~snemeth] could you review & commit

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-10-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952017#comment-16952017 ] Peter Bacsko commented on YARN-9840: Test failure seems unrelated. > Capacity scheduler: add support

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-10-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951883#comment-16951883 ] Peter Bacsko commented on YARN-9840: I've taken the liberty of updating patch v3 with some docs

[jira] [Updated] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-10-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9840: --- Attachment: YARN-9840-004.patch > Capacity scheduler: add support for Secondary Group rule mapping >

[jira] [Updated] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9899: --- Description: YARN-9699 laid down the groundworks of a converter from FS to CS config. During the

[jira] [Commented] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951841#comment-16951841 ] Peter Bacsko commented on YARN-9899: # Framework uploader has been built into the {{mapred}} command.

[jira] [Comment Edited] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951013#comment-16951013 ] Peter Bacsko edited comment on YARN-9899 at 10/14/19 8:29 PM: -- [~snemeth] my

[jira] [Comment Edited] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951013#comment-16951013 ] Peter Bacsko edited comment on YARN-9899 at 10/14/19 8:28 PM: -- [~snemeth] my

[jira] [Comment Edited] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951013#comment-16951013 ] Peter Bacsko edited comment on YARN-9899 at 10/14/19 2:40 PM: -- [~snemeth] my

[jira] [Commented] (YARN-9290) Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951018#comment-16951018 ] Peter Bacsko commented on YARN-9290: Thanks [~Prabhu Joseph], last patch LGTM. So +1 (non-binding)

[jira] [Commented] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951013#comment-16951013 ] Peter Bacsko commented on YARN-9899: [~snemeth] my proposal is: # Modify

[jira] [Assigned] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9899: -- Assignee: Peter Bacsko (was: Szilard Nemeth) > Migration tool that help to generate CS config

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950863#comment-16950863 ] Peter Bacsko commented on YARN-9840: [~snemeth]: I think so - this is an enhancement. A couple of

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-10-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949450#comment-16949450 ] Peter Bacsko commented on YARN-9840: [~snemeth] although you didn't ask me, I examined the group

[jira] [Created] (YARN-9893) Capacity scheduler: enhance leaf-queue-template capacity / maximum-capacity setting

2019-10-11 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-9893: -- Summary: Capacity scheduler: enhance leaf-queue-template capacity / maximum-capacity setting Key: YARN-9893 URL: https://issues.apache.org/jira/browse/YARN-9893 Project:

[jira] [Created] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2019-10-11 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-9892: -- Summary: Capacity scheduler: support DRF ordering policy on queue level Key: YARN-9892 URL: https://issues.apache.org/jira/browse/YARN-9892 Project: Hadoop YARN

[jira] [Updated] (YARN-9888) Capacity scheduler: add support for default maxRunningApps limit per user

2019-10-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9888: --- Component/s: capacity scheduler > Capacity scheduler: add support for default maxRunningApps limit

[jira] [Updated] (YARN-9887) Capacity scheduler: add support for limiting maxRunningApps per user

2019-10-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9887: --- Component/s: capacity scheduler > Capacity scheduler: add support for limiting maxRunningApps per

[jira] [Updated] (YARN-9891) Capacity scheduler: enhance capacity / maximum-capacity setting

2019-10-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9891: --- Component/s: capacity scheduler > Capacity scheduler: enhance capacity / maximum-capacity setting >

[jira] [Created] (YARN-9891) Capacity scheduler: enhance capacity / maximum-capacity setting

2019-10-11 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-9891: -- Summary: Capacity scheduler: enhance capacity / maximum-capacity setting Key: YARN-9891 URL: https://issues.apache.org/jira/browse/YARN-9891 Project: Hadoop YARN

[jira] [Created] (YARN-9888) Capacity scheduler: add support for default maxRunningApps limit per user

2019-10-11 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-9888: -- Summary: Capacity scheduler: add support for default maxRunningApps limit per user Key: YARN-9888 URL: https://issues.apache.org/jira/browse/YARN-9888 Project: Hadoop

[jira] [Created] (YARN-9887) Capacity scheduler: add support for limiting maxRunningApps per user

2019-10-11 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-9887: -- Summary: Capacity scheduler: add support for limiting maxRunningApps per user Key: YARN-9887 URL: https://issues.apache.org/jira/browse/YARN-9887 Project: Hadoop YARN

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-10-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949358#comment-16949358 ] Peter Bacsko commented on YARN-9841: +1 (non-binding) from me.  Let's wait for YARN-9840 and then try

[jira] [Updated] (YARN-9699) [Phase 1] Migration tool that help to generate CS config based on FS config

2019-10-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9699: --- Attachment: YARN-9699-015.patch > [Phase 1] Migration tool that help to generate CS config based on

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948476#comment-16948476 ] Peter Bacsko commented on YARN-9699: Ok, now the patch is in a very good condition I believe. * XML

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948314#comment-16948314 ] Peter Bacsko commented on YARN-9699: Attached patch v14 to address the unit test failure, relevant

[jira] [Updated] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9699: --- Attachment: YARN-9699-014.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16948285#comment-16948285 ] Peter Bacsko commented on YARN-9699: This is the problematic part: {noformat} public void setUp() {

[jira] [Commented] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-10-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947862#comment-16947862 ] Peter Bacsko commented on YARN-9552: It's been on trunk since May, so it should be okay there. >

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-10-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947654#comment-16947654 ] Peter Bacsko commented on YARN-9841: Thanks for the patch [~maniraj...@gmail.com]. I'm not sure

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-10-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947650#comment-16947650 ] Peter Bacsko commented on YARN-9840: +1 (non-binding). [~snemeth] please review & commit patch v3 if

[jira] [Updated] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9699: --- Attachment: YARN-9699-011.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947461#comment-16947461 ] Peter Bacsko commented on YARN-9699: Ok, here are my comments - I collected these when patch v2 was

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946987#comment-16946987 ] Peter Bacsko commented on YARN-9699: _"Fixed this, added the printing of the output files to an

[jira] [Updated] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9699: --- Attachment: YARN-9699-005.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946536#comment-16946536 ] Peter Bacsko commented on YARN-9699: Patch v4: unit tests failure are now hopefully resolved + fixed

[jira] [Updated] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9699: --- Attachment: YARN-9699-004.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946495#comment-16946495 ] Peter Bacsko commented on YARN-9699: Unit test failures are related. I'm fixing those. > Migration

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16945906#comment-16945906 ] Peter Bacsko commented on YARN-9699: Thanks [~snemeth], [~shuzirra] for the comments. I addressed

[jira] [Updated] (YARN-9699) Migration tool that help to generate CS config based on FS config (Phase 1)

2019-10-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9699: --- Attachment: YARN-9699-003.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config

2019-10-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944423#comment-16944423 ] Peter Bacsko commented on YARN-9699: Patch version 1 is almost ready, [~snemeth] is doing some

[jira] [Assigned] (YARN-9699) Migration tool that help to generate CS config based on FS config

2019-10-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9699: -- Assignee: Peter Bacsko (was: Gergely Pollak) > Migration tool that help to generate CS config

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-10-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944419#comment-16944419 ] Peter Bacsko commented on YARN-9840: [~maniraj...@gmail.com] as Prabhu asked above, pls check and fix

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-10-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944418#comment-16944418 ] Peter Bacsko commented on YARN-9841: [~maniraj...@gmail.com] could you please fix the checkstyle

[jira] [Comment Edited] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940924#comment-16940924 ] Peter Bacsko edited comment on YARN-9841 at 9/30/19 12:28 PM: -- I checked the

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940924#comment-16940924 ] Peter Bacsko commented on YARN-9841: I checked the first rule mapping: {{"u:user2:%primary_group"}} -

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config

2019-09-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939325#comment-16939325 ] Peter Bacsko commented on YARN-9699: +1 for standalone tool. Having to have a running RM instance is a

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938988#comment-16938988 ] Peter Bacsko commented on YARN-9841: [~maniraj...@gmail.com] no problem, I'm fine with a separate

[jira] [Comment Edited] (YARN-9699) Migration tool that help to generate CS configs based on FS

2019-09-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938306#comment-16938306 ] Peter Bacsko edited comment on YARN-9699 at 9/26/19 6:25 AM: - Had a discussion

[jira] [Comment Edited] (YARN-9699) Migration tool that help to generate CS configs based on FS

2019-09-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938306#comment-16938306 ] Peter Bacsko edited comment on YARN-9699 at 9/26/19 6:24 AM: - Had a discussion

[jira] [Comment Edited] (YARN-9699) Migration tool that help to generate CS configs based on FS

2019-09-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938306#comment-16938306 ] Peter Bacsko edited comment on YARN-9699 at 9/26/19 6:14 AM: - Had a discussion

[jira] [Comment Edited] (YARN-9699) Migration tool that help to generate CS configs based on FS

2019-09-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938306#comment-16938306 ] Peter Bacsko edited comment on YARN-9699 at 9/26/19 6:08 AM: - Had a discussion

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS configs based on FS

2019-09-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938306#comment-16938306 ] Peter Bacsko commented on YARN-9699: Had a discussion with [~sunilg], [~Prabhu Joseph], [~snemeth]. A

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938291#comment-16938291 ] Peter Bacsko commented on YARN-9841: Just some really minor comments: {noformat} 70 if

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938281#comment-16938281 ] Peter Bacsko commented on YARN-9841: [~maniraj...@gmail.com] just a thought. If we have this for

[jira] [Commented] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938280#comment-16938280 ] Peter Bacsko commented on YARN-6715: [~snemeth] patches are ready to be committed to branch-3.1 and

[jira] [Commented] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938279#comment-16938279 ] Peter Bacsko commented on YARN-9552: [~snemeth] you can now backport this patch to branch-3.1 and

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16938277#comment-16938277 ] Peter Bacsko commented on YARN-9841: Jenkins picked up the junit patch, re-uploading patch 001 again.

[jira] [Updated] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9841: --- Attachment: YARN-9841.001.patch > Capacity scheduler: add support for combined %user + %primary_group

[jira] [Updated] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Attachment: YARN-6715-branch-3.1.001.patch > Fix documentation about NodeHealthScriptRunner >

[jira] [Updated] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Attachment: YARN-6715-branch-3.2.001.patch > Fix documentation about NodeHealthScriptRunner >

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937707#comment-16937707 ] Peter Bacsko commented on YARN-9011: ping [~bibinchundatt], [~adam.antal], [~tangzhankun] > Race

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937696#comment-16937696 ] Peter Bacsko commented on YARN-9011: So I uploaded patch v6 which is contains a completely new

[jira] [Updated] (YARN-9011) Race condition during decommissioning

2019-09-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9011: --- Attachment: YARN-9011-006.patch > Race condition during decommissioning >

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16937163#comment-16937163 ] Peter Bacsko commented on YARN-9841: Thanks [~maniraj...@gmail.com], looks very interesting. I'll

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-09-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936867#comment-16936867 ] Peter Bacsko commented on YARN-9011: " In large clusters we cant expect that to be mills." - if that's

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-09-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936729#comment-16936729 ] Peter Bacsko commented on YARN-9011: [~bibinchundatt] thanks for the insights. There's no impact on

[jira] [Updated] (YARN-9011) Race condition during decommissioning

2019-09-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9011: --- Attachment: YARN-9011-005.patch > Race condition during decommissioning >

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS configs based on FS

2019-09-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936691#comment-16936691 ] Peter Bacsko commented on YARN-9699: Thanks [~Prabhu Joseph] for the comments. 1. This is completely

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-09-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936651#comment-16936651 ] Peter Bacsko commented on YARN-9011: Thanks for the comments [~adam.antal] Regarding the property,

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-09-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936576#comment-16936576 ] Peter Bacsko commented on YARN-9011: [~tangzhankun] yes, that's correct. The problem is that

[jira] [Comment Edited] (YARN-9011) Race condition during decommissioning

2019-09-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936576#comment-16936576 ] Peter Bacsko edited comment on YARN-9011 at 9/24/19 9:06 AM: - [~tangzhankun]

[jira] [Commented] (YARN-9717) Add more logging to container-executor about issues with directory creation or permissions

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935885#comment-16935885 ] Peter Bacsko commented on YARN-9717: As discussed with [~snemeth], the problem that we faced had

[jira] [Resolved] (YARN-9717) Add more logging to container-executor about issues with directory creation or permissions

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko resolved YARN-9717. Resolution: Won't Fix > Add more logging to container-executor about issues with directory creation

[jira] [Commented] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935862#comment-16935862 ] Peter Bacsko commented on YARN-9552: [~giovanni.fumarola] [~sunilg] could you guys review & commit the

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935844#comment-16935844 ] Peter Bacsko commented on YARN-9840: One more thing - this enhancement should be documented. Please

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935757#comment-16935757 ] Peter Bacsko commented on YARN-9840: Thanks for the patch [~maniraj...@gmail.com]. I triggered a

[jira] [Comment Edited] (YARN-9011) Race condition during decommissioning

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935731#comment-16935731 ] Peter Bacsko edited comment on YARN-9011 at 9/23/19 10:38 AM: -- [~adam.antal]

[jira] [Comment Edited] (YARN-9011) Race condition during decommissioning

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935731#comment-16935731 ] Peter Bacsko edited comment on YARN-9011 at 9/23/19 10:38 AM: -- [~adam.antal]

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935731#comment-16935731 ] Peter Bacsko commented on YARN-9011: [~adam.antal] so the problem is that {{ResourceTrackerService}}

[jira] [Assigned] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9841: -- Assignee: Manikandan R (was: Peter Bacsko) > Capacity scheduler: add support for combined

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935372#comment-16935372 ] Peter Bacsko commented on YARN-9841: [~maniraj...@gmail.com] sure, no problem. > Capacity scheduler:

[jira] [Assigned] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-09-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9840: -- Assignee: Manikandan R (was: Peter Bacsko) > Capacity scheduler: add support for Secondary

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS configs based on FS

2019-09-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934948#comment-16934948 ] Peter Bacsko commented on YARN-9699: [~jiwq] [~Prabhu Joseph] [~shuzirra] [~sunilg] I uploaded a POC

[jira] [Updated] (YARN-9699) Migration tool that help to generate CS configs based on FS

2019-09-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9699: --- Attachment: FS_to_CS_migration_POC.patch > Migration tool that help to generate CS configs based on

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-branch-3.2.003.patch > FairScheduler: NODE_UPDATE can cause

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-09-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934601#comment-16934601 ] Peter Bacsko commented on YARN-9840: [~maniraj...@gmail.com] if you already have a patch, feel free to

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-branch-3.1.002.patch > FairScheduler: NODE_UPDATE can cause

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-branch-3.2.002.patch > FairScheduler: NODE_UPDATE can cause

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: (was: YARN-9552-branch-3.2.002.patch) > FairScheduler: NODE_UPDATE can cause

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-branch-3.2.002.patch > FairScheduler: NODE_UPDATE can cause

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-branch-3.1.001.patch > FairScheduler: NODE_UPDATE can cause

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-branch-3.2.001.patch > FairScheduler: NODE_UPDATE can cause

[jira] [Reopened] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reopened YARN-9552: > FairScheduler: NODE_UPDATE can cause NoSuchElementException >

  1   2   3   4   5   6   >