[jira] [Created] (YARN-10104) FS-CS converter: dryRun requires either -p or -o

2020-01-24 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10104: --- Summary: FS-CS converter: dryRun requires either -p or -o Key: YARN-10104 URL: https://issues.apache.org/jira/browse/YARN-10104 Project: Hadoop YARN Issue

[jira] [Comment Edited] (YARN-9879) Allow multiple leaf queues with the same name in CS

2020-01-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022718#comment-17022718 ] Peter Bacsko edited comment on YARN-9879 at 1/24/20 12:42 PM: -- Hey folks, I

[jira] [Comment Edited] (YARN-9879) Allow multiple leaf queues with the same name in CS

2020-01-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022718#comment-17022718 ] Peter Bacsko edited comment on YARN-9879 at 1/24/20 6:33 AM: - Hey folks, I can

[jira] [Comment Edited] (YARN-9879) Allow multiple leaf queues with the same name in CS

2020-01-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022718#comment-17022718 ] Peter Bacsko edited comment on YARN-9879 at 1/24/20 6:32 AM: - Hey folks, I can

[jira] [Comment Edited] (YARN-9879) Allow multiple leaf queues with the same name in CS

2020-01-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022718#comment-17022718 ] Peter Bacsko edited comment on YARN-9879 at 1/24/20 6:22 AM: - Hey folks, I can

[jira] [Commented] (YARN-9879) Allow multiple leaf queues with the same name in CS

2020-01-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022718#comment-17022718 ] Peter Bacsko commented on YARN-9879: Hey folks, I can see that a lengthy conversation is already going

[jira] [Updated] (YARN-10099) FS-CS converter: handle allow-undeclared-pools and user-as-default queue properly

2020-01-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10099: Attachment: YARN-10099-002.patch > FS-CS converter: handle allow-undeclared-pools and

[jira] [Updated] (YARN-10103) Capacity scheduler: add support for create=true/false per mapping rule

2020-01-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10103: Description: You can't ask Capacity Scheduler for a mapping to create a queue if it doesn't

[jira] [Commented] (YARN-10102) Capacity scheduler: add support for %specified mapping

2020-01-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022336#comment-17022336 ] Peter Bacsko commented on YARN-10102: - [~maniraj...@gmail.com] haven't you worked on something

[jira] [Created] (YARN-10103) Capacity scheduler: add support for create=true/false per mapping rule

2020-01-23 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10103: --- Summary: Capacity scheduler: add support for create=true/false per mapping rule Key: YARN-10103 URL: https://issues.apache.org/jira/browse/YARN-10103 Project: Hadoop

[jira] [Created] (YARN-10102) Capacity scheduler: add support for combined %specified mapping

2020-01-23 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10102: --- Summary: Capacity scheduler: add support for combined %specified mapping Key: YARN-10102 URL: https://issues.apache.org/jira/browse/YARN-10102 Project: Hadoop YARN

[jira] [Updated] (YARN-10102) Capacity scheduler: add support for %specified mapping

2020-01-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10102: Summary: Capacity scheduler: add support for %specified mapping (was: Capacity scheduler: add

[jira] [Updated] (YARN-10099) FS-CS converter: handle allow-undeclared-pools and user-as-default queue properly

2020-01-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10099: Attachment: YARN-10099-001.patch > FS-CS converter: handle allow-undeclared-pools and

[jira] [Updated] (YARN-10099) FS-CS converter: handle allow-undeclared-pools and user-as-default queue properly

2020-01-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10099: Description: Based on the latest documentation, there are two important properties that are

[jira] [Created] (YARN-10099) FS-CS converter: handle allow-undeclared-pools and user-as-default queue properly

2020-01-22 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10099: --- Summary: FS-CS converter: handle allow-undeclared-pools and user-as-default queue properly Key: YARN-10099 URL: https://issues.apache.org/jira/browse/YARN-10099

[jira] [Commented] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020965#comment-17020965 ] Peter Bacsko commented on YARN-10085: - Fixed checkstyle in patch v5. > FS-CS converter: remove mixed

[jira] [Updated] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10085: Attachment: YARN-10085-005.patch > FS-CS converter: remove mixed ordering policy check >

[jira] [Updated] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10085: Attachment: YARN-10085-004.patch > FS-CS converter: remove mixed ordering policy check >

[jira] [Commented] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020415#comment-17020415 ] Peter Bacsko commented on YARN-10085: - Uploaded patch v4 to fix unit test failure. > FS-CS

[jira] [Updated] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10085: Attachment: YARN-10085-004.patch > FS-CS converter: remove mixed ordering policy check >

[jira] [Commented] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020141#comment-17020141 ] Peter Bacsko commented on YARN-10085: - Thanks for the comments [~adam.antal]. _"Could you please

[jira] [Updated] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10085: Attachment: YARN-10085-003.patch > FS-CS converter: remove mixed ordering policy check >

[jira] [Commented] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019548#comment-17019548 ] Peter Bacsko commented on YARN-10085: - [~snemeth] / [~adam.antal] could you pls review this patch? >

[jira] [Updated] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10085: Attachment: YARN-10085-002.patch > FS-CS converter: remove mixed ordering policy check >

[jira] [Updated] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10085: Description: In the converter, this part is very strict and probably unnecessary: {noformat}

[jira] [Updated] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10085: Description: In the converter, this part is very strict and probably unnecessary: {noformat}

[jira] [Updated] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10085: Attachment: YARN-10085-001.patch > FS-CS converter: remove mixed ordering policy check >

[jira] [Commented] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017361#comment-17017361 ] Peter Bacsko commented on YARN-10085: - Thanks [~leftnoteasy] - will modify the code accordingly. >

[jira] [Commented] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2020-01-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016925#comment-17016925 ] Peter Bacsko commented on YARN-10018: - I rebased the patch, uploaded v2. > container-executor:

[jira] [Updated] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2020-01-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10018: Attachment: YARN-10018-002.patch > container-executor: possible -1 return value of fork() is not

[jira] [Comment Edited] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016845#comment-17016845 ] Peter Bacsko edited comment on YARN-10085 at 1/16/20 12:11 PM: ---

[jira] [Commented] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016845#comment-17016845 ] Peter Bacsko commented on YARN-10085: - [~leftnoteasy] a question to you: I set YARN-9892 as a

[jira] [Commented] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2020-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016173#comment-17016173 ] Peter Bacsko commented on YARN-9892: [~leftnoteasy] thanks for sharing your thoughts - I admit I don't

[jira] [Commented] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2020-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016143#comment-17016143 ] Peter Bacsko commented on YARN-9892: [~leftnoteasy] Fair Scheduler supports all three scheduling

[jira] [Commented] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2020-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016013#comment-17016013 ] Peter Bacsko commented on YARN-9892: Ok, remaining checkstyle is a nothingburger. Test failure is

[jira] [Created] (YARN-10085) FS-CS converter: remove mixed ordering policy check

2020-01-15 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10085: --- Summary: FS-CS converter: remove mixed ordering policy check Key: YARN-10085 URL: https://issues.apache.org/jira/browse/YARN-10085 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7913) Improve error handling when application recovery fails with exception

2020-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015884#comment-17015884 ] Peter Bacsko commented on YARN-7913: +1 (non-binding). Patch looks good to me with all the

[jira] [Commented] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2020-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015865#comment-17015865 ] Peter Bacsko commented on YARN-9892: I uploaded patch v3 to fix checkstyle, whitespace issues and did

[jira] [Updated] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2020-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9892: --- Attachment: YARN-9892-003.patch > Capacity scheduler: support DRF ordering policy on queue level >

[jira] [Commented] (YARN-10082) FS-CS converter: disable terminal placement rule checking

2020-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015184#comment-17015184 ] Peter Bacsko commented on YARN-10082: - [~snemeth] please review this patch. > FS-CS converter:

[jira] [Updated] (YARN-10082) FS-CS converter: disable terminal placement rule checking

2020-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10082: Attachment: YARN-10082-002.patch > FS-CS converter: disable terminal placement rule checking >

[jira] [Commented] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2020-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015023#comment-17015023 ] Peter Bacsko commented on YARN-9892: [~maniraj...@gmail.com] have you had the chance to look at my

[jira] [Commented] (YARN-10082) FS-CS converter: disable terminal placement rule checking

2020-01-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014449#comment-17014449 ] Peter Bacsko commented on YARN-10082: - Attached patch v1 without tests. > FS-CS converter: disable

[jira] [Updated] (YARN-10082) FS-CS converter: disable terminal placement rule checking

2020-01-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10082: Attachment: YARN-10082-001.patch > FS-CS converter: disable terminal placement rule checking >

[jira] [Updated] (YARN-10082) FS-CS converter: disable terminal placement rule checking

2020-01-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10082: Description: Before YARN-8967, {{QueuePlacementRule}} class had a method called {{isTerminal()}}.

[jira] [Created] (YARN-10082) FS-CS converter: disable terminal placement rule checking

2020-01-13 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10082: --- Summary: FS-CS converter: disable terminal placement rule checking Key: YARN-10082 URL: https://issues.apache.org/jira/browse/YARN-10082 Project: Hadoop YARN

[jira] [Updated] (YARN-10067) Add dry-run feature to FS-CS converter tool

2020-01-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10067: Attachment: YARN-10067-007.patch > Add dry-run feature to FS-CS converter tool >

[jira] [Commented] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

2020-01-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012866#comment-17012866 ] Peter Bacsko commented on YARN-9698: [~brahmareddy] haven't found 3.4.0 in the list, so I removed the

[jira] [Updated] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

2020-01-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9698: --- Target Version/s: (was: 3.3.0) > [Umbrella] Tools to help migration from Fair Scheduler to Capacity

[jira] [Commented] (YARN-10067) Add dry-run feature to FS-CS converter tool

2020-01-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012864#comment-17012864 ] Peter Bacsko commented on YARN-10067: - Thanks [~snemeth] to me the enhancements look good. Uploaded

[jira] [Updated] (YARN-10067) Add dry-run feature to FS-CS converter tool

2020-01-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10067: Attachment: YARN-10067-007.patch > Add dry-run feature to FS-CS converter tool >

[jira] [Comment Edited] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

2020-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010758#comment-17010758 ] Peter Bacsko edited comment on YARN-9698 at 1/8/20 3:21 PM: [~brahmareddy] the

[jira] [Comment Edited] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

2020-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010758#comment-17010758 ] Peter Bacsko edited comment on YARN-9698 at 1/8/20 3:14 PM: [~brahmareddy] the

[jira] [Commented] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

2020-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010758#comment-17010758 ] Peter Bacsko commented on YARN-9698: [~brahmareddy] the whole umbrella will definitely won't be ready

[jira] [Commented] (YARN-10067) Add dry-run feature to FS-CS converter tool

2020-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010644#comment-17010644 ] Peter Bacsko commented on YARN-10067: - Thanks [~snemeth]. I addressed all comments except #5 which

[jira] [Updated] (YARN-10067) Add dry-run feature to FS-CS converter tool

2020-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10067: Attachment: YARN-10067-004.patch > Add dry-run feature to FS-CS converter tool >

[jira] [Commented] (YARN-10063) Usage output of container-executor binary needs to include --http/--https argument

2020-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010577#comment-17010577 ] Peter Bacsko commented on YARN-10063: - Good point [~wilfreds] - I agree with the above. > Usage

[jira] [Commented] (YARN-9879) Allow multiple leaf queues with the same name in CS

2020-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010461#comment-17010461 ] Peter Bacsko commented on YARN-9879: I just mentioned the mapping because based on my (admittedly

[jira] [Commented] (YARN-9879) Allow multiple leaf queues with the same name in CS

2020-01-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009845#comment-17009845 ] Peter Bacsko commented on YARN-9879: Alternatively, we can have {{Map fullToCSQueue}} and {{Map

[jira] [Comment Edited] (YARN-9879) Allow multiple leaf queues with the same name in CS

2020-01-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009797#comment-17009797 ] Peter Bacsko edited comment on YARN-9879 at 1/7/20 2:55 PM: [~wilfreds] based

[jira] [Commented] (YARN-9879) Allow multiple leaf queues with the same name in CS

2020-01-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009797#comment-17009797 ] Peter Bacsko commented on YARN-9879: [~wilfreds] based on your suggestion, here's what I came up with:

[jira] [Comment Edited] (YARN-9879) Allow multiple leaf queues with the same name in CS

2020-01-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009797#comment-17009797 ] Peter Bacsko edited comment on YARN-9879 at 1/7/20 2:54 PM: [~wilfreds] based

[jira] [Commented] (YARN-10063) Usage output of container-executor binary needs to include --http/--https argument

2020-01-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009429#comment-17009429 ] Peter Bacsko commented on YARN-10063: - [~sahuja] yeah, this looks like acceptable to me.  > Usage

[jira] [Commented] (YARN-10067) Add dry-run feature to FS-CS converter tool

2020-01-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008914#comment-17008914 ] Peter Bacsko commented on YARN-10067: - [~snemeth] could you pls check the changes? > Add dry-run

[jira] [Commented] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2020-01-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008878#comment-17008878 ] Peter Bacsko commented on YARN-9892: Thanks for the patch [~maniraj...@gmail.com]. I just have a few

[jira] [Comment Edited] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2020-01-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008878#comment-17008878 ] Peter Bacsko edited comment on YARN-9892 at 1/6/20 1:59 PM: Thanks for the

[jira] [Commented] (YARN-9989) Typo in CapacityScheduler documentation: Runtime Configuration

2020-01-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008810#comment-17008810 ] Peter Bacsko commented on YARN-9989: +1 (non-binding) > Typo in CapacityScheduler documentation:

[jira] [Updated] (YARN-9989) Typo in CapacityScheduler documentation: Runtime Configuration

2020-01-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9989: --- Labels: capacity-scheduler docuentation newbie (was: capacity-scheduler docuentation) > Typo in

[jira] [Updated] (YARN-9989) Typo in CapacityScheduler documentation: Runtime Configuration

2020-01-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9989: --- Labels: capacity-scheduler docuentation (was: ) > Typo in CapacityScheduler documentation: Runtime

[jira] [Commented] (YARN-10063) Usage output of container-executor binary needs to include --http/--https argument

2020-01-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17008809#comment-17008809 ] Peter Bacsko commented on YARN-10063: - [~sahuja] wouldn't it be better to print sth like {{1 appid

[jira] [Updated] (YARN-10067) Add dry-run feature to FS-CS converter tool

2020-01-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10067: Attachment: YARN-10067-003.patch > Add dry-run feature to FS-CS converter tool >

[jira] [Updated] (YARN-10067) Add dry-run feature to FS-CS converter tool

2020-01-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10067: Attachment: YARN-10067-002.patch > Add dry-run feature to FS-CS converter tool >

[jira] [Updated] (YARN-10067) Add dry-run feature to FS-CS converter tool

2020-01-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10067: Attachment: YARN-10067-001.patch > Add dry-run feature to FS-CS converter tool >

[jira] [Created] (YARN-10067) Add dry-run feature to FS-CS converter tool

2020-01-02 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10067: --- Summary: Add dry-run feature to FS-CS converter tool Key: YARN-10067 URL: https://issues.apache.org/jira/browse/YARN-10067 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-10067) Add dry-run feature to FS-CS converter tool

2020-01-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10067: Description: Add a "d" / "-dry-run" switch to the tool. The purpose of this would be to inform the

[jira] [Commented] (YARN-10051) Throwing NoSuchElementException when even dispatcher handling NODE_UPDATE

2019-12-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001638#comment-17001638 ] Peter Bacsko commented on YARN-10051: - Hi [~yxing] can you explain why you think the root cause is

[jira] [Commented] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995125#comment-16995125 ] Peter Bacsko commented on YARN-10019: - BTW I don't want to be overly pushy about this change. If you

[jira] [Commented] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995107#comment-16995107 ] Peter Bacsko commented on YARN-10019: - [~ebadger] no, we don't use these functions that you

[jira] [Updated] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10019: Priority: Minor (was: Major) > container-executor: misc improvements in child processes and

[jira] [Commented] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995029#comment-16995029 ] Peter Bacsko commented on YARN-10019: - [~szegedim] I got your point. Basically, this patch is more

[jira] [Commented] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995003#comment-16995003 ] Peter Bacsko commented on YARN-10019: - [~szegedim] we only invoke {{_exit()}} in the child process to

[jira] [Commented] (YARN-9879) Allow multiple leaf queues with the same name in CS

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994617#comment-16994617 ] Peter Bacsko commented on YARN-9879: Note: after the implementation is complete, remove this part from

[jira] [Commented] (YARN-9863) Randomize List of Resources to Localize

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994542#comment-16994542 ] Peter Bacsko commented on YARN-9863: [~belugabehr] do you have benchmarks by any chance? Theoretically

[jira] [Commented] (YARN-9951) Unify Error Messages in container-executor

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994539#comment-16994539 ] Peter Bacsko commented on YARN-9951: Minor comments from me: {noformat} if

[jira] [Comment Edited] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994520#comment-16994520 ] Peter Bacsko edited comment on YARN-10019 at 12/12/19 10:51 AM: Note: I

[jira] [Comment Edited] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994496#comment-16994496 ] Peter Bacsko edited comment on YARN-10018 at 12/12/19 10:50 AM:

[jira] [Commented] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994520#comment-16994520 ] Peter Bacsko commented on YARN-10019: - Note: I also changed some constants (0, 1, 2) to symbolic

[jira] [Comment Edited] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994520#comment-16994520 ] Peter Bacsko edited comment on YARN-10019 at 12/12/19 10:48 AM: Note: I

[jira] [Commented] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994496#comment-16994496 ] Peter Bacsko commented on YARN-10018: - [~szegedim], [~eyang] do you have some time to check this out?

[jira] [Updated] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10019: Attachment: YARN-10019-002.patch > container-executor: misc improvements in child processes and

[jira] [Updated] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10019: Attachment: YARN-10019-001.patch > container-executor: misc improvements in child processes and

[jira] [Commented] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991487#comment-16991487 ] Peter Bacsko commented on YARN-10018: - [~adam.antal] usually there's a proper exit code defined in

[jira] [Commented] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991117#comment-16991117 ] Peter Bacsko commented on YARN-10018: - [~ebadger] no worries, thanks for fixing. >

[jira] [Updated] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10018: Attachment: YARN-10018-001.patch > container-executor: possible -1 return value of fork() is not

[jira] [Created] (YARN-10019) container-executor: misc improvements in child process and regarding exec() calls

2019-12-07 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10019: --- Summary: container-executor: misc improvements in child process and regarding exec() calls Key: YARN-10019 URL: https://issues.apache.org/jira/browse/YARN-10019

[jira] [Updated] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10019: Summary: container-executor: misc improvements in child processes and exec() calls (was:

[jira] [Commented] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990484#comment-16990484 ] Peter Bacsko commented on YARN-10018: - [~ebadger] you recently worked on the native code, do you have

[jira] [Commented] (YARN-9868) Validate %primary_group queue in CS queue manager

2019-12-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990477#comment-16990477 ] Peter Bacsko commented on YARN-9868: Thanks [~maniraj...@gmail.com] +1 (non-binding) from me.

[jira] [Updated] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10018: Attachment: YARN-10018-001.patch > container-executor: possible -1 return value of fork() is not

[jira] [Updated] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10018: Description: There are some places in the container-executor native, where the {{fork()}} call is

<    5   6   7   8   9   10   11   12   13   14   >