[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-branch-3.2.001.patch > FairScheduler: NODE_UPDATE can cause

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config

2019-09-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16939325#comment-16939325 ] Peter Bacsko commented on YARN-9699: +1 for standalone tool. Having to have a running RM instance is a

[jira] [Assigned] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-09-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9840: -- Assignee: Manikandan R (was: Peter Bacsko) > Capacity scheduler: add support for Secondary

[jira] [Assigned] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9841: -- Assignee: Manikandan R (was: Peter Bacsko) > Capacity scheduler: add support for combined

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935372#comment-16935372 ] Peter Bacsko commented on YARN-9841: [~maniraj...@gmail.com] sure, no problem. > Capacity scheduler:

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-branch-3.1.001.patch > FairScheduler: NODE_UPDATE can cause

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940924#comment-16940924 ] Peter Bacsko commented on YARN-9841: I checked the first rule mapping: {{"u:user2:%primary_group"}} -

[jira] [Comment Edited] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16940924#comment-16940924 ] Peter Bacsko edited comment on YARN-9841 at 9/30/19 12:28 PM: -- I checked the

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863889#comment-16863889 ] Peter Bacsko commented on YARN-9525: [~adam.antal] is it possible to add some unit tests that

[jira] [Comment Edited] (YARN-9525) IFile format is not working against s3a remote folder

2019-06-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863889#comment-16863889 ] Peter Bacsko edited comment on YARN-9525 at 6/14/19 9:43 AM: - [~adam.antal] is

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880230#comment-16880230 ] Peter Bacsko commented on YARN-9667: I suggest considering two things: 1) When setting ERRORFILE or

[jira] [Comment Edited] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880230#comment-16880230 ] Peter Bacsko edited comment on YARN-9667 at 7/8/19 11:35 AM: - I suggest

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880234#comment-16880234 ] Peter Bacsko commented on YARN-9667: cc [~aceric] what do you think? Not sure who should be involved

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880280#comment-16880280 ] Peter Bacsko commented on YARN-9667: cc [~shaneku...@gmail.com] also > Container-executor.c

[jira] [Updated] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9660: --- Attachment: YARN-9660-002.patch > Enhance documentation of Docker on YARN support >

[jira] [Commented] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881935#comment-16881935 ] Peter Bacsko commented on YARN-9660: Thanks [~eyang] I updated the patch. v2 should be rendered

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881981#comment-16881981 ] Peter Bacsko commented on YARN-9667: ping [~eyang] > Container-executor.c duplicates messages to

[jira] [Commented] (YARN-9930) Support max running app logic for CapacityScheduler

2019-11-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966969#comment-16966969 ] Peter Bacsko commented on YARN-9930: [~cane] as [~epayne] noted above, this is exactly what FS does

[jira] [Commented] (YARN-9930) Support max running app logic for CapacityScheduler

2019-11-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970421#comment-16970421 ] Peter Bacsko commented on YARN-9930: [~epayne] thanks for explaining - now it's clear. I do agree that

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-11-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969193#comment-16969193 ] Peter Bacsko commented on YARN-9011: [~adam.antal] thanks for the comments. _"[...] renaming

[jira] [Updated] (YARN-9011) Race condition during decommissioning

2019-11-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9011: --- Attachment: YARN-9011-009.patch > Race condition during decommissioning >

[jira] [Comment Edited] (YARN-9877) Intermittent TIME_OUT of LogAggregationReport

2019-11-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969209#comment-16969209 ] Peter Bacsko edited comment on YARN-9877 at 11/7/19 12:14 PM: -- [~adam.antal] 

[jira] [Commented] (YARN-9877) Intermittent TIME_OUT of LogAggregationReport

2019-11-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969209#comment-16969209 ] Peter Bacsko commented on YARN-9877: [~adam.antal] to understand the issue better, I have a question:

[jira] [Commented] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964099#comment-16964099 ] Peter Bacsko commented on YARN-9899: Note: failing tests seems to fail for a reason other than the

[jira] [Updated] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9899: --- Attachment: YARN-9899-004.patch > Migration tool that help to generate CS config based on FS config

[jira] [Updated] (YARN-9865) Capacity scheduler: add support for combined %user + %secondary_group mapping

2019-10-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9865: --- Attachment: YARN-9865-005.patch > Capacity scheduler: add support for combined %user +

[jira] [Commented] (YARN-9865) Capacity scheduler: add support for combined %user + %secondary_group mapping

2019-10-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963002#comment-16963002 ] Peter Bacsko commented on YARN-9865: Patch v4 looks good. I made a small refactor regarding the

[jira] [Comment Edited] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963082#comment-16963082 ] Peter Bacsko edited comment on YARN-9899 at 10/30/19 2:59 PM: -- [~snemeth]

[jira] [Commented] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-10-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963082#comment-16963082 ] Peter Bacsko commented on YARN-9899: [~snemeth] this is the help text that you get with this patch:

[jira] [Commented] (YARN-9930) Support max running app logic for CapacityScheduler

2019-11-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974285#comment-16974285 ] Peter Bacsko commented on YARN-9930: [~cane] what will be your approach? I think the best would be to

[jira] [Updated] (YARN-9912) Capacity scheduler: support u:user2:%secondary_group queue mapping

2019-11-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9912: --- Summary: Capacity scheduler: support u:user2:%secondary_group queue mapping (was: Support

[jira] [Updated] (YARN-9912) Capacity scheduler: support u:user2:%secondary_group queue mapping

2019-11-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9912: --- Component/s: capacityscheduler capacity scheduler > Capacity scheduler: support

[jira] [Commented] (YARN-8373) RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH

2019-11-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976389#comment-16976389 ] Peter Bacsko commented on YARN-8373: Thanks [~wilfreds] now it looks solid. +1 (non-binding) again

[jira] [Updated] (YARN-9868) Validate %primary_group queue in CS queue manager

2019-11-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9868: --- Attachment: YARN-9868-003.patch > Validate %primary_group queue in CS queue manager >

[jira] [Commented] (YARN-9969) Improve yarn.scheduler.capacity.queue-mappings documentation

2019-11-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976536#comment-16976536 ] Peter Bacsko commented on YARN-9969: Thanks for the patch [~maniraj...@gmail.com]. Please correct the

[jira] [Updated] (YARN-9912) Capacity scheduler: support u:user2:%secondary_group queue mapping

2019-11-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9912: --- Attachment: YARN-9912-004.patch > Capacity scheduler: support u:user2:%secondary_group queue mapping

[jira] [Comment Edited] (YARN-9912) Capacity scheduler: support u:user2:%secondary_group queue mapping

2019-11-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976599#comment-16976599 ] Peter Bacsko edited comment on YARN-9912 at 11/18/19 2:32 PM: --

[jira] [Commented] (YARN-9912) Capacity scheduler: support u:user2:%secondary_group queue mapping

2019-11-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976599#comment-16976599 ] Peter Bacsko commented on YARN-9912: [~maniraj...@gmail.com] the patch cannot apply to trunk because

[jira] [Updated] (YARN-9011) Race condition during decommissioning

2019-11-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9011: --- Attachment: YARN-9011-branch-3.2.001.patch > Race condition during decommissioning >

[jira] [Commented] (YARN-9362) Code cleanup in TestNMLeveldbStateStoreService

2019-11-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975172#comment-16975172 ] Peter Bacsko commented on YARN-9362: +1 (non-binding) from me. > Code cleanup in

[jira] [Updated] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-11-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9899: --- Attachment: YARN-9899-006.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-8373) RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH

2019-11-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975404#comment-16975404 ] Peter Bacsko commented on YARN-8373: [~wilfreds] I have some concerns regarding the use of

[jira] [Commented] (YARN-8373) RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH

2019-11-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975730#comment-16975730 ] Peter Bacsko commented on YARN-8373: Thanks [~wilfreds] for explaining. If that is the case, let's

[jira] [Commented] (YARN-8373) RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH

2019-11-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975731#comment-16975731 ] Peter Bacsko commented on YARN-8373: Just two little things: 1. Javadoc still says "PriorityQueue":

[jira] [Commented] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-11-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967513#comment-16967513 ] Peter Bacsko commented on YARN-9899: Fixed a couple of minor things in v5. Also, if args.length == 0,

[jira] [Updated] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-11-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9899: --- Attachment: YARN-9899-005.patch > Migration tool that help to generate CS config based on FS config

[jira] [Commented] (YARN-9362) Code cleanup in TestNMLeveldbStateStoreService

2019-11-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967545#comment-16967545 ] Peter Bacsko commented on YARN-9362: Thanks for the patch [~denes.gerencser]. I don't have too much

[jira] [Commented] (YARN-9677) Make FpgaDevice and GpuDevice classes more similar to each other

2019-11-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16967556#comment-16967556 ] Peter Bacsko commented on YARN-9677: Thanks for the patch [~pingsutw]. Looks like a straightforward

[jira] [Commented] (YARN-9930) Support max running app logic for CapacityScheduler

2019-11-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969028#comment-16969028 ] Peter Bacsko commented on YARN-9930: [~epayne] [~cane] I'm a bit lost here. This setting currently

[jira] [Commented] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

2019-11-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979065#comment-16979065 ] Peter Bacsko commented on YARN-9899: [~snemeth] I just tested the patch on a real Hadoop cluster.

[jira] [Commented] (YARN-8373) RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH

2019-11-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979004#comment-16979004 ] Peter Bacsko commented on YARN-8373: [~sunilg] don't we need this patch to branch-3.2 also? > RM

[jira] [Commented] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991487#comment-16991487 ] Peter Bacsko commented on YARN-10018: - [~adam.antal] usually there's a proper exit code defined in

[jira] [Updated] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10018: Attachment: YARN-10018-001.patch > container-executor: possible -1 return value of fork() is not

[jira] [Commented] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16991117#comment-16991117 ] Peter Bacsko commented on YARN-10018: - [~ebadger] no worries, thanks for fixing. >

[jira] [Updated] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10019: Attachment: YARN-10019-001.patch > container-executor: misc improvements in child processes and

[jira] [Comment Edited] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994520#comment-16994520 ] Peter Bacsko edited comment on YARN-10019 at 12/12/19 10:51 AM: Note: I

[jira] [Commented] (YARN-9879) Allow multiple leaf queues with the same name in CS

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994617#comment-16994617 ] Peter Bacsko commented on YARN-9879: Note: after the implementation is complete, remove this part from

[jira] [Commented] (YARN-9863) Randomize List of Resources to Localize

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994542#comment-16994542 ] Peter Bacsko commented on YARN-9863: [~belugabehr] do you have benchmarks by any chance? Theoretically

[jira] [Commented] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994520#comment-16994520 ] Peter Bacsko commented on YARN-10019: - Note: I also changed some constants (0, 1, 2) to symbolic

[jira] [Comment Edited] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994520#comment-16994520 ] Peter Bacsko edited comment on YARN-10019 at 12/12/19 10:48 AM: Note: I

[jira] [Commented] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994496#comment-16994496 ] Peter Bacsko commented on YARN-10018: - [~szegedim], [~eyang] do you have some time to check this out?

[jira] [Comment Edited] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994496#comment-16994496 ] Peter Bacsko edited comment on YARN-10018 at 12/12/19 10:50 AM:

[jira] [Commented] (YARN-9951) Unify Error Messages in container-executor

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994539#comment-16994539 ] Peter Bacsko commented on YARN-9951: Minor comments from me: {noformat} if

[jira] [Commented] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995003#comment-16995003 ] Peter Bacsko commented on YARN-10019: - [~szegedim] we only invoke {{_exit()}} in the child process to

[jira] [Updated] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10019: Priority: Minor (was: Major) > container-executor: misc improvements in child processes and

[jira] [Commented] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995029#comment-16995029 ] Peter Bacsko commented on YARN-10019: - [~szegedim] I got your point. Basically, this patch is more

[jira] [Commented] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995107#comment-16995107 ] Peter Bacsko commented on YARN-10019: - [~ebadger] no, we don't use these functions that you

[jira] [Commented] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995125#comment-16995125 ] Peter Bacsko commented on YARN-10019: - BTW I don't want to be overly pushy about this change. If you

[jira] [Updated] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10018: Attachment: YARN-10018-001.patch > container-executor: possible -1 return value of fork() is not

[jira] [Commented] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990484#comment-16990484 ] Peter Bacsko commented on YARN-10018: - [~ebadger] you recently worked on the native code, do you have

[jira] [Commented] (YARN-9868) Validate %primary_group queue in CS queue manager

2019-12-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990477#comment-16990477 ] Peter Bacsko commented on YARN-9868: Thanks [~maniraj...@gmail.com] +1 (non-binding) from me.

[jira] [Updated] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10018: Description: There are some places in the container-executor native, where the {{fork()}} call is

[jira] [Created] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-07 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10018: --- Summary: container-executor: possible -1 return value of fork() is not always checked Key: YARN-10018 URL: https://issues.apache.org/jira/browse/YARN-10018 Project:

[jira] [Created] (YARN-10019) container-executor: misc improvements in child process and regarding exec() calls

2019-12-07 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10019: --- Summary: container-executor: misc improvements in child process and regarding exec() calls Key: YARN-10019 URL: https://issues.apache.org/jira/browse/YARN-10019

[jira] [Updated] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10019: Summary: container-executor: misc improvements in child processes and exec() calls (was:

[jira] [Commented] (YARN-9970) Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping

2019-12-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989696#comment-16989696 ] Peter Bacsko commented on YARN-9970: +1 (non-binding). Checkstyle complains about the method being too

[jira] [Commented] (YARN-9925) CapacitySchedulerQueueManager allows unsupported Queue hierarchy

2019-12-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989700#comment-16989700 ] Peter Bacsko commented on YARN-9925: +1 (non-binding). > CapacitySchedulerQueueManager allows

[jira] [Commented] (YARN-4029) Update LogAggregationStatus to store on finish

2019-12-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989703#comment-16989703 ] Peter Bacsko commented on YARN-4029: [~adam.antal] there are a bunch unit test failures. Can you

[jira] [Commented] (YARN-9920) YarnAuthorizationProvider AccessRequest gets Null RemoteAddress from FairScheduler

2019-12-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989720#comment-16989720 ] Peter Bacsko commented on YARN-9920: [~prabhujoseph] could you pls re-upload the patch? There are some

[jira] [Updated] (YARN-9868) Validate %primary_group queue in CS queue manager

2019-12-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9868: --- Attachment: YARN-9868-003.patch > Validate %primary_group queue in CS queue manager >

[jira] [Commented] (YARN-9868) Validate %primary_group queue in CS queue manager

2019-12-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989725#comment-16989725 ] Peter Bacsko commented on YARN-9868: Re-uploaded v3 again to see the checkstyle warning (Jenkins build

[jira] [Updated] (YARN-9868) Validate %primary_group queue in CS queue manager

2019-12-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9868: --- Attachment: YARN-9868-004.patch > Validate %primary_group queue in CS queue manager >

[jira] [Commented] (YARN-9868) Validate %primary_group queue in CS queue manager

2019-12-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989781#comment-16989781 ] Peter Bacsko commented on YARN-9868: Did a rebase, hopefully it's gonna work. > Validate

[jira] [Updated] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10019: Attachment: YARN-10019-002.patch > container-executor: misc improvements in child processes and

[jira] [Commented] (YARN-9865) Capacity scheduler: add support for combined %user + %secondary_group mapping

2019-10-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959662#comment-16959662 ] Peter Bacsko commented on YARN-9865: [~maniraj...@gmail.com] I agree, this is negligible. Let's skip

[jira] [Commented] (YARN-9930) Support max running app logic for CapacityScheduler

2019-10-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959719#comment-16959719 ] Peter Bacsko commented on YARN-9930: To me this looks like a duplicate. [~cane] please check and close

[jira] [Commented] (YARN-9868) Validate %primary_group queue in CS queue manager

2019-10-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960973#comment-16960973 ] Peter Bacsko commented on YARN-9868: Thanks for patch [~maniraj...@gmail.com], unfortunately it no

[jira] [Commented] (YARN-9780) SchedulerConf Mutation Api does not Allow Stop and Remove Queue in a single call

2019-10-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960936#comment-16960936 ] Peter Bacsko commented on YARN-9780: Latest patch +1 (non-binding). > SchedulerConf Mutation Api does

[jira] [Commented] (YARN-9788) Queue Management API - does not support parallel updates

2019-10-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16960937#comment-16960937 ] Peter Bacsko commented on YARN-9788: +1 (non-binding) > Queue Management API - does not support

[jira] [Commented] (YARN-9891) Capacity scheduler: enhance capacity / maximum-capacity setting

2019-10-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961000#comment-16961000 ] Peter Bacsko commented on YARN-9891: Apparently, [~zsiegl] will work on this in YARN-9936. Closing

[jira] [Resolved] (YARN-9891) Capacity scheduler: enhance capacity / maximum-capacity setting

2019-10-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko resolved YARN-9891. Resolution: Duplicate > Capacity scheduler: enhance capacity / maximum-capacity setting >

[jira] [Updated] (YARN-9011) Race condition during decommissioning

2019-10-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9011: --- Attachment: YARN-9011-007.patch > Race condition during decommissioning >

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-10-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961133#comment-16961133 ] Peter Bacsko commented on YARN-9011: Thanks [~snemeth] for the comments - uploaded patch v7 with

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS config based on FS config [Phase 1]

2019-10-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16955926#comment-16955926 ] Peter Bacsko commented on YARN-9699: Thanks [~eyang], I created YARN-9922 to fix these Javadoc issues.

[jira] [Created] (YARN-9922) Fix JavaDoc errors introduced by YARN-9699

2019-10-21 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-9922: -- Summary: Fix JavaDoc errors introduced by YARN-9699 Key: YARN-9922 URL: https://issues.apache.org/jira/browse/YARN-9922 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-9922) Fix JavaDoc errors introduced by YARN-9699

2019-10-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9922: --- Attachment: YARN-9922-001.patch > Fix JavaDoc errors introduced by YARN-9699 >

[jira] [Updated] (YARN-9922) Fix JavaDoc errors introduced by YARN-9699

2019-10-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9922: --- Description: We accidentally introduced some Javadoc errors in YARN-9699: {code:java} [ERROR]

[jira] [Commented] (YARN-9922) Fix JavaDoc errors introduced by YARN-9699

2019-10-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956017#comment-16956017 ] Peter Bacsko commented on YARN-9922: Findbugs is unrelated, "no tests" is obvious. pls check [~eyang]

[jira] [Commented] (YARN-9865) Capacity scheduler: add support for combined %user + %secondary_group mapping

2019-10-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956096#comment-16956096 ] Peter Bacsko commented on YARN-9865: [~maniraj...@gmail.com] could you please fix the last checkstyle

[jira] [Commented] (YARN-9887) Capacity scheduler: add support for limiting maxRunningApps per user

2019-10-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956102#comment-16956102 ] Peter Bacsko commented on YARN-9887: [~epayne] sorry for the delayed answer. Thanks for the info, I'm

<    1   2   3   4   5   6   7   8   9   10   >