[jira] [Commented] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2020-01-16 Thread Miklos Szegedi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17017541#comment-17017541 ] Miklos Szegedi commented on YARN-10018: --- [~pbacsko], thank you for the updated patch. I think we

[jira] [Created] (YARN-10050) NodeManagerCGroupsMemory.md does not show up in the official documentation

2019-12-19 Thread Miklos Szegedi (Jira)
Miklos Szegedi created YARN-10050: - Summary: NodeManagerCGroupsMemory.md does not show up in the official documentation Key: YARN-10050 URL: https://issues.apache.org/jira/browse/YARN-10050 Project:

[jira] [Commented] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Miklos Szegedi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995007#comment-16995007 ] Miklos Szegedi commented on YARN-10019: --- [~pbacsko] indeed, however there may be libc specific

[jira] [Commented] (YARN-10018) container-executor: possible -1 return value of fork() is not always checked

2019-12-12 Thread Miklos Szegedi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994983#comment-16994983 ] Miklos Szegedi commented on YARN-10018: --- Thank you for the patch [~pbacsko]. I have one

[jira] [Commented] (YARN-10019) container-executor: misc improvements in child processes and exec() calls

2019-12-12 Thread Miklos Szegedi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994970#comment-16994970 ] Miklos Szegedi commented on YARN-10019: --- I have a bit of a concern. The standard library cleanup

[jira] [Commented] (YARN-9951) Unify Error Messages in container-executor

2019-12-10 Thread Miklos Szegedi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992843#comment-16992843 ] Miklos Szegedi commented on YARN-9951: -- Hi there. I try to look at it later this week.   > Unify

[jira] [Commented] (YARN-8373) RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH

2019-11-07 Thread Miklos Szegedi (Jira)
[ https://issues.apache.org/jira/browse/YARN-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969797#comment-16969797 ] Miklos Szegedi commented on YARN-8373: -- Thank you [~wilfreds] for the patch. Is this patch against

[jira] [Commented] (YARN-9863) Randomize List of Resources to Localize

2019-10-30 Thread Miklos Szegedi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963398#comment-16963398 ] Miklos Szegedi commented on YARN-9863: -- [~belugabehr], thank you for the feedback. I did some end to

[jira] [Commented] (YARN-9863) Randomize List of Resources to Localize

2019-10-11 Thread Miklos Szegedi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949707#comment-16949707 ] Miklos Szegedi commented on YARN-9863: -- [~belugabehr], could you explain the motivation for this

[jira] [Comment Edited] (YARN-9863) Randomize List of Resources to Localize

2019-10-11 Thread Miklos Szegedi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949707#comment-16949707 ] Miklos Szegedi edited comment on YARN-9863 at 10/11/19 6:39 PM:

[jira] [Commented] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-09-03 Thread Miklos Szegedi (Jira)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921596#comment-16921596 ] Miklos Szegedi commented on YARN-6715: -- [~pbacsko] Is a week ETA okay for the review? > Fix

[jira] [Commented] (YARN-8590) Fair scheduler promotion does not update container execution type and token

2018-10-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645896#comment-16645896 ] Miklos Szegedi commented on YARN-8590: -- +1. Thank you for the patch [~haibochen], and for the review

[jira] [Commented] (YARN-8590) Fair scheduler promotion does not update container execution type and token

2018-10-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642791#comment-16642791 ] Miklos Szegedi commented on YARN-8590: -- I think it is okay to do the code refactoring in another

[jira] [Commented] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-09-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601234#comment-16601234 ] Miklos Szegedi commented on YARN-8717: -- Thanks, [~yangjiandan] for raising this and the patch and

[jira] [Commented] (YARN-8590) Fair scheduler promotion does not update container execution type and token

2018-08-13 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579256#comment-16579256 ] Miklos Szegedi commented on YARN-8590: -- Thank you, I have no other comments. It seems that the

[jira] [Commented] (YARN-8590) Fair scheduler promotion does not update container execution type and token

2018-08-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16569376#comment-16569376 ] Miklos Szegedi commented on YARN-8590: -- Thank you for the patch [~haibochen]. {code:java} 941

[jira] [Commented] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

2018-06-30 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16528834#comment-16528834 ] Miklos Szegedi commented on YARN-6672: -- I checked and I would like to add an additional +1 on the

[jira] [Created] (YARN-8470) Fair scheduler exception with SLS

2018-06-27 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-8470: Summary: Fair scheduler exception with SLS Key: YARN-8470 URL: https://issues.apache.org/jira/browse/YARN-8470 Project: Hadoop YARN Issue Type: Bug

[jira] [Assigned] (YARN-8452) FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on

2018-06-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-8452: Assignee: (was: Miklos Szegedi) > FairScheduler.update can take long time if >

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-06-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16525296#comment-16525296 ] Miklos Szegedi commented on YARN-8468: -- [~bsteinbach], thank you for raising this. I have some

[jira] [Commented] (YARN-8461) Support strict memory control on individual container with elastic control memory mechanism

2018-06-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524279#comment-16524279 ] Miklos Szegedi commented on YARN-8461: -- +1 LGTM. > Support strict memory control on individual

[jira] [Commented] (YARN-8461) Support strict memory control on individual container with elastic control memory mechanism

2018-06-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524280#comment-16524280 ] Miklos Szegedi commented on YARN-8461: -- I will commit this shortly pending jenkins. > Support strict

[jira] [Commented] (YARN-8461) Support strict memory control on individual container with elastic control memory mechanism

2018-06-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524258#comment-16524258 ] Miklos Szegedi commented on YARN-8461: -- Thank you for the patch [~haibochen]. {code:java} if

[jira] [Updated] (YARN-8452) FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on

2018-06-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8452: - Attachment: YARN-8452.003.patch > FairScheduler.update can take long time if >

[jira] [Commented] (YARN-8452) FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on

2018-06-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16524035#comment-16524035 ] Miklos Szegedi commented on YARN-8452: -- Thank you for the review [~wilfreds]. I updated the patch. I

[jira] [Updated] (YARN-8452) FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on

2018-06-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8452: - Attachment: YARN-8452.002.patch > FairScheduler.update can take long time if >

[jira] [Updated] (YARN-8452) FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on

2018-06-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8452: - Attachment: YARN-8452.001.patch > FairScheduler.update can take long time if >

[jira] [Commented] (YARN-8461) Support strict memory control on individual container with elastic control memory mechanism

2018-06-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523054#comment-16523054 ] Miklos Szegedi commented on YARN-8461: -- [~haibochen], thank you for the patch. {code:java} 188 if

[jira] [Commented] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

2018-06-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16523050#comment-16523050 ] Miklos Szegedi commented on YARN-8438: -- +1 LGTM. > TestContainer.testKillOnNew flaky on trunk >

[jira] [Commented] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

2018-06-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520815#comment-16520815 ] Miklos Szegedi commented on YARN-8438: -- I think it is legitimate that a code is fast. I would vote

[jira] [Updated] (YARN-8452) FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on

2018-06-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8452: - Attachment: YARN-8452.000.patch > FairScheduler.update can take long time if >

[jira] [Assigned] (YARN-8452) FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on

2018-06-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-8452: Assignee: Miklos Szegedi > FairScheduler.update can take long time if >

[jira] [Assigned] (YARN-8452) FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on

2018-06-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-8452: Assignee: (was: Szilard Nemeth) > FairScheduler.update can take long time if >

[jira] [Commented] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

2018-06-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520758#comment-16520758 ] Miklos Szegedi commented on YARN-8438: -- Thank you for the updated patch [~snemeth]. Why do not you

[jira] [Created] (YARN-8452) FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on

2018-06-22 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-8452: Summary: FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on Key: YARN-8452 URL: https://issues.apache.org/jira/browse/YARN-8452

[jira] [Commented] (YARN-8427) Don't start opportunistic containers at container scheduler/finish event with over-allocation

2018-06-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520607#comment-16520607 ] Miklos Szegedi commented on YARN-8427: -- +1 LGTM. If there are no concerns, I will commit this

[jira] [Commented] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

2018-06-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519861#comment-16519861 ] Miklos Szegedi commented on YARN-8438: -- Thank you for the patch [~snemeth]. This will still return

[jira] [Commented] (YARN-8427) Don't start opportunistic containers at container scheduler/finish event with over-allocation

2018-06-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518652#comment-16518652 ] Miklos Szegedi commented on YARN-8427: -- [~arun.sur...@gmail.com], [~leftnoteasy], do you have any

[jira] [Commented] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

2018-06-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518648#comment-16518648 ] Miklos Szegedi commented on YARN-8438: -- Thank you for the patch [~snemeth]. I would choose a better

[jira] [Commented] (YARN-8441) Typo in CSQueueUtils local variable names: queueGuranteedResource

2018-06-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518488#comment-16518488 ] Miklos Szegedi commented on YARN-8441: -- +1 LGTM. > Typo in CSQueueUtils local variable names:

[jira] [Commented] (YARN-8442) Strange characters and missing spaces in FairScheduler documentation

2018-06-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518486#comment-16518486 ] Miklos Szegedi commented on YARN-8442: -- +1 LGTM. > Strange characters and missing spaces in

[jira] [Commented] (YARN-7449) Split up class TestYarnClient to TestYarnClient and TestYarnClientImpl

2018-06-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518482#comment-16518482 ] Miklos Szegedi commented on YARN-7449: -- +1 LGTM. > Split up class TestYarnClient to TestYarnClient

[jira] [Commented] (YARN-8440) Typo in YarnConfiguration javadoc: "Miniumum request grant-able.."

2018-06-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518464#comment-16518464 ] Miklos Szegedi commented on YARN-8440: -- +1 LGTM. > Typo in YarnConfiguration javadoc: "Miniumum

[jira] [Commented] (YARN-8427) Don't start opportunistic containers at container scheduler/finish event with over-allocation

2018-06-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518443#comment-16518443 ] Miklos Szegedi commented on YARN-8427: -- Thank you for the patch [~haibochen]. Please address the

[jira] [Updated] (YARN-8391) Investigate AllocationFileLoaderService.reloadListener locking issue

2018-06-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8391: - Fix Version/s: 3.2.0 > Investigate AllocationFileLoaderService.reloadListener locking issue >

[jira] [Commented] (YARN-6794) Fair Scheduler to explicitly promote OPPORTUNISITIC containers locally at the node where they're running

2018-06-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518414#comment-16518414 ] Miklos Szegedi commented on YARN-6794: -- +1 LGTM. I will commit this shortly. > Fair Scheduler to

[jira] [Commented] (YARN-8391) Investigate AllocationFileLoaderService.reloadListener locking issue

2018-06-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518384#comment-16518384 ] Miklos Szegedi commented on YARN-8391: -- +1 LGTM. I will commit this shortly. > Investigate

[jira] [Updated] (YARN-7145) Identify potential flaky unit tests

2018-06-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7145: - Labels: newbie (was: ) > Identify potential flaky unit tests >

[jira] [Updated] (YARN-8437) Build oom-listener on older versions

2018-06-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8437: - Attachment: YARN-8437.000.patch > Build oom-listener on older versions >

[jira] [Created] (YARN-8437) Build oom-listener on older versions

2018-06-19 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-8437: Summary: Build oom-listener on older versions Key: YARN-8437 URL: https://issues.apache.org/jira/browse/YARN-8437 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-6794) Fair Scheduler to explicitly promote OPPORTUNISITIC containers locally at the node where they're running

2018-06-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517650#comment-16517650 ] Miklos Szegedi commented on YARN-6794: -- Thank you for the update [~haibochen]. {code} 519

[jira] [Assigned] (YARN-7145) Identify potential flaky unit tests

2018-06-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-7145: Assignee: (was: Miklos Szegedi) > Identify potential flaky unit tests >

[jira] [Commented] (YARN-7449) Split up class TestYarnClient to TestYarnClient and TestYarnClientImpl

2018-06-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517344#comment-16517344 ] Miklos Szegedi commented on YARN-7449: -- Thank you for the patch [~snemeth]. I still see references to

[jira] [Commented] (YARN-8391) Investigate AllocationFileLoaderService.reloadListener locking issue

2018-06-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517335#comment-16517335 ] Miklos Szegedi commented on YARN-8391: -- Thank you for the patch [~snemeth]. Is the unit test does not

[jira] [Assigned] (YARN-7712) Add ability to ignore timestamps in localized files

2018-06-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-7712: Assignee: (was: Miklos Szegedi) > Add ability to ignore timestamps in localized files

[jira] [Commented] (YARN-7712) Add ability to ignore timestamps in localized files

2018-06-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516509#comment-16516509 ] Miklos Szegedi commented on YARN-7712: -- Since I really needed this only for testing, let's defer this

[jira] [Updated] (YARN-7713) Add parallel copying of directories into FSDownload

2018-06-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7713: - Labels: newbie (was: ) > Add parallel copying of directories into FSDownload >

[jira] [Assigned] (YARN-7713) Add parallel copying of directories into FSDownload

2018-06-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-7713: Assignee: (was: Miklos Szegedi) > Add parallel copying of directories into FSDownload

[jira] [Assigned] (YARN-5986) Add support for container specific properties to the ContainerLaunchContext

2018-06-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-5986: Assignee: (was: Miklos Szegedi) > Add support for container specific properties to the

[jira] [Commented] (YARN-6794) Fair Scheduler to explicitly promote OPPORTUNISITIC containers locally at the node where they're running

2018-06-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516505#comment-16516505 ] Miklos Szegedi commented on YARN-6794: -- Thank you for the patch [~haibochen]. I have the following

[jira] [Commented] (YARN-8320) [Umbrella] Support CPU isolation for latency-sensitive (LS) service

2018-06-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516290#comment-16516290 ] Miklos Szegedi commented on YARN-8320: -- [~cheersyang], thank you for the response. Indeed, I was

[jira] [Commented] (YARN-6677) Preempt opportunistic containers when root container cgroup goes over memory limit

2018-06-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505510#comment-16505510 ] Miklos Szegedi commented on YARN-6677: -- Committed to trunk as well per request of [~haibochen]. >

[jira] [Updated] (YARN-6677) Preempt opportunistic containers when root container cgroup goes over memory limit

2018-06-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6677: - Fix Version/s: 3.2.0 > Preempt opportunistic containers when root container cgroup goes over

[jira] [Commented] (YARN-6677) Preempt opportunistic containers when root container cgroup goes over memory limit

2018-06-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505177#comment-16505177 ] Miklos Szegedi commented on YARN-6677: -- +1 LGTM. > Preempt opportunistic containers when root

[jira] [Commented] (YARN-6677) Preempt opportunistic containers when root container cgroup goes over memory limit

2018-06-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504060#comment-16504060 ] Miklos Szegedi commented on YARN-6677: -- [~haibochen], could you address the findbugs? > Preempt

[jira] [Resolved] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2018-06-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi resolved YARN-1014. -- Resolution: Won't Fix > Configure OOM Killer to kill OPPORTUNISTIC containers first >

[jira] [Commented] (YARN-8320) [Umbrella] Support CPU isolation for latency-sensitive (LS) service

2018-06-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503850#comment-16503850 ] Miklos Szegedi commented on YARN-8320: -- [~cheersyang], it makes sense in general. I think what you

[jira] [Assigned] (YARN-7712) Add ability to ignore timestamps in localized files

2018-06-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-7712: Assignee: Miklos Szegedi (was: Miklos Szegedi) > Add ability to ignore timestamps in

[jira] [Assigned] (YARN-7713) Add parallel copying of directories into FSDownload

2018-06-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-7713: Assignee: Miklos Szegedi (was: Miklos Szegedi) > Add parallel copying of directories into

[jira] [Assigned] (YARN-5986) Add support for container specific properties to the ContainerLaunchContext

2018-06-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-5986: Assignee: Miklos Szegedi (was: Miklos Szegedi) > Add support for container specific

[jira] [Assigned] (YARN-7145) Identify potential flaky unit tests

2018-06-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-7145: Assignee: Miklos Szegedi (was: Miklos Szegedi) > Identify potential flaky unit tests >

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-06-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503483#comment-16503483 ] Miklos Szegedi commented on YARN-4599: -- [~jlowe], this should be addressed now. > Set OOM control

[jira] [Assigned] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2018-06-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-1014: Assignee: (was: Miklos Szegedi) > Configure OOM Killer to kill OPPORTUNISTIC

[jira] [Commented] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2018-06-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503480#comment-16503480 ] Miklos Szegedi commented on YARN-1014: -- I think YARN-4599 and YARN-6677 addresses this. [~haibochen],

[jira] [Assigned] (YARN-6677) Preempt opportunistic containers when root container cgroup goes over memory limit

2018-06-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-6677: Assignee: Haibo Chen (was: Miklos Szegedi) > Preempt opportunistic containers when root

[jira] [Comment Edited] (YARN-8320) [Umbrella] Support CPU isolation for latency-sensitive (LS) service

2018-06-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502128#comment-16502128 ] Miklos Szegedi edited comment on YARN-8320 at 6/5/18 5:09 PM: -- Thanks

[jira] [Commented] (YARN-8320) [Umbrella] Support CPU isolation for latency-sensitive (LS) service

2018-06-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16502128#comment-16502128 ] Miklos Szegedi commented on YARN-8320: -- Thanks [~cheersyang] for the reply. bq. It's not

[jira] [Commented] (YARN-8240) Add queue-level control to allow all applications in a queue to opt-out

2018-06-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16500929#comment-16500929 ] Miklos Szegedi commented on YARN-8240: -- +1 > Add queue-level control to allow all applications in a

[jira] [Updated] (YARN-8388) TestCGroupElasticMemoryController.testNormalExit() hangs on Linux

2018-06-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8388: - Attachment: YARN-8388.002.patch > TestCGroupElasticMemoryController.testNormalExit() hangs on

[jira] [Commented] (YARN-8382) cgroup file leak in NM

2018-06-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16500615#comment-16500615 ] Miklos Szegedi commented on YARN-8382: -- Committed to trunk. Thank you for the contribution [~ziqian

[jira] [Commented] (YARN-8240) Add queue-level control to allow all applications in a queue to opt-out

2018-06-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16500587#comment-16500587 ] Miklos Szegedi commented on YARN-8240: -- Thank you, [~haibochen] for the patch. In general this looks

[jira] [Updated] (YARN-8388) TestCGroupElasticMemoryController.testNormalExit() hangs on Linux

2018-06-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8388: - Attachment: YARN-8388.001.patch > TestCGroupElasticMemoryController.testNormalExit() hangs on

[jira] [Commented] (YARN-8382) cgroup file leak in NM

2018-06-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499750#comment-16499750 ] Miklos Szegedi commented on YARN-8382: -- +1 LGTM. I will commit this, if noone has objections. >

[jira] [Updated] (YARN-8388) TestCGroupElasticMemoryController.testNormalExit() hangs on Linux

2018-06-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8388: - Attachment: YARN-8388.000.patch > TestCGroupElasticMemoryController.testNormalExit() hangs on

[jira] [Updated] (YARN-8375) TestCGroupElasticMemoryController fails surefire build

2018-05-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8375: - Attachment: YARN-8375.002.patch > TestCGroupElasticMemoryController fails surefire build >

[jira] [Commented] (YARN-8375) TestCGroupElasticMemoryController fails surefire build

2018-05-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497411#comment-16497411 ] Miklos Szegedi commented on YARN-8375: -- I updated a simple patch that runs the only verified platform

[jira] [Commented] (YARN-6677) Preempt opportunistic containers when root container cgroup goes over memory limit

2018-05-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496950#comment-16496950 ] Miklos Szegedi commented on YARN-6677: -- Thanks, for the update [~haibochen]. {code:java} 40 /**

[jira] [Commented] (YARN-8382) cgroup file leak in NM

2018-05-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496869#comment-16496869 ] Miklos Szegedi commented on YARN-8382: -- Thank you for the patch [~ziqian hu]. I think you can just

[jira] [Commented] (YARN-8375) TestCGroupElasticMemoryController fails surefire build

2018-05-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496165#comment-16496165 ] Miklos Szegedi commented on YARN-8375: -- This does not reproduce locally. This could only happen if

[jira] [Updated] (YARN-8375) TestCGroupElasticMemoryController fails surefire build

2018-05-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8375: - Attachment: YARN-8375.001.patch > TestCGroupElasticMemoryController fails surefire build >

[jira] [Commented] (YARN-8373) RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH

2018-05-30 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496085#comment-16496085 ] Miklos Szegedi commented on YARN-8373: -- This seems to be a race condition. Lots of parameters may

[jira] [Commented] (YARN-8375) TestCGroupElasticMemoryController fails surefire build

2018-05-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494684#comment-16494684 ] Miklos Szegedi commented on YARN-8375: -- Submitting a patch with timeouts to narrow down the failing

[jira] [Updated] (YARN-8375) TestCGroupElasticMemoryController fails surefire build

2018-05-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8375: - Attachment: YARN-8375.000.patch > TestCGroupElasticMemoryController fails surefire build >

[jira] [Comment Edited] (YARN-8320) [Umbrella] Support CPU isolation for latency-sensitive (LS) service

2018-05-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494656#comment-16494656 ] Miklos Szegedi edited comment on YARN-8320 at 5/30/18 4:23 AM: --- Thank you

[jira] [Commented] (YARN-8320) [Umbrella] Support CPU isolation for latency-sensitive (LS) service

2018-05-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494656#comment-16494656 ] Miklos Szegedi commented on YARN-8320: -- Thank you [~cheersyang] for the detailed response. The only

[jira] [Updated] (YARN-8373) RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH

2018-05-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8373: - Labels: newbie (was: ) > RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH >

[jira] [Commented] (YARN-8373) RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH

2018-05-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494646#comment-16494646 ] Miklos Szegedi commented on YARN-8373: -- This example samples the unallocated resource just once, so

[jira] [Commented] (YARN-8373) RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH

2018-05-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494637#comment-16494637 ] Miklos Szegedi commented on YARN-8373: -- It seems that SchedulerNode.unallocatedResource can change

[jira] [Commented] (YARN-6677) Preempt opportunistic containers when root container cgroup goes over memory limit

2018-05-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494614#comment-16494614 ] Miklos Szegedi commented on YARN-6677: -- Indeed. How about a comparator with a condition? # It would

[jira] [Commented] (YARN-8370) Some nodemanager tests fail on Windows due to improper path/file separator

2018-05-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493117#comment-16493117 ] Miklos Szegedi commented on YARN-8370: -- [~huanbang1993], thank you for raising this and providing the

  1   2   3   4   5   6   7   8   9   10   >