[jira] [Reopened] (YARN-7289) Application lifetime does not work with FairScheduler

2017-11-01 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reopened YARN-7289: -- I noticed that we override the configuration in case of capacity scheduler instead of extending it.

[jira] [Updated] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6747: - Attachment: YARN-6747.002.patch Thank you for the review, [~yufeigu]. I updated the patch. > TestF

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2017-10-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.007.patch > Use cgroup to get container resource utilization > --

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2017-10-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: (was: YARN-7064.006.patch) > Use cgroup to get container resource utilization > ---

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2017-10-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.006.patch I did a rebase because there were some conflicts. > Use cgroup to

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-10-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16222740#comment-16222740 ] Miklos Szegedi commented on YARN-1015: -- Thank you for the patch [~haibochen]. {code} 2

[jira] [Commented] (YARN-7289) Application lifetime does not work with FairScheduler

2017-10-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16222658#comment-16222658 ] Miklos Szegedi commented on YARN-7289: -- The ASF license issues are unrelated to the pa

[jira] [Updated] (YARN-7336) Unsafe cast from long to int Resource.hashCode() method

2017-10-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7336: - Attachment: YARN-7336.001.patch Thank you, [~templedf] for the review. I updated the patch. > Unsa

[jira] [Updated] (YARN-7289) Application lifetime does not work with FairScheduler

2017-10-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7289: - Attachment: YARN-7289.005.patch > Application lifetime does not work with FairScheduler > -

[jira] [Commented] (YARN-7289) Application lifetime does not work with FairScheduler

2017-10-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16220744#comment-16220744 ] Miklos Szegedi commented on YARN-7289: -- [~rohithsharma], I was not off yesterday. Than

[jira] [Commented] (YARN-7289) Application lifetime does not work with FairScheduler

2017-10-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219807#comment-16219807 ] Miklos Szegedi commented on YARN-7289: -- [~rohithsharma], thank you for the patch. Woul

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2017-10-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.005.patch > Use cgroup to get container resource utilization > --

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2017-10-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16219785#comment-16219785 ] Miklos Szegedi commented on YARN-7064: -- Thank you, [~haibochen] for the review. I chan

[jira] [Updated] (YARN-7336) Unsafe cast from long to int Resource.hashCode() method

2017-10-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7336: - Attachment: YARN-7336.000.patch > Unsafe cast from long to int Resource.hashCode() method > ---

[jira] [Commented] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16217685#comment-16217685 ] Miklos Szegedi commented on YARN-7289: -- The issues are YARN-6747, YARN-7385, YARN-7385

[jira] [Created] (YARN-7387) org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently

2017-10-24 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7387: Summary: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently Key: YARN-7387 URL: https://issues.apache.org/jira/br

[jira] [Comment Edited] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16217577#comment-16217577 ] Miklos Szegedi edited comment on YARN-6747 at 10/24/17 8:36 PM: -

[jira] [Commented] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16217577#comment-16217577 ] Miklos Szegedi commented on YARN-6747: -- The first and second issues are YARN-7385. >

[jira] [Commented] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16215960#comment-16215960 ] Miklos Szegedi commented on YARN-7289: -- I was looking at the test failures. Most of th

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16215729#comment-16215729 ] Miklos Szegedi commented on YARN-4511: -- [~leftnoteasy], [~asuresh], do you have any mo

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16215566#comment-16215566 ] Miklos Szegedi commented on YARN-4511: -- Thank you, [~haibochen] for the patch. {code}

[jira] [Commented] (YARN-6757) Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

2017-10-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16215456#comment-16215456 ] Miklos Szegedi commented on YARN-6757: -- Yes, we can modify the type. > Refactor the u

[jira] [Commented] (YARN-7373) The atomicity of container update in RM is not clear

2017-10-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16215406#comment-16215406 ] Miklos Szegedi commented on YARN-7373: -- Thank you, [~asuresh]. Yes, I agree, since we

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16212848#comment-16212848 ] Miklos Szegedi commented on YARN-4511: -- Thank you, [~haibochen] for the patch. {code}

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211480#comment-16211480 ] Miklos Szegedi commented on YARN-4511: -- Thank you, [~haibochen] for the patch. I have

[jira] [Commented] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211407#comment-16211407 ] Miklos Szegedi commented on YARN-7289: -- Thank you, [~rohithsharma] and [~templedf] for

[jira] [Updated] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7289: - Attachment: YARN-7289.003.patch > TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor tim

[jira] [Updated] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6747: - Attachment: YARN-6747.001.patch Thank you, [~templedf]. I tried to be even more specific and update

[jira] [Updated] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7289: - Attachment: YARN-7289.002.patch > TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor tim

[jira] [Commented] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16210088#comment-16210088 ] Miklos Szegedi commented on YARN-7289: -- Thank you for reviewing the patch. Fair schedu

[jira] [Created] (YARN-7354) Fair scheduler should support application lifetime monitor

2017-10-18 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7354: Summary: Fair scheduler should support application lifetime monitor Key: YARN-7354 URL: https://issues.apache.org/jira/browse/YARN-7354 Project: Hadoop YARN

[jira] [Updated] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7289: - Attachment: YARN-7289.001.patch > TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor tim

[jira] [Commented] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16209960#comment-16209960 ] Miklos Szegedi commented on YARN-7289: -- Indeed, I did some more debugging. The issue w

[jira] [Created] (YARN-7350) TestSignalContainer should check both FS and CS

2017-10-17 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7350: Summary: TestSignalContainer should check both FS and CS Key: YARN-7350 URL: https://issues.apache.org/jira/browse/YARN-7350 Project: Hadoop YARN Issue Type:

[jira] [Comment Edited] (YARN-7294) TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair scheduler

2017-10-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16208438#comment-16208438 ] Miklos Szegedi edited comment on YARN-7294 at 10/17/17 9:41 PM: -

[jira] [Created] (YARN-7349) TestSignalContainer.testSignalRequestDeliveryToNM fails with attempt state is not correct

2017-10-17 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7349: Summary: TestSignalContainer.testSignalRequestDeliveryToNM fails with attempt state is not correct Key: YARN-7349 URL: https://issues.apache.org/jira/browse/YARN-7349

[jira] [Comment Edited] (YARN-7294) TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair scheduler

2017-10-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16208438#comment-16208438 ] Miklos Szegedi edited comment on YARN-7294 at 10/17/17 9:39 PM: -

[jira] [Commented] (YARN-7294) TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair scheduler

2017-10-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16208438#comment-16208438 ] Miklos Szegedi commented on YARN-7294: -- Thank you, [~yufeigu] for the review. Yes, tha

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2017-10-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16206455#comment-16206455 ] Miklos Szegedi commented on YARN-5764: -- Thank you for the patch, [~devaraj.k]. {{yarn.

[jira] [Commented] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-10-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16206295#comment-16206295 ] Miklos Szegedi commented on YARN-6384: -- Thank you for the patch [~lolee_k], DEFAULT_NM

[jira] [Commented] (YARN-6546) SLS is slow while loading 10k queues

2017-10-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16206260#comment-16206260 ] Miklos Szegedi commented on YARN-6546: -- Thank you for the patch [~yufeigu]. {code} 245

[jira] [Resolved] (YARN-4943) Add support to collect actual resource usage from cgroups

2017-10-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi resolved YARN-4943. -- Resolution: Duplicate > Add support to collect actual resource usage from cgroups > -

[jira] [Commented] (YARN-4943) Add support to collect actual resource usage from cgroups

2017-10-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16202875#comment-16202875 ] Miklos Szegedi commented on YARN-4943: -- [~vvasudev], YARN-6668 is very similar to this

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

2017-10-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16202192#comment-16202192 ] Miklos Szegedi commented on YARN-6668: -- Indeed this is a duplicate. How should we coor

[jira] [Commented] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-10-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16197265#comment-16197265 ] Miklos Szegedi commented on YARN-6384: -- My opinion is that the distinction between str

[jira] [Updated] (YARN-7294) TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair scheduler

2017-10-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7294: - Attachment: YARN-7294.000.patch > TestSignalContainer#testSignalRequestDeliveryToNM fails intermitt

[jira] [Created] (YARN-7294) TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair scheduler

2017-10-06 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7294: Summary: TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair scheduler Key: YARN-7294 URL: https://issues.apache.org/jira/browse/YARN-7294

[jira] [Updated] (YARN-7293) ContainerLaunch.cleanupContainer may miss a starting container

2017-10-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7293: - Description: The relevant part of YARN-7009 needs to be backported to branch-2 (was: The relevant

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-10-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193970#comment-16193970 ] Miklos Szegedi commented on YARN-7009: -- Thank you, [~haibochen]. I opened YARN-7293 fo

[jira] [Created] (YARN-7293) ContainerLaunch.cleanupContainer may miss a starting node

2017-10-05 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7293: Summary: ContainerLaunch.cleanupContainer may miss a starting node Key: YARN-7293 URL: https://issues.apache.org/jira/browse/YARN-7293 Project: Hadoop YARN I

[jira] [Updated] (YARN-7293) ContainerLaunch.cleanupContainer may miss a starting container

2017-10-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7293: - Summary: ContainerLaunch.cleanupContainer may miss a starting container (was: ContainerLaunch.clea

[jira] [Commented] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193382#comment-16193382 ] Miklos Szegedi commented on YARN-7289: -- It finished in about 40 seconds to me. That su

[jira] [Comment Edited] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16191993#comment-16191993 ] Miklos Szegedi edited comment on YARN-7289 at 10/4/17 8:35 PM: --

[jira] [Comment Edited] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16191993#comment-16191993 ] Miklos Szegedi edited comment on YARN-7289 at 10/4/17 8:33 PM: --

[jira] [Commented] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16191993#comment-16191993 ] Miklos Szegedi commented on YARN-7289: -- The other issues should be unrelated. This is

[jira] [Comment Edited] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16191988#comment-16191988 ] Miklos Szegedi edited comment on YARN-6747 at 10/4/17 8:29 PM: --

[jira] [Commented] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16191988#comment-16191988 ] Miklos Szegedi commented on YARN-6747: -- Both unit test issues are timeouts: {code} org

[jira] [Updated] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7289: - Attachment: YARN-7289.000.patch > TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor tim

[jira] [Created] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-04 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7289: Summary: TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out Key: YARN-7289 URL: https://issues.apache.org/jira/browse/YARN-7289 Project: Hadoop Y

[jira] [Updated] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6747: - Attachment: YARN-6747.000.patch > TestFSAppStarvation.testPreemptionEnable fails intermittently > -

[jira] [Commented] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16191558#comment-16191558 ] Miklos Szegedi commented on YARN-6747: -- I was able to reproduce this. It happens becau

[jira] [Assigned] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-04 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-6747: Assignee: Miklos Szegedi > TestFSAppStarvation.testPreemptionEnable fails intermittently > -

[jira] [Commented] (YARN-7001) If shared cache upload is terminated in the middle, the temp file will never be deleted

2017-09-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16186756#comment-16186756 ] Miklos Szegedi commented on YARN-7001: -- [~ctrezzo], would you like to review this jira

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2017-09-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16186681#comment-16186681 ] Miklos Szegedi commented on YARN-4599: -- [~sandflee], do you plan to continue working o

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184415#comment-16184415 ] Miklos Szegedi commented on YARN-6623: -- If the decision is to ignore this bug for beta

[jira] [Updated] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7009: - Attachment: YARN-7009.007.patch > TestNMClient.testNMClientNoCleanupOnStop is flaky by design > ---

[jira] [Updated] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-27 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7009: - Attachment: YARN-7009.006.patch > TestNMClient.testNMClientNoCleanupOnStop is flaky by design > ---

[jira] [Commented] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-09-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16179775#comment-16179775 ] Miklos Szegedi commented on YARN-1014: -- Thank you for the patch [~haibochen]. I have a

[jira] [Comment Edited] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16176865#comment-16176865 ] Miklos Szegedi edited comment on YARN-7009 at 9/22/17 6:20 PM: --

[jira] [Updated] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7009: - Attachment: YARN-7009.005.patch Thank you for the review [~haibochen] and [~templedf]. I updated th

[jira] [Commented] (YARN-6968) Hardcoded absolute pathname in DockerLinuxContainerRuntime

2017-09-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16175360#comment-16175360 ] Miklos Szegedi commented on YARN-6968: -- Thank you, [~ebadger] and [~jlowe] for working

[jira] [Updated] (YARN-7239) Possible launch/cleanup race condition in ContainersLauncher

2017-09-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7239: - Description: ContainersLauncher.handle() submits the launch job and then adds the job into the col

[jira] [Updated] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7009: - Attachment: YARN-7009.004.patch Thank you, [~asuresh] for the review. I updated the patch. In gener

[jira] [Created] (YARN-7239) Possible launch/cleanup race condition in ContainersLauncher

2017-09-21 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7239: Summary: Possible launch/cleanup race condition in ContainersLauncher Key: YARN-7239 URL: https://issues.apache.org/jira/browse/YARN-7239 Project: Hadoop YARN

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16175249#comment-16175249 ] Miklos Szegedi commented on YARN-6623: -- Indeed, I verified and we still need the strle

[jira] [Commented] (YARN-6546) SLS is slow while loading 10k queues

2017-09-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16175225#comment-16175225 ] Miklos Szegedi commented on YARN-6546: -- Thank you for the patch [~yufeigu]. If I under

[jira] [Created] (YARN-7233) Make the cgroup mount into Docker containers configurable

2017-09-20 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7233: Summary: Make the cgroup mount into Docker containers configurable Key: YARN-7233 URL: https://issues.apache.org/jira/browse/YARN-7233 Project: Hadoop YARN I

[jira] [Created] (YARN-7232) Consider /sys/fs/cgroup as the default CGroup mount path

2017-09-20 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7232: Summary: Consider /sys/fs/cgroup as the default CGroup mount path Key: YARN-7232 URL: https://issues.apache.org/jira/browse/YARN-7232 Project: Hadoop YARN Is

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16173952#comment-16173952 ] Miklos Szegedi commented on YARN-6623: -- [~vvasudev], thank you for the updated patch.

[jira] [Commented] (YARN-6968) Hardcoded absolute pathname in DockerLinuxContainerRuntime

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16173925#comment-16173925 ] Miklos Szegedi commented on YARN-6968: -- Ah I see. Yes it also sounds too general How a

[jira] [Updated] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7009: - Attachment: YARN-7009.003.patch Submitting new patch. > TestNMClient.testNMClientNoCleanupOnStop i

[jira] [Commented] (YARN-6968) Hardcoded absolute pathname in DockerLinuxContainerRuntime

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16173898#comment-16173898 ] Miklos Szegedi commented on YARN-6968: -- Thank you, [~ebadger] for the patch and [~jlow

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16173858#comment-16173858 ] Miklos Szegedi commented on YARN-7009: -- Thank you for the review and comments, [~asure

[jira] [Commented] (YARN-6968) Hard coded reference to an absolute pathname in org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.runtime.DockerLinuxContainerRuntime.launchContainer(Cont

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16173635#comment-16173635 ] Miklos Szegedi commented on YARN-6968: -- Thank you, [~ebadger]. bq. In this JIRA we jus

[jira] [Commented] (YARN-6943) Update Yarn to YARN in documentation

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16173433#comment-16173433 ] Miklos Szegedi commented on YARN-6943: -- +1 (non-binding) It looks good to me. Thank yo

[jira] [Commented] (YARN-6968) Hard coded reference to an absolute pathname in org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.runtime.DockerLinuxContainerRuntime.launchContainer(Cont

2017-09-20 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16173337#comment-16173337 ] Miklos Szegedi commented on YARN-6968: -- Thank you, [~ebadger] for working on this and

[jira] [Commented] (YARN-6943) Update Yarn to YARN in documentation

2017-09-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172106#comment-16172106 ] Miklos Szegedi commented on YARN-6943: -- Thank you for signing up. I assigned it to you

[jira] [Assigned] (YARN-6943) Update Yarn to YARN in documentation

2017-09-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-6943: Assignee: Chetna Chaudhari > Update Yarn to YARN in documentation >

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-09-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172102#comment-16172102 ] Miklos Szegedi commented on YARN-5534: -- Thank you, [~eyang] for sharing your thoughts.

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172087#comment-16172087 ] Miklos Szegedi commented on YARN-7034: -- [~shaneku...@gmail.com], do you have any other

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172086#comment-16172086 ] Miklos Szegedi commented on YARN-7034: -- The unit test is a flaky one. See YARN-7145 Id

[jira] [Commented] (YARN-7001) If shared cache upload is terminated in the middle, the temp file will never be deleted

2017-09-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172026#comment-16172026 ] Miklos Szegedi commented on YARN-7001: -- Thank you, [~Sen Zhao] for the patch. Could yo

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-09-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16170610#comment-16170610 ] Miklos Szegedi commented on YARN-5534: -- Thank you, [~eyang] for the comment. Can you p

[jira] [Comment Edited] (YARN-5534) Allow whitelisted volume mounts

2017-09-18 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168728#comment-16168728 ] Miklos Szegedi edited comment on YARN-5534 at 9/18/17 7:25 PM: --

[jira] [Commented] (YARN-7207) Cache the local host name when getting application list in RM

2017-09-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168732#comment-16168732 ] Miklos Szegedi commented on YARN-7207: -- Thank you [~yufeigu] for reporting this. Pleas

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-09-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168728#comment-16168728 ] Miklos Szegedi commented on YARN-5534: -- [~eyang] I would approach this from the user p

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168403#comment-16168403 ] Miklos Szegedi commented on YARN-7192: -- +1 (non-binding) Thank you [~asuresh], the lat

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168238#comment-16168238 ] Miklos Szegedi commented on YARN-7192: -- Thank you [~asuresh] for the updated patch. bq

[jira] [Updated] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7034: - Attachment: YARN-7034.006.patch YARN-7034.branch-2.006.patch YARN-70

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-15 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168180#comment-16168180 ] Miklos Szegedi commented on YARN-7034: -- Thank you, [~shaneku...@gmail.com] for the rev

<    1   2   3   4   5   6   7   8   9   10   >