[jira] [Updated] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Fix Version/s: (was: 3.0.0-beta1) 3.0.0-alpha3 [~andrew.wang], this JIRA is already

[jira] [Updated] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.branch-2.016.patch Submitting patch with cherry-pick from trunk to branch-2 so that

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086090#comment-16086090 ] Eric Payne commented on YARN-2113: -- Committed the cherry-pick to branch-2. > Add cross-user preemption

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086287#comment-16086287 ] Eric Payne commented on YARN-5892: -- The javadoc failures are because of the naming convention of the '_'

[jira] [Updated] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.branch-2.8.017.patch Uploading YARN-5892.branch-2.8.017.patch because I used

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083038#comment-16083038 ] Eric Payne commented on YARN-2113: -- bq. revert branch-2 commit for YARN-2113 and cherry-pick

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083084#comment-16083084 ] Eric Payne commented on YARN-2113: -- I see. Sure, will do. > Add cross-user preemption within

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082989#comment-16082989 ] Eric Payne commented on YARN-2113: -- I should not have created a separate patch for the branch-2 backport.

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080811#comment-16080811 ] Eric Payne commented on YARN-5892: -- Thanks [~sunilg] bq. YARN-3140 is something i would like to see in

[jira] [Updated] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.branch-2.015.patch [~sunilg], [~leftnoteasy], [~jlowe]: Since branch-2 and 2.8 are

[jira] [Reopened] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-5892: -- Re-opening in order to backport to branch-2 and 2.8. > Support user-specific minimum user limit percentage

[jira] [Updated] (YARN-5889) Improve and refactor user-limit calculation in capacity scheduler

2017-07-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5889: - Fix Version/s: 2.9.0 I cherry-picked this commit to branch-2 as a prereq for YARN-2113 > Improve and

[jira] [Reopened] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-2113: -- {quote} 1. Revert the commit for branch-2 YARN-2113.branch-2.0020.patch (eda4ac0) 2. Cherry pick YARN-5889

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: (was: YARN-2113.branch-2.0021.patch) > Add cross-user preemption within

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.0021.patch Uploading patch YARN-2113.branch-2.0021.patch. This patch

[jira] [Updated] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.branch-2.8.018.patch bq. Replaced it with {{new

[jira] [Comment Edited] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077246#comment-16077246 ] Eric Payne edited comment on YARN-5892 at 7/7/17 12:33 PM: --- [~sunilg],

[jira] [Updated] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.branch-2.8.016.patch I cherry-picked the trunk commit to branch-2 for this JIRA. I

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100167#comment-16100167 ] Eric Payne commented on YARN-5892: -- Thanks [~sunilg] for the review. {quote} In ActiveUsersManager, could

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.0021.patch Resubmitting patch to deal with raw type warnings. > Add

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084840#comment-16084840 ] Eric Payne commented on YARN-2113: -- The branch-2 patch seems fine. The following unit tests worked in my

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-29 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.8.0020.patch YARN-2113.branch-2.0020.patch Thanks

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070130#comment-16070130 ] Eric Payne commented on YARN-2113: -- bq. Resolving this for now so I can run releasenotes generation.

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070101#comment-16070101 ] Eric Payne commented on YARN-2113: -- bq. +1 on branch-2 and branch-2.7 patches. Thanks [~sunilg]. I think

[jira] [Reopened] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-2113: -- Reopenning so can run branch-2 pre-commit. > Add cross-user preemption within CapacityScheduler's

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076807#comment-16076807 ] Eric Payne commented on YARN-2113: -- Thanks Sunil. I committed to branch 2 and 2.8. > Add cross-user

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: (was: YARN-2113.branch-2.0020.patch) > Add cross-user preemption within

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.0020.patch > Add cross-user preemption within CapacityScheduler's

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075317#comment-16075317 ] Eric Payne commented on YARN-2113: -- The TestRMRestart test failure looks like it's the same as YARN-6759.

[jira] [Commented] (YARN-6759) TestRMRestart.testRMRestartWaitForPreviousAMToFinish is failing in trunk

2017-07-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075279#comment-16075279 ] Eric Payne commented on YARN-6759: -- Please note that this is not just failing in trunk. It fails for me in

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-04-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15983699#comment-15983699 ] Eric Payne commented on YARN-2113: -- Thanks [~sunilg]. I have one more (last?) concern. Shouldn't the

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-04-26 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15985032#comment-15985032 ] Eric Payne commented on YARN-2113: -- [~sunilg], the latest patch seems to work almost as I expect. However,

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-04-26 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.012.patch [~leftnoteasy] bq. updateUserWeights: Should we re-count Yes. Thanks for

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-04-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981780#comment-15981780 ] Eric Payne commented on YARN-2113: -- [~sunilg], YARN-2113.0009.patch has a problem when

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-04-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981830#comment-15981830 ] Eric Payne commented on YARN-2113: -- [~sunilg], It looks like

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-04-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15983235#comment-15983235 ] Eric Payne commented on YARN-5892: -- I will need to upload a new patch at any rate, because the check for

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-04-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989225#comment-15989225 ] Eric Payne commented on YARN-2113: -- [~sunilg], I'm sorry to say that the latest patch

[jira] [Commented] (YARN-6536) TestAMRMClient.testAMRMClientWithSaslEncryption fails intermittently

2017-04-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989401#comment-15989401 ] Eric Payne commented on YARN-6536: -- Thanks [~jlowe] +1 > TestAMRMClient.testAMRMClientWithSaslEncryption

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-04-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981939#comment-15981939 ] Eric Payne commented on YARN-5892: -- bq. I don't understand imposing a hard limit of weight < 100/MULP.

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-04-27 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.apply.onto.0012.ericp.patch Thanks [~sunilg] for the all of your work and for the

[jira] [Commented] (YARN-6846) Nodemanager can fail to fully delete application local directories when applications are killed

2017-08-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1634#comment-1634 ] Eric Payne commented on YARN-6846: -- {quote} Agreed. It's harmless to the code execution if it does not

[jira] [Commented] (YARN-5349) TestWorkPreservingRMRestart#testUAMRecoveryOnRMWorkPreservingRestart fail intermittently

2017-08-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111413#comment-16111413 ] Eric Payne commented on YARN-5349: -- Thanks [~jlowe] for the fix. Patch LGTM. +1 Failed unit tests are not

[jira] [Updated] (YARN-6917) Queue path is recomputed from scratch on every allocation

2017-08-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6917: - Attachment: YARN-6917.001.patch The queue path is only ever set during queue initialization or

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-27 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104294#comment-16104294 ] Eric Payne commented on YARN-5892: -- Thanks [~sunilg] for all your help on this JIRA. Were you planning on

[jira] [Commented] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

2017-08-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129100#comment-16129100 ] Eric Payne commented on YARN-2127: -- [~ste...@apache.org], thanks for identifying and documenting this

[jira] [Updated] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception/

2017-08-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7051: - Component/s: yarn scheduler preemption capacity scheduler >

[jira] [Commented] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception/

2017-08-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16133631#comment-16133631 ] Eric Payne commented on YARN-7051: -- In the cross-queue preemption policy, it is synchronizing on the

[jira] [Created] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception/

2017-08-18 Thread Eric Payne (JIRA)
Eric Payne created YARN-7051: Summary: FifoIntraQueuePreemptionPlugin can get concurrent modification exception/ Key: YARN-7051 URL: https://issues.apache.org/jira/browse/YARN-7051 Project: Hadoop YARN

[jira] [Created] (YARN-7052) RM SchedulingMonitor should use HadoopExecutors when creating ScheduledExecutorService

2017-08-18 Thread Eric Payne (JIRA)
Eric Payne created YARN-7052: Summary: RM SchedulingMonitor should use HadoopExecutors when creating ScheduledExecutorService Key: YARN-7052 URL: https://issues.apache.org/jira/browse/YARN-7052 Project:

[jira] [Assigned] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception

2017-08-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-7051: Assignee: Eric Payne > FifoIntraQueuePreemptionPlugin can get concurrent modification exception >

[jira] [Updated] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception

2017-08-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7051: - Attachment: YARN-7051.001.patch The YARN-7051.001.patch adds a leafqueue synchronization around the

[jira] [Assigned] (YARN-7052) RM SchedulingMonitor should use HadoopExecutors when creating ScheduledExecutorService

2017-08-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-7052: Assignee: Eric Payne > RM SchedulingMonitor should use HadoopExecutors when creating >

[jira] [Updated] (YARN-7052) RM SchedulingMonitor should use HadoopExecutors when creating ScheduledExecutorService

2017-08-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7052: - Description: In YARN-7051, we ran into a case where the preemption monitor thread hung with no indication

[jira] [Commented] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

2017-08-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16137431#comment-16137431 ] Eric Payne commented on YARN-2127: -- The unit tests are not failing for me in my local environment.

[jira] [Updated] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

2017-08-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2127: - Attachment: YARN-2127.001.patch Thanks [~ste...@apache.org]. I'm attaching a patch that subclasses

[jira] [Assigned] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

2017-08-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-2127: Assignee: Eric Payne > Move YarnUncaughtExceptionHandler into Hadoop common >

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995184#comment-15995184 ] Eric Payne commented on YARN-2113: -- [~sunilg], would you mind, please, explaining why the check for

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-05-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.013.patch Attaching patch YARN-5892.013.patch. Previous patch had a rounding error.

[jira] [Created] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-05-11 Thread Eric Payne (JIRA)
Eric Payne created YARN-6585: Summary: RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels. Key: YARN-6585 URL: https://issues.apache.org/jira/browse/YARN-6585 Project: Hadoop

[jira] [Updated] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-05-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6585: - Target Version/s: 2.8.1 Priority: Blocker (was: Major) > RM fails to start when upgrading

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003254#comment-16003254 ] Eric Payne commented on YARN-2113: -- [~sunilg] / [~leftnoteasy]. It looks like the latest patch has all of

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011304#comment-16011304 ] Eric Payne commented on YARN-2113: -- I'm sorry [~sunilg], but the new patch doesn't fix the problem. I can

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16011384#comment-16011384 ] Eric Payne commented on YARN-2113: -- [~sunilg], the unit test was not failing for a couple of reasons.

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16008402#comment-16008402 ] Eric Payne commented on YARN-2113: -- Hey [~sunilg], I'm still digging into this, but this happens for me

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16008658#comment-16008658 ] Eric Payne commented on YARN-2113: -- The oscillation is not related to the number of node managers. Rather,

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007294#comment-16007294 ] Eric Payne commented on YARN-2113: -- Hi [~sunilg]. There's something strange about the way preemption works

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045063#comment-16045063 ] Eric Payne commented on YARN-6585: -- BTW, the findbugs warning for

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16045017#comment-16045017 ] Eric Payne commented on YARN-6585: -- Thanks [~sunilg]. The patch looks good. +1. Will commit soon. > RM

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-06-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062167#comment-16062167 ] Eric Payne commented on YARN-5892: -- Thanks for everything, [~sunilg]. bq. Committed to trunk. However it

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-20 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.0019.patch Hi [~sunilg] and [~leftnoteasy]. I am also attaching the

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-05-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021209#comment-16021209 ] Eric Payne commented on YARN-5892: -- [~jlowe], [~leftnoteasy], [~sunilg], just checking to see if you have

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023111#comment-16023111 ] Eric Payne commented on YARN-2113: -- bq. I might need to backport YARN-5889 first and then this ticket.

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-26 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026253#comment-16026253 ] Eric Payne commented on YARN-2113: -- I don't think the docker failure was due to the branch-2.8 patch:

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-05-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025425#comment-16025425 ] Eric Payne commented on YARN-5892: -- Thank you for the reviews. bq. allUsersTimesWeights will be less than

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.8.0019.patch [~sunilg], I took a shot at backporting YARN-2113.0019.patch

[jira] [Commented] (YARN-6618) TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once

2017-05-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017604#comment-16017604 ] Eric Payne commented on YARN-6618: -- LGTM. +1. Thanks [~jlowe]. >

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-05-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.014.patch Uploading YARN-5892.014.patch. bq. 1) Ideally we allow atleast one

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-05-31 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16031352#comment-16031352 ] Eric Payne commented on YARN-5892: -- The findbugs warning was in code that was not changed by this patch.

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035055#comment-16035055 ] Eric Payne commented on YARN-6585: -- bq. I don't understand why we needed to add a deprecated newInstance

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: (was: YARN-2113.branch-2.8.0019.patch) > Add cross-user preemption within

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.8.0019.patch Bad 2.8 patch. Sorry about that. Uploading a fixed on that

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035315#comment-16035315 ] Eric Payne commented on YARN-6585: -- bq. In similar to GetClusterNodeLabelsResponse, it was also support

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033720#comment-16033720 ] Eric Payne commented on YARN-6585: -- bq. i also had to a newInstance method in

[jira] [Updated] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6585: - Target Version/s: 2.8.2 (was: 2.8.1) > RM fails to start when upgrading from 2.7 to 2.8 for clusters with

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16033429#comment-16033429 ] Eric Payne commented on YARN-2113: -- Hmm. Still getting the 404: {noformat} [0m[91mConnecting to

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-06-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.015.patch [~sunilg] / [~leftnoteasy] / [~jlowe], I'm loading a new patch. I forgot

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15991126#comment-15991126 ] Eric Payne commented on YARN-2113: -- Thanks [~leftnoteasy]. {quote} 1) Priority first: - App1 can preempt

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-05-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998847#comment-15998847 ] Eric Payne commented on YARN-5892: -- Sorry [~sunilg]. I missed your comment. {quote} I have few doubts

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15991671#comment-15991671 ] Eric Payne commented on YARN-2113: -- {quote} bq. 2) User limit first: bq. - App1 can preempt app2 if:

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16018125#comment-16018125 ] Eric Payne commented on YARN-2113: -- The latest patch is better, but I can still cause oscillation when

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037860#comment-16037860 ] Eric Payne commented on YARN-6585: -- Hi [~sunilg], I have come up with a unit test for this that I think

[jira] [Updated] (YARN-7149) Cross-queue preemption sometimes starves an underserved queue

2017-09-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7149: - Attachment: YARN-7149.002.patch bq. Do you think does it make sense to merge the

[jira] [Commented] (YARN-7149) Cross-queue preemption sometimes starves an underserved queue

2017-09-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170157#comment-16170157 ] Eric Payne commented on YARN-7149: -- Thanks a lot [~leftnoteasy]. Also, this needs to be pulled back into

[jira] [Updated] (YARN-7149) Cross-queue preemption sometimes starves an underserved queue

2017-09-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7149: - Fix Version/s: 3.1.0 2.9.0 > Cross-queue preemption sometimes starves an underserved

[jira] [Updated] (YARN-7245) In Cap Sched UI, Max AM Resource column in Active Users Info section should be per-user

2017-09-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7245: - Attachment: CapSched UI Showing Inaccurate Per User Max AM Resource.png The value in the {{Max AM

[jira] [Created] (YARN-7245) In Cap Sched UI, Max AM Resource column in Active Users Info section should be per-user

2017-09-22 Thread Eric Payne (JIRA)
Eric Payne created YARN-7245: Summary: In Cap Sched UI, Max AM Resource column in Active Users Info section should be per-user Key: YARN-7245 URL: https://issues.apache.org/jira/browse/YARN-7245 Project:

[jira] [Commented] (YARN-7149) Cross-queue preemption sometimes starves an underserved queue

2017-09-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168499#comment-16168499 ] Eric Payne commented on YARN-7149: -- The following unit tests are succeeding for me in my environment:

[jira] [Commented] (YARN-7149) Cross-queue preemption sometimes starves an underserved queue

2017-09-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166286#comment-16166286 ] Eric Payne commented on YARN-7149: -- Unit test failures are not related to this patch:

[jira] [Commented] (YARN-4727) Unable to override the $HADOOP_CONF_DIR env variable for container

2017-09-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165194#comment-16165194 ] Eric Payne commented on YARN-4727: -- +1 Thanks [~jlowe] > Unable to override the $HADOOP_CONF_DIR env

[jira] [Updated] (YARN-7149) Cross-queue preemption sometimes starves an underserved queue

2017-09-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7149: - Attachment: YARN-7149.001.patch Rather than use this JIRA to revert the {{computeUserLimit}} behavior to

<    1   2   3   4   5   6   7   8   9   10   >