[jira] [Updated] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception

2017-08-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7051: - Attachment: YARN-7051.002.patch bq. so this won't be changing while createTempAppForResCalculation is loop

[jira] [Comment Edited] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception

2017-08-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16140730#comment-16140730 ] Eric Payne edited comment on YARN-7051 at 8/24/17 9:28 PM: --- Hi [~

[jira] [Commented] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception

2017-08-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16140730#comment-16140730 ] Eric Payne commented on YARN-7051: -- Hi [~sunilg]. Thanks for the review and the detailed r

[jira] [Updated] (YARN-7052) RM SchedulingMonitor gives no indication why the spawned thread crashed.

2017-08-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7052: - Attachment: YARN-7052.001.patch > RM SchedulingMonitor gives no indication why the spawned thread crashed.

[jira] [Updated] (YARN-7052) RM SchedulingMonitor gives no indication why the spawned thread crashed.

2017-08-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7052: - Target Version/s: 2.8.2 Priority: Critical (was: Major) bq. I suggest that another solution wo

[jira] [Updated] (YARN-7052) RM SchedulingMonitor gives no indication why the spawned thread crashed.

2017-08-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7052: - Description: In YARN-7051, we ran into a case where the preemption monitor thread hung with no indication

[jira] [Commented] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

2017-08-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137431#comment-16137431 ] Eric Payne commented on YARN-2127: -- The unit tests are not failing for me in my local envi

[jira] [Assigned] (YARN-7052) RM SchedulingMonitor should use HadoopExecutors when creating ScheduledExecutorService

2017-08-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-7052: Assignee: Eric Payne > RM SchedulingMonitor should use HadoopExecutors when creating > ScheduledExe

[jira] [Updated] (YARN-7052) RM SchedulingMonitor should use HadoopExecutors when creating ScheduledExecutorService

2017-08-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7052: - Description: In YARN-7051, we ran into a case where the preemption monitor thread hung with no indication

[jira] [Updated] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception

2017-08-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7051: - Attachment: YARN-7051.001.patch The YARN-7051.001.patch adds a leafqueue synchronization around the vulnera

[jira] [Assigned] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception

2017-08-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-7051: Assignee: Eric Payne > FifoIntraQueuePreemptionPlugin can get concurrent modification exception > --

[jira] [Created] (YARN-7052) RM SchedulingMonitor should use HadoopExecutors when creating ScheduledExecutorService

2017-08-18 Thread Eric Payne (JIRA)
Eric Payne created YARN-7052: Summary: RM SchedulingMonitor should use HadoopExecutors when creating ScheduledExecutorService Key: YARN-7052 URL: https://issues.apache.org/jira/browse/YARN-7052 Project: H

[jira] [Commented] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception/

2017-08-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16133631#comment-16133631 ] Eric Payne commented on YARN-7051: -- In the cross-queue preemption policy, it is synchroniz

[jira] [Updated] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception/

2017-08-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7051: - Component/s: yarn scheduler preemption capacity scheduler > FifoIntraQueu

[jira] [Created] (YARN-7051) FifoIntraQueuePreemptionPlugin can get concurrent modification exception/

2017-08-18 Thread Eric Payne (JIRA)
Eric Payne created YARN-7051: Summary: FifoIntraQueuePreemptionPlugin can get concurrent modification exception/ Key: YARN-7051 URL: https://issues.apache.org/jira/browse/YARN-7051 Project: Hadoop YARN

[jira] [Commented] (YARN-7017) Enable preemption for a single queue.

2017-08-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16133188#comment-16133188 ] Eric Payne commented on YARN-7017: -- bq. Thanks for the details. [~saruntek], do you have e

[jira] [Updated] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

2017-08-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2127: - Attachment: YARN-2127.001.patch Thanks [~ste...@apache.org]. I'm attaching a patch that subclasses {{YarnU

[jira] [Assigned] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

2017-08-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-2127: Assignee: Eric Payne > Move YarnUncaughtExceptionHandler into Hadoop common > --

[jira] [Commented] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

2017-08-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129100#comment-16129100 ] Eric Payne commented on YARN-2127: -- [~ste...@apache.org], thanks for identifying and docum

[jira] [Comment Edited] (YARN-7017) Enable preemption for a single queue.

2017-08-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16127774#comment-16127774 ] Eric Payne edited comment on YARN-7017 at 8/15/17 7:56 PM: --- Thank

[jira] [Commented] (YARN-7017) Enable preemption for a single queue.

2017-08-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16127774#comment-16127774 ] Eric Payne commented on YARN-7017: -- Thanks [~saruntek] for raising this issue. {quote} As

[jira] [Updated] (YARN-6917) Queue path is recomputed from scratch on every allocation

2017-08-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6917: - Attachment: YARN-6917.002.patch Thanks [~jlowe]. Uploading patch YARN-6917.002.patch that makes {{String q

[jira] [Updated] (YARN-6917) Queue path is recomputed from scratch on every allocation

2017-08-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6917: - Attachment: YARN-6917.001.patch The queue path is only ever set during queue initialization or reinitializ

[jira] [Assigned] (YARN-6917) Queue path is recomputed from scratch on every allocation

2017-08-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-6917: Assignee: Eric Payne > Queue path is recomputed from scratch on every allocation > -

[jira] [Commented] (YARN-5349) TestWorkPreservingRMRestart#testUAMRecoveryOnRMWorkPreservingRestart fail intermittently

2017-08-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16111413#comment-16111413 ] Eric Payne commented on YARN-5349: -- Thanks [~jlowe] for the fix. Patch LGTM. +1 Failed un

[jira] [Commented] (YARN-6846) Nodemanager can fail to fully delete application local directories when applications are killed

2017-08-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1634#comment-1634 ] Eric Payne commented on YARN-6846: -- {quote} Agreed. It's harmless to the code execution if

[jira] [Commented] (YARN-6846) Nodemanager can fail to fully delete application local directories when applications are killed

2017-08-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16110852#comment-16110852 ] Eric Payne commented on YARN-6846: -- {quote} these aren't the methods that are setting errn

[jira] [Commented] (YARN-6846) Nodemanager can fail to fully delete application local directories when applications are killed

2017-08-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16109883#comment-16109883 ] Eric Payne commented on YARN-6846: -- The patch looks good in general, but there is one thin

[jira] [Commented] (YARN-6901) A CapacityScheduler app->LeafQueue deadlock found in branch-2.8

2017-07-31 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16107522#comment-16107522 ] Eric Payne commented on YARN-6901: -- I suspect the test failure is a recurring one: YARN-59

[jira] [Commented] (YARN-6901) A CapacityScheduler app->LeafQueue deadlock found in branch-2.8

2017-07-31 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16107433#comment-16107433 ] Eric Payne commented on YARN-6901: -- [~leftnoteasy], thanks for the heads-up on this issue.

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-27 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16104294#comment-16104294 ] Eric Payne commented on YARN-5892: -- Thanks [~sunilg] for all your help on this JIRA. Were

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16100167#comment-16100167 ] Eric Payne commented on YARN-5892: -- Thanks [~sunilg] for the review. {quote} In ActiveUser

[jira] [Updated] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.branch-2.8.018.patch bq. Replaced it with {{new ConcurrentHashMap().keySet("dummy")}}

[jira] [Updated] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.branch-2.8.017.patch Uploading YARN-5892.branch-2.8.017.patch because I used {{Concu

[jira] [Updated] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.branch-2.8.016.patch I cherry-picked the trunk commit to branch-2 for this JIRA. I a

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16086287#comment-16086287 ] Eric Payne commented on YARN-5892: -- The javadoc failures are because of the naming convent

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16086090#comment-16086090 ] Eric Payne commented on YARN-2113: -- Committed the cherry-pick to branch-2. > Add cross-us

[jira] [Updated] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.branch-2.016.patch Submitting patch with cherry-pick from trunk to branch-2 so that p

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16084840#comment-16084840 ] Eric Payne commented on YARN-2113: -- The branch-2 patch seems fine. The following unit test

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: (was: YARN-2113.branch-2.0021.patch) > Add cross-user preemption within CapacityScheduler's

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.0021.patch Resubmitting patch to deal with raw type warnings. > Add cross-u

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.0021.patch Uploading patch YARN-2113.branch-2.0021.patch. This patch represe

[jira] [Updated] (YARN-5889) Improve and refactor user-limit calculation in capacity scheduler

2017-07-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5889: - Fix Version/s: 2.9.0 I cherry-picked this commit to branch-2 as a prereq for YARN-2113 > Improve and refac

[jira] [Reopened] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-2113: -- {quote} 1. Revert the commit for branch-2 YARN-2113.branch-2.0020.patch (eda4ac0) 2. Cherry pick YARN-5889 to

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083084#comment-16083084 ] Eric Payne commented on YARN-2113: -- I see. Sure, will do. > Add cross-user preemption wit

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083038#comment-16083038 ] Eric Payne commented on YARN-2113: -- bq. revert branch-2 commit for YARN-2113 and cherry-pi

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082989#comment-16082989 ] Eric Payne commented on YARN-2113: -- I should not have created a separate patch for the bra

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16080811#comment-16080811 ] Eric Payne commented on YARN-5892: -- Thanks [~sunilg] bq. YARN-3140 is something i would li

[jira] [Updated] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Fix Version/s: (was: 3.0.0-beta1) 3.0.0-alpha3 [~andrew.wang], this JIRA is already

[jira] [Comment Edited] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077246#comment-16077246 ] Eric Payne edited comment on YARN-5892 at 7/7/17 12:33 PM: --- [~sun

[jira] [Updated] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.branch-2.015.patch [~sunilg], [~leftnoteasy], [~jlowe]: Since branch-2 and 2.8 are so

[jira] [Reopened] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-5892: -- Re-opening in order to backport to branch-2 and 2.8. > Support user-specific minimum user limit percentage i

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16076807#comment-16076807 ] Eric Payne commented on YARN-2113: -- Thanks Sunil. I committed to branch 2 and 2.8. > Add

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16075317#comment-16075317 ] Eric Payne commented on YARN-2113: -- The TestRMRestart test failure looks like it's the sam

[jira] [Commented] (YARN-6759) TestRMRestart.testRMRestartWaitForPreviousAMToFinish is failing in trunk

2017-07-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16075279#comment-16075279 ] Eric Payne commented on YARN-6759: -- Please note that this is not just failing in trunk. It

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.0020.patch > Add cross-user preemption within CapacityScheduler's leaf-queue

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: (was: YARN-2113.branch-2.0020.patch) > Add cross-user preemption within CapacityScheduler's

[jira] [Reopened] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-2113: -- Reopenning so can run branch-2 pre-commit. > Add cross-user preemption within CapacityScheduler's leaf-queue

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16070130#comment-16070130 ] Eric Payne commented on YARN-2113: -- bq. Resolving this for now so I can run releasenotes g

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16070101#comment-16070101 ] Eric Payne commented on YARN-2113: -- bq. +1 on branch-2 and branch-2.7 patches. Thanks [~su

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-29 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.8.0020.patch YARN-2113.branch-2.0020.patch Thanks [~sunilg].

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-06-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062167#comment-16062167 ] Eric Payne commented on YARN-5892: -- Thanks for everything, [~sunilg]. bq. Committed to tr

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-20 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.0019.patch Hi [~sunilg] and [~leftnoteasy]. I am also attaching the branch-2

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-06-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.015.patch [~sunilg] / [~leftnoteasy] / [~jlowe], I'm loading a new patch. I forgot to

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16045063#comment-16045063 ] Eric Payne commented on YARN-6585: -- BTW, the findbugs warning for {{org.apache.hadoop.yar

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16045017#comment-16045017 ] Eric Payne commented on YARN-6585: -- Thanks [~sunilg]. The patch looks good. +1. Will commi

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037860#comment-16037860 ] Eric Payne commented on YARN-6585: -- Hi [~sunilg], I have come up with a unit test for thi

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.8.0019.patch Bad 2.8 patch. Sorry about that. Uploading a fixed on that actu

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: (was: YARN-2113.branch-2.8.0019.patch) > Add cross-user preemption within CapacityScheduler

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035315#comment-16035315 ] Eric Payne commented on YARN-6585: -- bq. In similar to GetClusterNodeLabelsResponse, it was

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16035055#comment-16035055 ] Eric Payne commented on YARN-6585: -- bq. I don't understand why we needed to add a deprecat

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16033720#comment-16033720 ] Eric Payne commented on YARN-6585: -- bq. i also had to a newInstance method in addToCluster

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16033429#comment-16033429 ] Eric Payne commented on YARN-2113: -- Hmm. Still getting the 404: {noformat} [0m[91mConnecti

[jira] [Updated] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6585: - Target Version/s: 2.8.2 (was: 2.8.1) > RM fails to start when upgrading from 2.7 to 2.8 for clusters with

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-05-31 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031352#comment-16031352 ] Eric Payne commented on YARN-5892: -- The findbugs warning was in code that was not changed

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-05-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.014.patch Uploading YARN-5892.014.patch. bq. 1) Ideally we allow atleast one contain

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-26 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16026253#comment-16026253 ] Eric Payne commented on YARN-2113: -- I don't think the docker failure was due to the branch

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.8.0019.patch [~sunilg], I took a shot at backporting YARN-2113.0019.patch to

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-05-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16025425#comment-16025425 ] Eric Payne commented on YARN-5892: -- Thank you for the reviews. bq. allUsersTimesWeights wi

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16023111#comment-16023111 ] Eric Payne commented on YARN-2113: -- bq. I might need to backport YARN-5889 first and then

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-05-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021209#comment-16021209 ] Eric Payne commented on YARN-5892: -- [~jlowe], [~leftnoteasy], [~sunilg], just checking to

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16018125#comment-16018125 ] Eric Payne commented on YARN-2113: -- The latest patch is better, but I can still cause osci

[jira] [Commented] (YARN-6618) TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once

2017-05-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017604#comment-16017604 ] Eric Payne commented on YARN-6618: -- LGTM. +1. Thanks [~jlowe]. > TestNMLeveldbStateStoreS

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16011384#comment-16011384 ] Eric Payne commented on YARN-2113: -- [~sunilg], the unit test was not failing for a couple

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16011304#comment-16011304 ] Eric Payne commented on YARN-2113: -- I'm sorry [~sunilg], but the new patch doesn't fix the

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16008658#comment-16008658 ] Eric Payne commented on YARN-2113: -- The oscillation is not related to the number of node m

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16008402#comment-16008402 ] Eric Payne commented on YARN-2113: -- Hey [~sunilg], I'm still digging into this, but this h

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16007294#comment-16007294 ] Eric Payne commented on YARN-2113: -- Hi [~sunilg]. There's something strange about the way

[jira] [Updated] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-05-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6585: - Target Version/s: 2.8.1 Priority: Blocker (was: Major) > RM fails to start when upgrading from

[jira] [Created] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-05-11 Thread Eric Payne (JIRA)
Eric Payne created YARN-6585: Summary: RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels. Key: YARN-6585 URL: https://issues.apache.org/jira/browse/YARN-6585 Project: Hadoop Y

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-05-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.013.patch Attaching patch YARN-5892.013.patch. Previous patch had a rounding error.

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003254#comment-16003254 ] Eric Payne commented on YARN-2113: -- [~sunilg] / [~leftnoteasy]. It looks like the latest p

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-05-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15998847#comment-15998847 ] Eric Payne commented on YARN-5892: -- Sorry [~sunilg]. I missed your comment. {quote} I hav

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995184#comment-15995184 ] Eric Payne commented on YARN-2113: -- [~sunilg], would you mind, please, explaining why the

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991671#comment-15991671 ] Eric Payne commented on YARN-2113: -- {quote} bq. 2) User limit first: bq. - App1 can preemp

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-05-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991126#comment-15991126 ] Eric Payne commented on YARN-2113: -- Thanks [~leftnoteasy]. {quote} 1) Priority first: - A

[jira] [Commented] (YARN-6536) TestAMRMClient.testAMRMClientWithSaslEncryption fails intermittently

2017-04-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15989401#comment-15989401 ] Eric Payne commented on YARN-6536: -- Thanks [~jlowe] +1 > TestAMRMClient.testAMRMClientWit

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-04-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15989225#comment-15989225 ] Eric Payne commented on YARN-2113: -- [~sunilg], I'm sorry to say that the latest patch (YAR

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-04-27 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.apply.onto.0012.ericp.patch Thanks [~sunilg] for the all of your work and for the upd

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-04-26 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.012.patch [~leftnoteasy] bq. updateUserWeights: Should we re-count Yes. Thanks for c

<    5   6   7   8   9   10   11   12   13   14   >