[jira] [Updated] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4805: --- Attachment: yarn-4805-1.patch > Don't go through all schedulers in ParameterizedTestBase >

[jira] [Updated] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4805: --- Attachment: (was: yarn-4805-1.patch) > Don't go through all schedulers in ParameterizedTest

[jira] [Created] (YARN-4806) Don't run TestZKRMStateStorePerf as part of the regular unittests

Karthik Kambatla created YARN-4806: -- Summary: Don't run TestZKRMStateStorePerf as part of the regular unittests Key: YARN-4806 URL: https://issues.apache.org/jira/browse/YARN-4806 Project: Hadoop YAR

[jira] [Updated] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4805: --- Attachment: yarn-4805-1.patch > Don't go through all schedulers in ParameterizedTestBase >

[jira] [Updated] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4805: --- Summary: Don't go through all schedulers in ParameterizedTestBase (was: Don't through all sche

[jira] [Created] (YARN-4805) Don't through all schedulers in ParameterizedTestBase

Karthik Kambatla created YARN-4805: -- Summary: Don't through all schedulers in ParameterizedTestBase Key: YARN-4805 URL: https://issues.apache.org/jira/browse/YARN-4805 Project: Hadoop YARN I

[jira] [Created] (YARN-4804) [Umbrella] Improve test run duration

Karthik Kambatla created YARN-4804: -- Summary: [Umbrella] Improve test run duration Key: YARN-4804 URL: https://issues.apache.org/jira/browse/YARN-4804 Project: Hadoop YARN Issue Type: Improv

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-7.patch Patch to fix the javac warning. The checkstyle warnings are innoc

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-6.patch > Add a helper library to maintain node state and allows common q

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191596#comment-15191596 ] Karthik Kambatla commented on YARN-4719: bq. Can we make ClusterNodeTracker an inte

[jira] [Updated] (YARN-4784) fair scheduler: defaultQueueSchedulingPolicy should not accept fifo as a value

[ https://issues.apache.org/jira/browse/YARN-4784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4784: --- Fix Version/s: (was: 2.9.0) > fair scheduler: defaultQueueSchedulingPolicy should not accep

[jira] [Updated] (YARN-4784) fair scheduler: defaultQueueSchedulingPolicy should not accept fifo as a value

[ https://issues.apache.org/jira/browse/YARN-4784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4784: --- Component/s: (was: yarn) > fair scheduler: defaultQueueSchedulingPolicy should not accept f

[jira] [Commented] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191556#comment-15191556 ] Karthik Kambatla commented on YARN-3054: Also, the approach being proposed on YARN-

[jira] [Commented] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191554#comment-15191554 ] Karthik Kambatla commented on YARN-3054: Also, the approach being proposed on YARN-

[jira] [Updated] (YARN-4792) FairScheduler should do sanity checks on its configuration

[ https://issues.apache.org/jira/browse/YARN-4792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4792: --- Component/s: (was: yarn) > FairScheduler should do sanity checks on its configuration > ---

[jira] [Resolved] (YARN-1961) Fair scheduler preemption doesn't work for non-leaf queues

[ https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-1961. Resolution: Won't Fix Closing this as "Won't Fix". Please reopen if there is a good reason to

[jira] [Commented] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191538#comment-15191538 ] Karthik Kambatla commented on YARN-3054: Thanks [~peng.zhang]. I understand it now.

[jira] [Commented] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190344#comment-15190344 ] Karthik Kambatla commented on YARN-3933: The patch fails to apply. [~guoshiwei] - m

[jira] [Updated] (YARN-4089) Race condition when calling AbstractYarnScheduler.completedContainer.

[ https://issues.apache.org/jira/browse/YARN-4089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4089: --- Component/s: (was: resourcemanager) fairscheduler > Race condition when ca

[jira] [Updated] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3933: --- Component/s: (was: resourcemanager) fairscheduler > Race condition when ca

[jira] [Commented] (YARN-4090) Make Collections.sort() more efficient in FSParentQueue.java

[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15189707#comment-15189707 ] Karthik Kambatla commented on YARN-4090: Is this a duplicate of YARN-1297? > Make

[jira] [Commented] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15189698#comment-15189698 ] Karthik Kambatla commented on YARN-4752: Yes, my current intent is to split schedul

[jira] [Commented] (YARN-4120) FSAppAttempt.getResourceUsage() should not take preemptedResource into account

[ https://issues.apache.org/jira/browse/YARN-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15189695#comment-15189695 ] Karthik Kambatla commented on YARN-4120: [~xinxianyin] - splitting out getResourceU

[jira] [Updated] (YARN-4661) Per-queue preemption policy in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4661: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4752) > Per-queue preemption po

[jira] [Updated] (YARN-3903) Disable preemption at Queue level for Fair Scheduler

[ https://issues.apache.org/jira/browse/YARN-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3903: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4752) > Disable preemption at Q

[jira] [Commented] (YARN-4661) Per-queue preemption policy in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186519#comment-15186519 ] Karthik Kambatla commented on YARN-4661: Interesting thought. In the context of YAR

[jira] [Commented] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186463#comment-15186463 ] Karthik Kambatla commented on YARN-3054: [~peng.zhang] - the problem reported is no

[jira] [Updated] (YARN-4134) FairScheduler preemption stops at queue level that all child queues are not over their fairshare

[ https://issues.apache.org/jira/browse/YARN-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4134: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4752) > FairScheduler preemptio

[jira] [Updated] (YARN-3414) FairScheduler's preemption may cause livelock

[ https://issues.apache.org/jira/browse/YARN-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3414: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4752) > FairScheduler's preempt

[jira] [Resolved] (YARN-3414) FairScheduler's preemption may cause livelock

[ https://issues.apache.org/jira/browse/YARN-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-3414. Resolution: Duplicate > FairScheduler's preemption may cause livelock > -

[jira] [Commented] (YARN-1961) Fair scheduler preemption doesn't work for non-leaf queues

[ https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186273#comment-15186273 ] Karthik Kambatla commented on YARN-1961: Configuring minResources and minshare pree

[jira] [Updated] (YARN-1961) Fair scheduler preemption doesn't work for non-leaf queues

[ https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1961: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4752) > Fair scheduler preempti

[jira] [Updated] (YARN-4333) Fair scheduler should support preemption within a leaf queue

[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4333: --- Summary: Fair scheduler should support preemption within a leaf queue (was: Fair scheduler sho

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-5.patch v5 patch addresses javac and checkstyle warnings. > Add a helpe

[jira] [Resolved] (YARN-1772) Fair Scheduler documentation should indicate that admin ACLs also give submit permissions

[ https://issues.apache.org/jira/browse/YARN-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-1772. Resolution: Not A Problem > Fair Scheduler documentation should indicate that admin ACLs also

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-4.patch > Add a helper library to maintain node state and allows common q

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: (was: yarn-4719-4.patch) > Add a helper library to maintain node state and allo

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-4.patch > Add a helper library to maintain node state and allows common q

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: (was: yarn-4719-4.patch) > Add a helper library to maintain node state and allo

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-4.patch Patch that uses NodeFilter to keep non-node-tracking logic out of

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15183328#comment-15183328 ] Karthik Kambatla commented on YARN-4719: Oh, and when the NodeFilter is null or an

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15183324#comment-15183324 ] Karthik Kambatla commented on YARN-4719: bq. I may not understand about this, could

[jira] [Commented] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15182438#comment-15182438 ] Karthik Kambatla commented on YARN-4752: Update: Started looking at each of the sub

[jira] [Resolved] (YARN-4134) FairScheduler preemption stops at queue level that all child queues are not over their fairshare

[ https://issues.apache.org/jira/browse/YARN-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-4134. Resolution: Duplicate [~xinxianyin] - thanks for reporting and working on this. As you say, t

[jira] [Commented] (YARN-3997) An Application requesting multiple core containers can't preempt running application made of single core containers

[ https://issues.apache.org/jira/browse/YARN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180328#comment-15180328 ] Karthik Kambatla commented on YARN-3997: Sorry for the delay in following up on thi

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15176644#comment-15176644 ] Karthik Kambatla commented on YARN-4719: [~leftnoteasy] - thanks for chiming in, yo

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15176248#comment-15176248 ] Karthik Kambatla commented on YARN-4719: [~rkanter] - this code touches the adaptiv

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-3.patch Updated patch should fix the test failures and findbugs warnings.

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: (was: yarn-4719-3.patch) > Add a helper library to maintain node state and allo

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-3.patch > Add a helper library to maintain node state and allows common q

[jira] [Updated] (YARN-3903) Disable preemption at Queue level for Fair Scheduler

[ https://issues.apache.org/jira/browse/YARN-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3903: --- Issue Type: Sub-task (was: Improvement) Parent: YARN-4752 > Disable preemption at Queu

[jira] [Updated] (YARN-4661) Per-queue preemption policy in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4661: --- Issue Type: Sub-task (was: Wish) Parent: YARN-4752 > Per-queue preemption policy in Fa

[jira] [Updated] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3054: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > Preempt policy in FairScheduler ma

[jira] [Updated] (YARN-3414) FairScheduler's preemption may cause livelock

[ https://issues.apache.org/jira/browse/YARN-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3414: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > FairScheduler's preemption may cau

[jira] [Updated] (YARN-3121) FairScheduler preemption metrics

[ https://issues.apache.org/jira/browse/YARN-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3121: --- Issue Type: Sub-task (was: Improvement) Parent: YARN-4752 > FairScheduler preemption m

[jira] [Updated] (YARN-1961) Fair scheduler preemption doesn't work for non-leaf queues

[ https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1961: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > Fair scheduler preemption doesn't

[jira] [Updated] (YARN-4133) Containers to be preempted leak in FairScheduler preemption logic.

[ https://issues.apache.org/jira/browse/YARN-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4133: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > Containers to be preempted leak in

[jira] [Updated] (YARN-3902) Fair scheduler preempts ApplicationMaster

[ https://issues.apache.org/jira/browse/YARN-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3902: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > Fair scheduler preempts Applicatio

[jira] [Updated] (YARN-4134) FairScheduler preemption stops at queue level that all child queues are not over their fairshare

[ https://issues.apache.org/jira/browse/YARN-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4134: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > FairScheduler preemption stops at

[jira] [Updated] (YARN-4120) FSAppAttempt.getResourceUsage() should not take preemptedResource into account

[ https://issues.apache.org/jira/browse/YARN-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4120: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > FSAppAttempt.getResourceUsage() sh

[jira] [Updated] (YARN-2154) FairScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

[ https://issues.apache.org/jira/browse/YARN-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2154: --- Issue Type: Sub-task (was: Improvement) Parent: YARN-4752 > FairScheduler: Improve pre

[jira] [Updated] (YARN-4333) Fair scheduler should support preemption within queue

[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4333: --- Issue Type: Sub-task (was: Improvement) Parent: YARN-4752 > Fair scheduler should supp

[jira] [Updated] (YARN-3405) FairScheduler's preemption cannot happen between sibling in some case

[ https://issues.apache.org/jira/browse/YARN-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3405: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > FairScheduler's preemption cannot

[jira] [Created] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

Karthik Kambatla created YARN-4752: -- Summary: [Umbrella] FairScheduler: Improve preemption Key: YARN-4752 URL: https://issues.apache.org/jira/browse/YARN-4752 Project: Hadoop YARN Issue Type

[jira] [Updated] (YARN-3997) An Application requesting multiple core containers can't preempt running application made of single core containers

[ https://issues.apache.org/jira/browse/YARN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3997: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > An Application requesting multiple

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15174594#comment-15174594 ] Karthik Kambatla commented on YARN-4719: bq. For ClusterNodeTracker#nodes, can we u

[jira] [Commented] (YARN-4743) ResourceManager crash because TimSort

[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15173162#comment-15173162 ] Karthik Kambatla commented on YARN-4743: [~gzh1992n] - thanks for reporting and wor

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15173137#comment-15173137 ] Karthik Kambatla commented on YARN-4719: bq. May also be useful to expose functiona

[jira] [Commented] (YARN-4704) TestResourceManager#testResourceAllocation() fails when using FairScheduler

[ https://issues.apache.org/jira/browse/YARN-4704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15172933#comment-15172933 ] Karthik Kambatla commented on YARN-4704: Verified the patch fixes the test with Fai

[jira] [Commented] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171392#comment-15171392 ] Karthik Kambatla commented on YARN-4718: I made some progress on YARN-4719, and fee

[jira] [Updated] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4511: --- Summary: Common scheduler changes supporting scheduler-specific implementations (was: Create c

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-2.patch Ran *Scheduler* tests locally. Fixed most failures. Ran into a co

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-1.patch First patch. It removes redundancy across schedulers. Kicking off

[jira] [Resolved] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-4718. Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Thanks for picking

[jira] [Commented] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171117#comment-15171117 ] Karthik Kambatla commented on YARN-4718: Those test failures are unrelated, and hav

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171114#comment-15171114 ] Karthik Kambatla commented on YARN-1011: bq. So we are going to add promotion notif

[jira] [Updated] (YARN-4743) ResourceManager crash because TimSort

[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4743: --- Component/s: (was: resourcemanager) fairscheduler > ResourceManager crash

[jira] [Updated] (YARN-4741) RM is flooded with RMNodeFinishedContainersPulledByAMEvents in the async dispatcher event queue

[ https://issues.apache.org/jira/browse/YARN-4741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4741: --- Priority: Critical (was: Major) > RM is flooded with RMNodeFinishedContainersPulledByAMEvents

[jira] [Commented] (YARN-4735) Remove stale LogAggregationReport from NM's context

[ https://issues.apache.org/jira/browse/YARN-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15166778#comment-15166778 ] Karthik Kambatla commented on YARN-4735: We have seen this issue as well. > Remov

[jira] [Commented] (YARN-4730) YARN preemption based on instantaneous fair share

[ https://issues.apache.org/jira/browse/YARN-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15163873#comment-15163873 ] Karthik Kambatla commented on YARN-4730: IIRR, FairScheduler preemption is based on

[jira] [Updated] (YARN-4730) YARN preemption based on instantaneous fair share

[ https://issues.apache.org/jira/browse/YARN-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4730: --- Component/s: fairscheduler > YARN preemption based on instantaneous fair share > --

[jira] [Commented] (YARN-4729) SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE

[ https://issues.apache.org/jira/browse/YARN-4729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15163860#comment-15163860 ] Karthik Kambatla commented on YARN-4729: Test failures are not related. > Schedul

[jira] [Created] (YARN-4732) *ProcessTree classes have too many whitespace issues

Karthik Kambatla created YARN-4732: -- Summary: *ProcessTree classes have too many whitespace issues Key: YARN-4732 URL: https://issues.apache.org/jira/browse/YARN-4732 Project: Hadoop YARN Is

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15163573#comment-15163573 ] Karthik Kambatla commented on YARN-3304: [~djp] - did we ever file follow up JIRAs

[jira] [Updated] (YARN-4729) SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE

[ https://issues.apache.org/jira/browse/YARN-4729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4729: --- Attachment: yarn-4729.patch Straight-forward patch. > SchedulerApplicationAttempt#getTotalReq

[jira] [Created] (YARN-4729) SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE

Karthik Kambatla created YARN-4729: -- Summary: SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE Key: YARN-4729 URL: https://issues.apache.org/jira/browse/YARN-4729 Project: Hadoo

[jira] [Commented] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157873#comment-15157873 ] Karthik Kambatla commented on YARN-4718: The webapp changes are user-facing, don't

[jira] [Commented] (YARN-4511) Create common scheduling policy for resource over-subscription

[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157257#comment-15157257 ] Karthik Kambatla commented on YARN-4511: As discussed on YARN-1011, things we might

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157253#comment-15157253 ] Karthik Kambatla commented on YARN-1011: [~elgoiri] - for work that we want to get

[jira] [Created] (YARN-4719) Add a helper library to maintain node state and allows common queries

Karthik Kambatla created YARN-4719: -- Summary: Add a helper library to maintain node state and allows common queries Key: YARN-4719 URL: https://issues.apache.org/jira/browse/YARN-4719 Project: Hadoop

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157248#comment-15157248 ] Karthik Kambatla commented on YARN-1011: bq. Could you clarify 2.2? What would trig

[jira] [Commented] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157233#comment-15157233 ] Karthik Kambatla commented on YARN-4718: I was thinking of the following variable r

[jira] [Created] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

Karthik Kambatla created YARN-4718: -- Summary: Rename variables in SchedulerNode to reduce ambiguity post YARN-1011 Key: YARN-4718 URL: https://issues.apache.org/jira/browse/YARN-4718 Project: Hadoop

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15155792#comment-15155792 ] Karthik Kambatla commented on YARN-1011: Looked more closely into how we would impl

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15155692#comment-15155692 ] Karthik Kambatla commented on YARN-1011: Had offline discussions with [~jlowe], [~n

[jira] [Created] (YARN-4702) FairScheduler: Allow setting maxResources for ad hoc queues

Karthik Kambatla created YARN-4702: -- Summary: FairScheduler: Allow setting maxResources for ad hoc queues Key: YARN-4702 URL: https://issues.apache.org/jira/browse/YARN-4702 Project: Hadoop YARN

[jira] [Commented] (YARN-4569) Remove incorrect part of maxResources in FairScheduler documentation

[ https://issues.apache.org/jira/browse/YARN-4569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15151617#comment-15151617 ] Karthik Kambatla commented on YARN-4569: +1. Checking this in. > Remove incorrect

[jira] [Comment Edited] (YARN-4333) Fair scheduler should support preemption within queue

[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15151595#comment-15151595 ] Karthik Kambatla edited comment on YARN-4333 at 2/18/16 2:14 AM:

[jira] [Commented] (YARN-4333) Fair scheduler should support preemption within queue

[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15151595#comment-15151595 ] Karthik Kambatla commented on YARN-4333: Thanks a lot for filing this JIRA and work

[jira] [Commented] (YARN-4690) Skip object allocation in FSAppAttempt#getResourceUsage when possible

[ https://issues.apache.org/jira/browse/YARN-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15151571#comment-15151571 ] Karthik Kambatla commented on YARN-4690: The optimization might not help since the

<    5   6   7   8   9   10   11   12   13   14   >