[jira] [Updated] (YARN-3997) An Application requesting multiple core containers can't preempt running application made of single core containers

2016-03-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3997: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > An Application requesting multiple

[jira] [Updated] (YARN-3405) FairScheduler's preemption cannot happen between sibling in some case

2016-03-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3405: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > FairScheduler's preemption cannot

[jira] [Updated] (YARN-4333) Fair scheduler should support preemption within queue

2016-03-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4333: --- Issue Type: Sub-task (was: Improvement) Parent: YARN-4752 > Fair scheduler should supp

[jira] [Updated] (YARN-2154) FairScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2154: --- Issue Type: Sub-task (was: Improvement) Parent: YARN-4752 > FairScheduler: Improve pre

[jira] [Updated] (YARN-4120) FSAppAttempt.getResourceUsage() should not take preemptedResource into account

2016-03-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4120: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > FSAppAttempt.getResourceUsage() sh

[jira] [Updated] (YARN-4134) FairScheduler preemption stops at queue level that all child queues are not over their fairshare

2016-03-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4134: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > FairScheduler preemption stops at

[jira] [Updated] (YARN-3902) Fair scheduler preempts ApplicationMaster

2016-03-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3902: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > Fair scheduler preempts Applicatio

[jira] [Updated] (YARN-4133) Containers to be preempted leak in FairScheduler preemption logic.

2016-03-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4133: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > Containers to be preempted leak in

[jira] [Updated] (YARN-1961) Fair scheduler preemption doesn't work for non-leaf queues

2016-03-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1961: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > Fair scheduler preemption doesn't

[jira] [Updated] (YARN-3121) FairScheduler preemption metrics

2016-03-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3121: --- Issue Type: Sub-task (was: Improvement) Parent: YARN-4752 > FairScheduler preemption m

[jira] [Updated] (YARN-3414) FairScheduler's preemption may cause livelock

2016-03-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3414: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > FairScheduler's preemption may cau

[jira] [Updated] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

2016-03-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3054: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4752 > Preempt policy in FairScheduler ma

[jira] [Updated] (YARN-4661) Per-queue preemption policy in FairScheduler

2016-03-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4661: --- Issue Type: Sub-task (was: Wish) Parent: YARN-4752 > Per-queue preemption policy in Fa

[jira] [Updated] (YARN-3903) Disable preemption at Queue level for Fair Scheduler

2016-03-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3903: --- Issue Type: Sub-task (was: Improvement) Parent: YARN-4752 > Disable preemption at Queu

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-3.patch > Add a helper library to maintain node state and allows common q

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-3.patch Updated patch should fix the test failures and findbugs warnings.

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: (was: yarn-4719-3.patch) > Add a helper library to maintain node state and allo

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15176248#comment-15176248 ] Karthik Kambatla commented on YARN-4719: [~rkanter] - this code touches the adaptiv

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15176644#comment-15176644 ] Karthik Kambatla commented on YARN-4719: [~leftnoteasy] - thanks for chiming in, yo

[jira] [Commented] (YARN-3997) An Application requesting multiple core containers can't preempt running application made of single core containers

2016-03-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180328#comment-15180328 ] Karthik Kambatla commented on YARN-3997: Sorry for the delay in following up on thi

[jira] [Resolved] (YARN-4134) FairScheduler preemption stops at queue level that all child queues are not over their fairshare

2016-03-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-4134. Resolution: Duplicate [~xinxianyin] - thanks for reporting and working on this. As you say, t

[jira] [Commented] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-03-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15182438#comment-15182438 ] Karthik Kambatla commented on YARN-4752: Update: Started looking at each of the sub

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15183324#comment-15183324 ] Karthik Kambatla commented on YARN-4719: bq. I may not understand about this, could

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15183328#comment-15183328 ] Karthik Kambatla commented on YARN-4719: Oh, and when the NodeFilter is null or an

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-4.patch Patch that uses NodeFilter to keep non-node-tracking logic out of

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: (was: yarn-4719-4.patch) > Add a helper library to maintain node state and allo

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-4.patch > Add a helper library to maintain node state and allows common q

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: (was: yarn-4719-4.patch) > Add a helper library to maintain node state and allo

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-4.patch > Add a helper library to maintain node state and allows common q

[jira] [Resolved] (YARN-1772) Fair Scheduler documentation should indicate that admin ACLs also give submit permissions

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-1772. Resolution: Not A Problem > Fair Scheduler documentation should indicate that admin ACLs also

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-5.patch v5 patch addresses javac and checkstyle warnings. > Add a helpe

[jira] [Updated] (YARN-4333) Fair scheduler should support preemption within a leaf queue

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4333: --- Summary: Fair scheduler should support preemption within a leaf queue (was: Fair scheduler sho

[jira] [Commented] (YARN-1961) Fair scheduler preemption doesn't work for non-leaf queues

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186273#comment-15186273 ] Karthik Kambatla commented on YARN-1961: Configuring minResources and minshare pree

[jira] [Updated] (YARN-1961) Fair scheduler preemption doesn't work for non-leaf queues

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1961: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4752) > Fair scheduler preempti

[jira] [Resolved] (YARN-3414) FairScheduler's preemption may cause livelock

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-3414. Resolution: Duplicate > FairScheduler's preemption may cause livelock > -

[jira] [Updated] (YARN-3414) FairScheduler's preemption may cause livelock

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3414: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4752) > FairScheduler's preempt

[jira] [Updated] (YARN-4134) FairScheduler preemption stops at queue level that all child queues are not over their fairshare

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4134: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4752) > FairScheduler preemptio

[jira] [Commented] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186463#comment-15186463 ] Karthik Kambatla commented on YARN-3054: [~peng.zhang] - the problem reported is no

[jira] [Commented] (YARN-4661) Per-queue preemption policy in FairScheduler

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186519#comment-15186519 ] Karthik Kambatla commented on YARN-4661: Interesting thought. In the context of YAR

[jira] [Updated] (YARN-3903) Disable preemption at Queue level for Fair Scheduler

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3903: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4752) > Disable preemption at Q

[jira] [Updated] (YARN-4661) Per-queue preemption policy in FairScheduler

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4661: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4752) > Per-queue preemption po

[jira] [Commented] (YARN-4120) FSAppAttempt.getResourceUsage() should not take preemptedResource into account

2016-03-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15189695#comment-15189695 ] Karthik Kambatla commented on YARN-4120: [~xinxianyin] - splitting out getResourceU

[jira] [Commented] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-03-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15189698#comment-15189698 ] Karthik Kambatla commented on YARN-4752: Yes, my current intent is to split schedul

[jira] [Commented] (YARN-4090) Make Collections.sort() more efficient in FSParentQueue.java

2016-03-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15189707#comment-15189707 ] Karthik Kambatla commented on YARN-4090: Is this a duplicate of YARN-1297? > Make

[jira] [Updated] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

2016-03-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3933: --- Component/s: (was: resourcemanager) fairscheduler > Race condition when ca

[jira] [Updated] (YARN-4089) Race condition when calling AbstractYarnScheduler.completedContainer.

2016-03-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4089: --- Component/s: (was: resourcemanager) fairscheduler > Race condition when ca

[jira] [Commented] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

2016-03-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15190344#comment-15190344 ] Karthik Kambatla commented on YARN-3933: The patch fails to apply. [~guoshiwei] - m

[jira] [Commented] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191538#comment-15191538 ] Karthik Kambatla commented on YARN-3054: Thanks [~peng.zhang]. I understand it now.

[jira] [Resolved] (YARN-1961) Fair scheduler preemption doesn't work for non-leaf queues

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-1961. Resolution: Won't Fix Closing this as "Won't Fix". Please reopen if there is a good reason to

[jira] [Updated] (YARN-4792) FairScheduler should do sanity checks on its configuration

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4792: --- Component/s: (was: yarn) > FairScheduler should do sanity checks on its configuration > ---

[jira] [Commented] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191554#comment-15191554 ] Karthik Kambatla commented on YARN-3054: Also, the approach being proposed on YARN-

[jira] [Commented] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191556#comment-15191556 ] Karthik Kambatla commented on YARN-3054: Also, the approach being proposed on YARN-

[jira] [Updated] (YARN-4784) fair scheduler: defaultQueueSchedulingPolicy should not accept fifo as a value

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4784: --- Component/s: (was: yarn) > fair scheduler: defaultQueueSchedulingPolicy should not accept f

[jira] [Updated] (YARN-4784) fair scheduler: defaultQueueSchedulingPolicy should not accept fifo as a value

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4784: --- Fix Version/s: (was: 2.9.0) > fair scheduler: defaultQueueSchedulingPolicy should not accep

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191596#comment-15191596 ] Karthik Kambatla commented on YARN-4719: bq. Can we make ClusterNodeTracker an inte

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-6.patch > Add a helper library to maintain node state and allows common q

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-7.patch Patch to fix the javac warning. The checkstyle warnings are innoc

[jira] [Created] (YARN-4804) [Umbrella] Improve test run duration

2016-03-12 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-4804: -- Summary: [Umbrella] Improve test run duration Key: YARN-4804 URL: https://issues.apache.org/jira/browse/YARN-4804 Project: Hadoop YARN Issue Type: Improv

[jira] [Created] (YARN-4805) Don't through all schedulers in ParameterizedTestBase

2016-03-12 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-4805: -- Summary: Don't through all schedulers in ParameterizedTestBase Key: YARN-4805 URL: https://issues.apache.org/jira/browse/YARN-4805 Project: Hadoop YARN I

[jira] [Updated] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

2016-03-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4805: --- Summary: Don't go through all schedulers in ParameterizedTestBase (was: Don't through all sche

[jira] [Updated] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

2016-03-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4805: --- Attachment: yarn-4805-1.patch > Don't go through all schedulers in ParameterizedTestBase >

[jira] [Created] (YARN-4806) Don't run TestZKRMStateStorePerf as part of the regular unittests

2016-03-12 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-4806: -- Summary: Don't run TestZKRMStateStorePerf as part of the regular unittests Key: YARN-4806 URL: https://issues.apache.org/jira/browse/YARN-4806 Project: Hadoop YAR

[jira] [Updated] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

2016-03-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4805: --- Attachment: (was: yarn-4805-1.patch) > Don't go through all schedulers in ParameterizedTest

[jira] [Updated] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

2016-03-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4805: --- Attachment: yarn-4805-1.patch > Don't go through all schedulers in ParameterizedTestBase >

[jira] [Created] (YARN-4807) MockAM#waitForState sleep duration is too long

2016-03-12 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-4807: -- Summary: MockAM#waitForState sleep duration is too long Key: YARN-4807 URL: https://issues.apache.org/jira/browse/YARN-4807 Project: Hadoop YARN Issue Ty

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15192123#comment-15192123 ] Karthik Kambatla commented on YARN-4719: The checkstyle warnings are innocuous, and

[jira] [Updated] (YARN-4807) MockAM#waitForState sleep duration is too long

2016-03-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4807: --- Assignee: Yufei Gu Affects Version/s: 2.8.0 Target Version/s: 2.9.0

[jira] [Commented] (YARN-4806) Don't run TestZKRMStateStorePerf as part of the regular unittests

2016-03-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15192125#comment-15192125 ] Karthik Kambatla commented on YARN-4806: May be, we should add a stress/perf profil

[jira] [Commented] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

2016-03-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15192221#comment-15192221 ] Karthik Kambatla commented on YARN-4805: Comparing against earlier builds from toda

[jira] [Commented] (YARN-4807) MockAM#waitForState sleep duration is too long

2016-03-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15192416#comment-15192416 ] Karthik Kambatla commented on YARN-4807: Actually, the problem seems worse. We have

[jira] [Created] (YARN-4808) SchedulerNode can use a few more cosmetic changes

2016-03-13 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-4808: -- Summary: SchedulerNode can use a few more cosmetic changes Key: YARN-4808 URL: https://issues.apache.org/jira/browse/YARN-4808 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-4808) SchedulerNode can use a few more cosmetic changes

2016-03-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4808: --- Attachment: yarn-4808-1.patch > SchedulerNode can use a few more cosmetic changes > ---

[jira] [Commented] (YARN-4808) SchedulerNode can use a few more cosmetic changes

2016-03-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15192557#comment-15192557 ] Karthik Kambatla commented on YARN-4808: [~elgoiri], [~leftnoteasy] - could you guy

[jira] [Updated] (YARN-4808) SchedulerNode can use a few more cosmetic changes

2016-03-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4808: --- Attachment: yarn-4808-1.patch > SchedulerNode can use a few more cosmetic changes > ---

[jira] [Updated] (YARN-4808) SchedulerNode can use a few more cosmetic changes

2016-03-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4808: --- Attachment: (was: yarn-4808-1.patch) > SchedulerNode can use a few more cosmetic changes >

[jira] [Created] (YARN-4809) De-duplicate container completion across schedulers

2016-03-13 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-4809: -- Summary: De-duplicate container completion across schedulers Key: YARN-4809 URL: https://issues.apache.org/jira/browse/YARN-4809 Project: Hadoop YARN Iss

[jira] [Created] (YARN-4812) TestFairScheduler#testContinuousScheduling fails intermittently

2016-03-14 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-4812: -- Summary: TestFairScheduler#testContinuousScheduling fails intermittently Key: YARN-4812 URL: https://issues.apache.org/jira/browse/YARN-4812 Project: Hadoop YARN

[jira] [Updated] (YARN-4812) TestFairScheduler#testContinuousScheduling fails intermittently

2016-03-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4812: --- Description: This test has failed in the past, and there seem to be more issues. {noformat} j

[jira] [Updated] (YARN-4812) TestFairScheduler#testContinuousScheduling fails intermittently

2016-03-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4812: --- Attachment: yarn-4812-1.patch Moved testContinuousScheduling to a separate class that uses mock

[jira] [Commented] (YARN-4809) De-duplicate container completion across schedulers

2016-03-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194119#comment-15194119 ] Karthik Kambatla commented on YARN-4809: Please feel free to take up. I might be ab

[jira] [Commented] (YARN-4812) TestFairScheduler#testContinuousScheduling fails intermittently

2016-03-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194170#comment-15194170 ] Karthik Kambatla commented on YARN-4812: I ran it a few thousand times, and didn't

[jira] [Commented] (YARN-4816) SystemClock API broken in 2.9.0

2016-03-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194325#comment-15194325 ] Karthik Kambatla commented on YARN-4816: My bad. Thanks for catching and fixing thi

[jira] [Commented] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

2016-03-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15194326#comment-15194326 ] Karthik Kambatla commented on YARN-4805: Thanks Robert. Will check this in tomorrow

[jira] [Commented] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

2016-03-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196504#comment-15196504 ] Karthik Kambatla commented on YARN-4805: There is a minor chance that can happen. P

[jira] [Commented] (YARN-4812) TestFairScheduler#testContinuousScheduling fails intermittently

2016-03-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196508#comment-15196508 ] Karthik Kambatla commented on YARN-4812: The test failures are unrelated. > TestF

[jira] [Commented] (YARN-1856) cgroups based memory monitoring for containers

2016-03-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196837#comment-15196837 ] Karthik Kambatla commented on YARN-1856: [~vinodkv] - I have filed YARN-4599 for th

[jira] [Commented] (YARN-4593) Deadlock in AbstractService.getConfig()

2016-03-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196871#comment-15196871 ] Karthik Kambatla commented on YARN-4593: Seems like a safe change. +1 > Deadlock i

[jira] [Commented] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

2016-03-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196875#comment-15196875 ] Karthik Kambatla commented on YARN-2965: [~elgoiri] - sure. You might want to make

[jira] [Commented] (YARN-4560) Make scheduler error checking message more user friendly

2016-03-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196883#comment-15196883 ] Karthik Kambatla commented on YARN-4560: +1. Checking this in. > Make scheduler e

[jira] [Commented] (YARN-3122) Metrics for container's actual CPU usage

2016-03-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196904#comment-15196904 ] Karthik Kambatla commented on YARN-3122: [~Naganarasimha] - I am sorry, but I didn'

[jira] [Commented] (YARN-4811) Generate histograms for actual container resource usage

2016-03-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196917#comment-15196917 ] Karthik Kambatla commented on YARN-4811: Quickly skimmed through the patch, and it

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2016-03-18 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202256#comment-15202256 ] Karthik Kambatla commented on YARN-810: --- Hasn't this been recently added with strict c

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200536#comment-15200536 ] Karthik Kambatla commented on YARN-4686: bq. Currently it is in the RM start method

[jira] [Reopened] (YARN-2048) List all of the containers of an application from the yarn web

2016-03-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reopened YARN-2048: > List all of the containers of an application from the yarn web > --

[jira] [Resolved] (YARN-2048) List all of the containers of an application from the yarn web

2016-03-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-2048. Resolution: Duplicate > List all of the containers of an application from the yarn web >

[jira] [Commented] (YARN-4808) SchedulerNode can use a few more cosmetic changes

2016-03-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202938#comment-15202938 ] Karthik Kambatla commented on YARN-4808: [~leftnoteasy] - will you be able to revie

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198410#comment-15198410 ] Karthik Kambatla commented on YARN-4686: On a cursory look, the patch looks reasona

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

2016-03-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15202044#comment-15202044 ] Karthik Kambatla commented on YARN-4837: I am in favor of making these changes if i

[jira] [Updated] (YARN-4732) *ProcessTree classes have too many whitespace issues

2016-03-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4732: --- Release Note: was:YARN-4732 Cleanup whitespace issues in *ProcessTree classes > *Process

[jira] [Commented] (YARN-4067) available resource could be set negative

2016-03-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15203401#comment-15203401 ] Karthik Kambatla commented on YARN-4067: IMO, available resource being negative is

<    1   2   3   4   5   6   7   8   9   10   >