[jira] [Commented] (YARN-6021) When your allocated minShare of all queue`s added up exceed cluster capacity you can get some queue for 0 fairshare

2016-12-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15771433#comment-15771433 ] Karthik Kambatla commented on YARN-6021: bq. When your allocated minShare of all qu

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15765938#comment-15765938 ] Karthik Kambatla commented on YARN-5709: The precommit build seems to be having iss

[jira] [Updated] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Fix Version/s: 2.9.0 > Cleanup leader election configs and pluggability > -

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15765681#comment-15765681 ] Karthik Kambatla commented on YARN-5709: Posting a branch-2.8 patch to address some

[jira] [Updated] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: yarn-5709-branch-2.8.patch > Cleanup leader election configs and pluggability > ---

[jira] [Commented] (YARN-4559) Make leader elector and zk store share the same curator client

2016-12-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15765667#comment-15765667 ] Karthik Kambatla commented on YARN-4559: Just pulled this back into branch-2.8 as w

[jira] [Updated] (YARN-4559) Make leader elector and zk store share the same curator client

2016-12-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4559: --- Fix Version/s: 2.8.0 > Make leader elector and zk store share the same curator client > ---

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15765158#comment-15765158 ] Karthik Kambatla commented on YARN-5709: Sorry for dropping the ball on this. I ll

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15749766#comment-15749766 ] Karthik Kambatla commented on YARN-5709: Will take a look later today or tomorrow.

[jira] [Commented] (YARN-5600) Allow setting yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-12-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15749754#comment-15749754 ] Karthik Kambatla commented on YARN-5600: This is quite handy. Thanks for working on

[jira] [Updated] (YARN-5600) Allow setting yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-12-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5600: --- Summary: Allow setting yarn.nodemanager.delete.debug-delay-sec on a per-application basis (was

[jira] [Commented] (YARN-5646) Documentation for scheduling of OPPORTUNISTIC containers

2016-12-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15743531#comment-15743531 ] Karthik Kambatla commented on YARN-5646: Really well written docs, [~kkaranasos].

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15743309#comment-15743309 ] Karthik Kambatla commented on YARN-5709: [~jianhe] - I didn't quite get that. Are y

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15738172#comment-15738172 ] Karthik Kambatla commented on YARN-5709: I just pushed YARN-5677 to branch-2.8, but

[jira] [Updated] (YARN-4752) FairScheduler should preempt for a ResourceRequest and all preempted containers should be on the same node

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4752: --- Summary: FairScheduler should preempt for a ResourceRequest and all preempted containers should

[jira] [Assigned] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-4752: -- Assignee: Karthik Kambatla > [Umbrella] FairScheduler: Improve preemption >

[jira] [Updated] (YARN-5893) Experiment with using PriorityQueue for storing starved applications

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5893: --- Parent Issue: YARN-5990 (was: YARN-4752) > Experiment with using PriorityQueue for storing sta

[jira] [Updated] (YARN-5832) Preemption should consider multiple resource-requests of a starved app as needed

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5832: --- Parent Issue: YARN-5990 (was: YARN-4752) > Preemption should consider multiple resource-reques

[jira] [Updated] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5829: --- Parent Issue: YARN-5990 (was: YARN-4752) > FS preemption should reserve a node before consider

[jira] [Assigned] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-5829: -- Assignee: Karthik Kambatla > FS preemption should reserve a node before considering cont

[jira] [Updated] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5831: --- Parent Issue: YARN-5990 (was: YARN-4752) > Propagate allowPreemptionFrom flag all the way down

[jira] [Updated] (YARN-5830) Avoid preempting AM containers

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5830: --- Parent Issue: YARN-5990 (was: YARN-4752) > Avoid preempting AM containers > --

[jira] [Updated] (YARN-5824) Verify app starvation under custom preemption thresholds and timeouts

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5824: --- Parent Issue: YARN-5990 (was: YARN-4752) > Verify app starvation under custom preemption thres

[jira] [Updated] (YARN-5798) Handle FSPreemptionThread crashing due to a RuntimeException

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5798: --- Parent Issue: YARN-5990 (was: YARN-4752) > Handle FSPreemptionThread crashing due to a Runtime

[jira] [Created] (YARN-5990) [Umbrella] Follow-up (phase-2) FairScheduler preemption improvements

2016-12-09 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5990: -- Summary: [Umbrella] Follow-up (phase-2) FairScheduler preemption improvements Key: YARN-5990 URL: https://issues.apache.org/jira/browse/YARN-5990 Project: Hadoop

[jira] [Updated] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: yarn-5709.4.patch We can't directly call the method on EmbeddedElector as it can be

[jira] [Updated] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: yarn-5709.3.patch * Updated patch (v3) fixes pertinent checkstyle issues. * The te

[jira] [Updated] (YARN-5919) FairSharePolicy is not reasonable when sorting the application

2016-12-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5919: --- Target Version/s: (was: 2.7.1) > FairSharePolicy is not reasonable when sorting the applicati

[jira] [Updated] (YARN-5919) FairSharePolicy is not reasonable when sorting the application

2016-12-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5919: --- Priority: Major (was: Critical) > FairSharePolicy is not reasonable when sorting the applicati

[jira] [Updated] (YARN-5919) FairSharePolicy is not reasonable when sorting the application

2016-12-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5919: --- Fix Version/s: (was: 2.7.1) > FairSharePolicy is not reasonable when sorting the applicatio

[jira] [Updated] (YARN-5964) Lower the granularity of locks in FairScheduler

2016-12-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5964: --- Summary: Lower the granularity of locks in FairScheduler (was: fairscheduler use too many obje

[jira] [Commented] (YARN-5964) fairscheduler use too many object lock, leads to low performance

2016-12-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730429#comment-15730429 ] Karthik Kambatla commented on YARN-5964: Do you have continuous scheduling turned o

[jira] [Commented] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2016-12-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730421#comment-15730421 ] Karthik Kambatla commented on YARN-5292: Just looked at the design code but not the

[jira] [Updated] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: yarn-5709.2.patch Patch v2 should take care of javadoc, checkstyle warnings, and un

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15730006#comment-15730006 ] Karthik Kambatla commented on YARN-5709: Since it is a config that users should be

[jira] [Updated] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: yarn-5709-wip.2.patch Updated patch fixes some of the unit tests. It is still work

[jira] [Updated] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Summary: Cleanup leader election configs and pluggability (was: Cleanup leader election relate

[jira] [Commented] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15727438#comment-15727438 ] Karthik Kambatla commented on YARN-5709: The patch posted here captures my intentio

[jira] [Assigned] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-5709: -- Assignee: Karthik Kambatla (was: Daniel Templeton) > Cleanup leader election related co

[jira] [Updated] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: (was: yarn-5709.1.patch) > Cleanup leader election related configuration mess >

[jira] [Updated] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: yarn-5709.1.patch > Cleanup leader election related configuration mess > --

[jira] [Updated] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: (was: yarn-5709-1.patch) > Cleanup leader election related configuration mess >

[jira] [Updated] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: yarn-5709.1.patch > Cleanup leader election related configuration mess > --

[jira] [Updated] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: yarn-5709-1.patch > Cleanup leader election related configuration mess > --

[jira] [Commented] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726943#comment-15726943 ] Karthik Kambatla commented on YARN-5709: bq. For the original hadoop-common's elect

[jira] [Commented] (YARN-5685) Non-embedded HA failover is broken

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726603#comment-15726603 ] Karthik Kambatla commented on YARN-5685: I am uncomfortable with deprecating the co

[jira] [Commented] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726506#comment-15726506 ] Karthik Kambatla commented on YARN-5709: My primary concern with the current 2.8.0

[jira] [Comment Edited] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726506#comment-15726506 ] Karthik Kambatla edited comment on YARN-5709 at 12/6/16 7:50 PM:

[jira] [Updated] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Summary: Cleanup leader election related configuration mess (was: Cleanup Curator-based leader

[jira] [Updated] (YARN-5709) Cleanup Curator-based leader election code

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Priority: Blocker (was: Critical) > Cleanup Curator-based leader election code > -

[jira] [Commented] (YARN-5709) Cleanup Curator-based leader election code

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726301#comment-15726301 ] Karthik Kambatla commented on YARN-5709: [~djp] - I was really hoping to clean up t

[jira] [Updated] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4752: --- Attachment: yarn-4752.4.patch > [Umbrella] FairScheduler: Improve preemption >

[jira] [Updated] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4752: --- Attachment: yarn-4752.4.patch Updated cumulative patch after YARN-5885 got committed. This patc

[jira] [Updated] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5885: --- Attachment: yarn-5885.YARN-4752.4.patch Updated patch to address Daniels' latest round of comme

[jira] [Created] (YARN-5893) Experiment with using PriorityQueue for storing starved applications

2016-11-16 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5893: -- Summary: Experiment with using PriorityQueue for storing starved applications Key: YARN-5893 URL: https://issues.apache.org/jira/browse/YARN-5893 Project: Hadoop

[jira] [Updated] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5885: --- Attachment: yarn-5885.YARN-4752.3.patch Updated patch renames {{FSAppAttempt}} methods {{addPre

[jira] [Updated] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5885: --- Attachment: yarn-5885.YARN-4752.2.patch > Cleanup YARN-4752 for merge > ---

[jira] [Updated] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5885: --- Attachment: yarn-5885.2.patch > Cleanup YARN-4752 for merge > --- > >

[jira] [Commented] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667812#comment-15667812 ] Karthik Kambatla commented on YARN-5885: Also, posted the [cumulative patch|https:

[jira] [Updated] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4752: --- Attachment: yarn-4752.3.patch > [Umbrella] FairScheduler: Improve preemption >

[jira] [Updated] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5885: --- Attachment: yarn-5885.1.patch > Cleanup YARN-4752 for merge > --- > >

[jira] [Created] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-15 Thread Karthik Kambatla (JIRA)
Components: fairscheduler Reporter: Karthik Kambatla Assignee: Karthik Kambatla JIRA to track changes necessary for branch merge. These include: # Remove names from TODOs (e.g. KK) and add JIRA numbers for follow-up work. # Fix tests that have been commented out in

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664991#comment-15664991 ] Karthik Kambatla commented on YARN-4597: The latest patch looks good to me. > Add

[jira] [Commented] (YARN-4033) In FairScheduler, parent queues should also display queue status

2016-11-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15662833#comment-15662833 ] Karthik Kambatla commented on YARN-4033: +1. Checking this in. > In FairScheduler,

[jira] [Updated] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4752: --- Attachment: yarn-4752.2.patch > [Umbrella] FairScheduler: Improve preemption >

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: yarn-5819.YARN-4752.5.patch Rebased YARN-4752 on trunk. Updating this patch to catc

[jira] [Updated] (YARN-5834) TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5834: --- Fix Version/s: 3.0.0-alpha2 > TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager

[jira] [Commented] (YARN-5834) TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15655304#comment-15655304 ] Karthik Kambatla commented on YARN-5834: +1. Checking this in.. > TestNodeStatusUp

[jira] [Updated] (YARN-5834) TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5834: --- Priority: Trivial (was: Minor) > TestNodeStatusUpdater.testNMRMConnectionConf compares nodeman

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15655248#comment-15655248 ] Karthik Kambatla commented on YARN-5819: Since updating {{Resource}} is not atomic,

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15653359#comment-15653359 ] Karthik Kambatla commented on YARN-4597: [~asuresh] - could you hold off until Frid

[jira] [Updated] (YARN-5453) FairScheduler#update may skip update demand resource of child queue/app if current demand reached maxResource

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5453: --- Fix Version/s: 3.0.0-alpha2 > FairScheduler#update may skip update demand resource of child que

[jira] [Commented] (YARN-5453) FairScheduler#update may skip update demand resource of child queue/app if current demand reached maxResource

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15653324#comment-15653324 ] Karthik Kambatla commented on YARN-5453: +1. Checking this in.. > FairScheduler#up

[jira] [Commented] (YARN-5552) Add Builder methods for common yarn API records

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15653301#comment-15653301 ] Karthik Kambatla commented on YARN-5552: Eye-balled the changes and they look good

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: yarn-5819.YARN-4752.4.patch Patch v4 that drops unused imports. > Verify fairshar

[jira] [Comment Edited] (YARN-5819) Verify fairshare and minshare preemption

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652786#comment-15652786 ] Karthik Kambatla edited comment on YARN-5819 at 11/10/16 2:31 AM: ---

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652786#comment-15652786 ] Karthik Kambatla commented on YARN-5819: Patch v3 incorporates most recent review f

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: yarn-5819.YARN-4752.3.patch > Verify fairshare and minshare preemption > --

[jira] [Updated] (YARN-5783) Verify identification of starved applications

2016-11-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5783: --- Summary: Verify identification of starved applications (was: Verify applications are identifie

[jira] [Commented] (YARN-5783) Verify applications are identified starved

2016-11-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649546#comment-15649546 ] Karthik Kambatla commented on YARN-5783: [~templedf] - thanks for the careful revie

[jira] [Created] (YARN-5863) Record that an application is starved for resources when it is

2016-11-08 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5863: -- Summary: Record that an application is starved for resources when it is Key: YARN-5863 URL: https://issues.apache.org/jira/browse/YARN-5863 Project: Hadoop YARN

[jira] [Commented] (YARN-5783) Verify applications are identified starved

2016-11-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649382#comment-15649382 ] Karthik Kambatla commented on YARN-5783: bq. Overall, I think "starved" should be a

[jira] [Updated] (YARN-5783) Verify applications are identified starved

2016-11-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5783: --- Attachment: yarn-5783.YARN-4752.8.patch My bad, didn't realize ApplicationAttemptId already imp

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15646541#comment-15646541 ] Karthik Kambatla commented on YARN-5819: [~templedf] - would you like me to post th

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15646534#comment-15646534 ] Karthik Kambatla commented on YARN-5819: Thanks for the prompt and thorough first p

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: yarn-5819.YARN-4752.2.patch > Verify fairshare and minshare preemption > --

[jira] [Commented] (YARN-5783) Verify applications are identified starved

2016-11-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15646386#comment-15646386 ] Karthik Kambatla commented on YARN-5783: Fair point. That was actually my initial t

[jira] [Updated] (YARN-5783) Verify applications are identified starved

2016-11-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5783: --- Attachment: yarn-5783.YARN-4752.7.patch > Verify applications are identified starved >

[jira] [Updated] (YARN-5783) Verify applications are identified starved

2016-11-03 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5783: --- Attachment: yarn-5783.YARN-4752.6.patch > Verify applications are identified starved >

[jira] [Commented] (YARN-5783) Verify applications are identified starved

2016-11-03 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15634830#comment-15634830 ] Karthik Kambatla commented on YARN-5783: bq. In SchedulerApplicationAttempt.hashCod

[jira] [Created] (YARN-5832) Preemption should consider multiple resource-requests of a starved app as needed

2016-11-03 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5832: -- Summary: Preemption should consider multiple resource-requests of a starved app as needed Key: YARN-5832 URL: https://issues.apache.org/jira/browse/YARN-5832 Proj

[jira] [Created] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2016-11-03 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5831: -- Summary: Propagate allowPreemptionFrom flag all the way down to the app Key: YARN-5831 URL: https://issues.apache.org/jira/browse/YARN-5831 Project: Hadoop YARN

[jira] [Commented] (YARN-5821) Drop left-over preemption-related code and clean up method visibilities in the Schedulable hierarchy

2016-11-03 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15634467#comment-15634467 ] Karthik Kambatla commented on YARN-5821: Checking this in.. > Drop left-over preem

[jira] [Created] (YARN-5830) Avoid preempting AM containers

2016-11-03 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5830: -- Summary: Avoid preempting AM containers Key: YARN-5830 URL: https://issues.apache.org/jira/browse/YARN-5830 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2016-11-03 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5829: -- Summary: FS preemption should reserve a node before considering containers on it for preemption Key: YARN-5829 URL: https://issues.apache.org/jira/browse/YARN-5829

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-03 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15631873#comment-15631873 ] Karthik Kambatla commented on YARN-5819: This patch applies on top of YARN-5783. >

[jira] [Updated] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4752: --- Attachment: yarn-4752-1.patch Attaching the preliminary cumulative patch for the curious. > [U

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: (was: yarn-5819.YARN-4752.1.patch) > Verify fairshare and minshare preemption >

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: yarn-5819.YARN-4752.1.patch > Verify fairshare and minshare preemption > --

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: yarn-5819.YARN-4752.1.patch Attaching patch that adds Parameterized tests for fairs

<    1   2   3   4   5   6   7   8   9   10   >