[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-07-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15385192#comment-15385192 ] Karthik Kambatla commented on YARN-4464: I know there is no right answer here. We s

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-07-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386064#comment-15386064 ] Karthik Kambatla commented on YARN-4464: I am okay with option 3. What should be

[jira] [Commented] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-07-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15391207#comment-15391207 ] Karthik Kambatla commented on YARN-4752: Working on a branch might help keep the re

[jira] [Commented] (YARN-5392) Replace use of Priority in the Scheduling infrastructure with an opaque ShedulerKey

2016-07-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15391272#comment-15391272 ] Karthik Kambatla commented on YARN-5392: Looking into this now.. > Replace use of

[jira] [Commented] (YARN-5392) Replace use of Priority in the Scheduling infrastructure with an opaque ShedulerKey

2016-07-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15391285#comment-15391285 ] Karthik Kambatla commented on YARN-5392: Patch looks mostly good. Have mostly minor

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-07-25 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392333#comment-15392333 ] Karthik Kambatla commented on YARN-4464: Sure. Just to confirm, here is my understa

[jira] [Commented] (YARN-5392) Replace use of Priority in the Scheduling infrastructure with an opaque ShedulerKey

2016-07-26 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394449#comment-15394449 ] Karthik Kambatla commented on YARN-5392: In my comments above, 2.1 still applies. O

[jira] [Commented] (YARN-5434) Add -client|server argument for graceful decom

2016-07-26 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394582#comment-15394582 ] Karthik Kambatla commented on YARN-5434: Marking this a blocker for 5.8.0 to ensure

[jira] [Updated] (YARN-5434) Add -client|server argument for graceful decom

2016-07-26 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5434: --- Priority: Blocker (was: Major) > Add -client|server argument for graceful decom >

[jira] [Commented] (YARN-5392) Replace use of Priority in the Scheduling infrastructure with an opaque ShedulerKey

2016-07-26 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394594#comment-15394594 ] Karthik Kambatla commented on YARN-5392: +1. Thanks for your patience through the r

[jira] [Commented] (YARN-3662) Federation Membership State Store internal APIs

2016-07-27 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15396735#comment-15396735 ] Karthik Kambatla commented on YARN-3662: Quickly skimmed through. It looks good.

[jira] [Commented] (YARN-5453) FairScheduler#update may skip update demand resource of child queue/app if current demand reached maxResource

2016-08-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15413687#comment-15413687 ] Karthik Kambatla commented on YARN-5453: Demand is limited to maxResources to enfor

[jira] [Commented] (YARN-4806) Don't run TestZKRMStateStorePerf as part of the regular unittests

2016-08-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15413694#comment-15413694 ] Karthik Kambatla commented on YARN-4806: bq. Is it OK that added profile may test o

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

2016-08-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15413696#comment-15413696 ] Karthik Kambatla commented on YARN-1011: [~anshul.pundir] - as responded on email,

[jira] [Commented] (YARN-4767) Network issues can cause persistent RM UI outage

2016-08-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15413848#comment-15413848 ] Karthik Kambatla commented on YARN-4767: [~templedf] - I am comfortable with the ap

[jira] [Commented] (YARN-5373) NPE listing wildcard directory in containerLaunch

2016-08-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15413916#comment-15413916 ] Karthik Kambatla commented on YARN-5373: Thanks for picking this up, [~templedf].

[jira] [Commented] (YARN-5453) FairScheduler#update may skip update demand resource of child queue/app if current demand reached maxResource

2016-08-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15414146#comment-15414146 ] Karthik Kambatla commented on YARN-5453: If we can limit the scheduling to under ma

[jira] [Commented] (YARN-5343) TestContinuousScheduling#testSortedNodes fail intermittently

2016-08-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15414443#comment-15414443 ] Karthik Kambatla commented on YARN-5343: Nice catch, [~sandflee] and [~yufeigu]. Th

[jira] [Commented] (YARN-5343) TestContinuousScheduling#testSortedNodes fail intermittently

2016-08-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15414465#comment-15414465 ] Karthik Kambatla commented on YARN-5343: Checking this in. > TestContinuousSchedu

[jira] [Updated] (YARN-5343) TestContinuousScheduling#testSortedNodes fails intermittently

2016-08-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5343: --- Summary: TestContinuousScheduling#testSortedNodes fails intermittently (was: TestContinuousSch

[jira] [Updated] (YARN-4743) FairSharePolicy breaks TimSort assumption

2016-10-27 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4743: --- Fix Version/s: 2.9.0 > FairSharePolicy breaks TimSort assumption >

[jira] [Commented] (YARN-4981) limit the max containers to assign to one application per heartbeart

2016-10-27 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15614405#comment-15614405 ] Karthik Kambatla commented on YARN-4981: YARN-5035 adjusts the number of containers

[jira] [Created] (YARN-5798) Handle FSPreemptionThread crashing due to a RuntimeException

2016-10-28 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5798: -- Summary: Handle FSPreemptionThread crashing due to a RuntimeException Key: YARN-5798 URL: https://issues.apache.org/jira/browse/YARN-5798 Project: Hadoop YARN

[jira] [Updated] (YARN-5783) Unit tests to verify the identification of starved applications

2016-10-28 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5783: --- Attachment: yarn-5783.YARN-4752.2.patch > Unit tests to verify the identification of starved ap

[jira] [Commented] (YARN-5783) Unit tests to verify the identification of starved applications

2016-10-28 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15616421#comment-15616421 ] Karthik Kambatla commented on YARN-5783: [~templedf] - thanks for the review. Addre

[jira] [Updated] (YARN-5783) Unit tests to verify the identification of starved applications

2016-10-28 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5783: --- Attachment: (was: yarn-5783.YARN-4752.1.patch) > Unit tests to verify the identification of

[jira] [Updated] (YARN-5184) Fix up incompatible changes introduced on ContainerStatus and NodeReport

2016-10-28 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5184: --- Description: YARN-2882 and YARN-5430 broke compatibility by adding abstract methods to Contain

[jira] [Commented] (YARN-5184) Fix up incompatible changes introduced on ContainerStatus and NodeReport

2016-10-28 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15616521#comment-15616521 ] Karthik Kambatla commented on YARN-5184: I would think this falls under the purview

[jira] [Commented] (YARN-5184) Fix up incompatible changes introduced on ContainerStatus and NodeReport

2016-10-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15618248#comment-15618248 ] Karthik Kambatla commented on YARN-5184: What if the methods in question are used b

[jira] [Assigned] (YARN-5184) Fix up incompatible changes introduced on ContainerStatus and NodeReport

2016-10-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-5184: -- Assignee: Sangjin Lee (was: Karthik Kambatla) Assigning to Sangjin as he is working on

[jira] [Updated] (YARN-3637) Handle localization sym-linking correctly at the YARN level

2016-10-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3637: --- Priority: Major (was: Critical) > Handle localization sym-linking correctly at the YARN level

[jira] [Updated] (YARN-3637) Handle localization sym-linking correctly at the YARN level

2016-10-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3637: --- Priority: Critical (was: Blocker) > Handle localization sym-linking correctly at the YARN leve

[jira] [Updated] (YARN-2684) FairScheduler: When failing an application due to changes in queue config or placement policy, indicate the cause.

2016-10-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2684: --- Priority: Major (was: Critical) > FairScheduler: When failing an application due to changes in

[jira] [Updated] (YARN-5184) Fix up incompatible changes introduced on ContainerStatus and NodeReport

2016-10-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5184: --- Target Version/s: 2.9.0, 3.0.0-alpha2 (was: 2.9.0) > Fix up incompatible changes introduced on

[jira] [Updated] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2016-10-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1492: --- Priority: Major (was: Critical) > truly shared cache for jars (jobjar/libjar) > --

[jira] [Updated] (YARN-5783) Unit tests to verify the identification of starved applications

2016-10-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5783: --- Attachment: yarn-5783.YARN-4752.3.patch > Unit tests to verify the identification of starved ap

[jira] [Commented] (YARN-5783) Unit tests to verify the identification of starved applications

2016-10-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15623344#comment-15623344 ] Karthik Kambatla commented on YARN-5783: bq. If you're assuming a single-threaded c

[jira] [Commented] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-10-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15623378#comment-15623378 ] Karthik Kambatla commented on YARN-5694: I am not very particular about the method

[jira] [Commented] (YARN-5685) Non-embedded HA failover is broken

2016-10-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15623708#comment-15623708 ] Karthik Kambatla commented on YARN-5685: Would it make sense to address the first t

[jira] [Commented] (YARN-4998) Minor cleanup to UGI use in AdminService

2016-10-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15623712#comment-15623712 ] Karthik Kambatla commented on YARN-4998: +1, checking this in.. > Minor cleanup t

[jira] [Commented] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15626103#comment-15626103 ] Karthik Kambatla commented on YARN-5694: +1, pending Jenkins. > ZKRMStateStore sh

[jira] [Updated] (YARN-5783) Unit tests to verify the identification of starved applications

2016-11-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5783: --- Attachment: yarn-5783.YARN-4752.4.patch Updated patch to address javadoc and findbugs warnings.

[jira] [Created] (YARN-5819) Verify preemption works between applications in the same leaf queue

2016-11-02 Thread Karthik Kambatla (JIRA)
YARN Issue Type: Sub-task Components: fairscheduler Affects Versions: 2.9.0 Reporter: Karthik Kambatla Assignee: Karthik Kambatla JIRA to track the unit test(s) for tracking preemption between applications in the same queue. Note that this can only

[jira] [Created] (YARN-5821) Drop left-over preemption-related code and clean up method visibilities in the Schedulable hierarchy

2016-11-02 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5821: -- Summary: Drop left-over preemption-related code and clean up method visibilities in the Schedulable hierarchy Key: YARN-5821 URL: https://issues.apache.org/jira/browse/YARN-58

[jira] [Updated] (YARN-5821) Drop left-over preemption-related code and clean up method visibilities in the Schedulable hierarchy

2016-11-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5821: --- Attachment: yarn-5821.YARN-4752.1.patch Straight-forward patch. > Drop left-over preemption-r

[jira] [Updated] (YARN-5821) Drop left-over preemption-related code and clean up method visibilities in the Schedulable hierarchy

2016-11-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5821: --- Attachment: yarn-5821.YARN-4752.1.patch > Drop left-over preemption-related code and clean up m

[jira] [Updated] (YARN-5783) Unit tests to verify the identification of starved applications

2016-11-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5783: --- Attachment: yarn-5783.YARN-4752.5.patch > Unit tests to verify the identification of starved ap

[jira] [Updated] (YARN-5783) Verify applications are identified starved

2016-11-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5783: --- Summary: Verify applications are identified starved (was: Unit tests to verify the identificat

[jira] [Created] (YARN-5824) Verify app starvation under custom preemption thresholds and timeouts

2016-11-02 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5824: -- Summary: Verify app starvation under custom preemption thresholds and timeouts Key: YARN-5824 URL: https://issues.apache.org/jira/browse/YARN-5824 Project: Hadoop

[jira] [Commented] (YARN-5783) Verify applications are identified starved

2016-11-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15631629#comment-15631629 ] Karthik Kambatla commented on YARN-5783: Good points, [~templedf]. Your last sugge

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-02 Thread Karthik Kambatla (JIRA)
Issue Type: Sub-task > Components: fairscheduler >Affects Versions: 2.9.0 >Reporter: Karthik Kambatla > Assignee: Karthik Kambatla > > JIRA to track the unit test(s) for tracking preemption between applications > in the same queue. Note that this c

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-02 Thread Karthik Kambatla (JIRA)
Project: Hadoop YARN > Issue Type: Sub-task > Components: fairscheduler >Affects Versions: 2.9.0 >Reporter: Karthik Kambatla > Assignee: Karthik Kambatla > > JIRA to track the unit test(s) verifying both fairshare and minshare

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: yarn-5819.YARN-4752.1.patch Attaching patch that adds Parameterized tests for fairs

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: (was: yarn-5819.YARN-4752.1.patch) > Verify fairshare and minshare preemption >

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: yarn-5819.YARN-4752.1.patch > Verify fairshare and minshare preemption > --

[jira] [Updated] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4752: --- Attachment: yarn-4752-1.patch Attaching the preliminary cumulative patch for the curious. > [U

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-03 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15631873#comment-15631873 ] Karthik Kambatla commented on YARN-5819: This patch applies on top of YARN-5783. >

[jira] [Created] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2016-11-03 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5829: -- Summary: FS preemption should reserve a node before considering containers on it for preemption Key: YARN-5829 URL: https://issues.apache.org/jira/browse/YARN-5829

[jira] [Created] (YARN-5830) Avoid preempting AM containers

2016-11-03 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5830: -- Summary: Avoid preempting AM containers Key: YARN-5830 URL: https://issues.apache.org/jira/browse/YARN-5830 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5821) Drop left-over preemption-related code and clean up method visibilities in the Schedulable hierarchy

2016-11-03 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15634467#comment-15634467 ] Karthik Kambatla commented on YARN-5821: Checking this in.. > Drop left-over preem

[jira] [Created] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2016-11-03 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5831: -- Summary: Propagate allowPreemptionFrom flag all the way down to the app Key: YARN-5831 URL: https://issues.apache.org/jira/browse/YARN-5831 Project: Hadoop YARN

[jira] [Created] (YARN-5832) Preemption should consider multiple resource-requests of a starved app as needed

2016-11-03 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5832: -- Summary: Preemption should consider multiple resource-requests of a starved app as needed Key: YARN-5832 URL: https://issues.apache.org/jira/browse/YARN-5832 Proj

[jira] [Commented] (YARN-5783) Verify applications are identified starved

2016-11-03 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15634830#comment-15634830 ] Karthik Kambatla commented on YARN-5783: bq. In SchedulerApplicationAttempt.hashCod

[jira] [Updated] (YARN-5783) Verify applications are identified starved

2016-11-03 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5783: --- Attachment: yarn-5783.YARN-4752.6.patch > Verify applications are identified starved >

[jira] [Updated] (YARN-5783) Verify applications are identified starved

2016-11-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5783: --- Attachment: yarn-5783.YARN-4752.7.patch > Verify applications are identified starved >

[jira] [Commented] (YARN-5783) Verify applications are identified starved

2016-11-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15646386#comment-15646386 ] Karthik Kambatla commented on YARN-5783: Fair point. That was actually my initial t

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: yarn-5819.YARN-4752.2.patch > Verify fairshare and minshare preemption > --

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15646534#comment-15646534 ] Karthik Kambatla commented on YARN-5819: Thanks for the prompt and thorough first p

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15646541#comment-15646541 ] Karthik Kambatla commented on YARN-5819: [~templedf] - would you like me to post th

[jira] [Updated] (YARN-5783) Verify applications are identified starved

2016-11-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5783: --- Attachment: yarn-5783.YARN-4752.8.patch My bad, didn't realize ApplicationAttemptId already imp

[jira] [Commented] (YARN-5783) Verify applications are identified starved

2016-11-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649382#comment-15649382 ] Karthik Kambatla commented on YARN-5783: bq. Overall, I think "starved" should be a

[jira] [Created] (YARN-5863) Record that an application is starved for resources when it is

2016-11-08 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5863: -- Summary: Record that an application is starved for resources when it is Key: YARN-5863 URL: https://issues.apache.org/jira/browse/YARN-5863 Project: Hadoop YARN

[jira] [Commented] (YARN-5783) Verify applications are identified starved

2016-11-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649546#comment-15649546 ] Karthik Kambatla commented on YARN-5783: [~templedf] - thanks for the careful revie

[jira] [Updated] (YARN-5783) Verify identification of starved applications

2016-11-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5783: --- Summary: Verify identification of starved applications (was: Verify applications are identifie

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: yarn-5819.YARN-4752.3.patch > Verify fairshare and minshare preemption > --

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652786#comment-15652786 ] Karthik Kambatla commented on YARN-5819: Patch v3 incorporates most recent review f

[jira] [Comment Edited] (YARN-5819) Verify fairshare and minshare preemption

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652786#comment-15652786 ] Karthik Kambatla edited comment on YARN-5819 at 11/10/16 2:31 AM: ---

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: yarn-5819.YARN-4752.4.patch Patch v4 that drops unused imports. > Verify fairshar

[jira] [Commented] (YARN-5552) Add Builder methods for common yarn API records

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15653301#comment-15653301 ] Karthik Kambatla commented on YARN-5552: Eye-balled the changes and they look good

[jira] [Commented] (YARN-5453) FairScheduler#update may skip update demand resource of child queue/app if current demand reached maxResource

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15653324#comment-15653324 ] Karthik Kambatla commented on YARN-5453: +1. Checking this in.. > FairScheduler#up

[jira] [Updated] (YARN-5453) FairScheduler#update may skip update demand resource of child queue/app if current demand reached maxResource

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5453: --- Fix Version/s: 3.0.0-alpha2 > FairScheduler#update may skip update demand resource of child que

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15653359#comment-15653359 ] Karthik Kambatla commented on YARN-4597: [~asuresh] - could you hold off until Frid

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15655248#comment-15655248 ] Karthik Kambatla commented on YARN-5819: Since updating {{Resource}} is not atomic,

[jira] [Updated] (YARN-5834) TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5834: --- Priority: Trivial (was: Minor) > TestNodeStatusUpdater.testNMRMConnectionConf compares nodeman

[jira] [Commented] (YARN-5834) TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15655304#comment-15655304 ] Karthik Kambatla commented on YARN-5834: +1. Checking this in.. > TestNodeStatusUp

[jira] [Updated] (YARN-5834) TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5834: --- Fix Version/s: 3.0.0-alpha2 > TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: yarn-5819.YARN-4752.5.patch Rebased YARN-4752 on trunk. Updating this patch to catc

[jira] [Updated] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4752: --- Attachment: yarn-4752.2.patch > [Umbrella] FairScheduler: Improve preemption >

[jira] [Commented] (YARN-4033) In FairScheduler, parent queues should also display queue status

2016-11-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15662833#comment-15662833 ] Karthik Kambatla commented on YARN-4033: +1. Checking this in. > In FairScheduler,

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664991#comment-15664991 ] Karthik Kambatla commented on YARN-4597: The latest patch looks good to me. > Add

[jira] [Created] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-15 Thread Karthik Kambatla (JIRA)
Components: fairscheduler Reporter: Karthik Kambatla Assignee: Karthik Kambatla JIRA to track changes necessary for branch merge. These include: # Remove names from TODOs (e.g. KK) and add JIRA numbers for follow-up work. # Fix tests that have been commented out in

[jira] [Updated] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5885: --- Attachment: yarn-5885.1.patch > Cleanup YARN-4752 for merge > --- > >

[jira] [Updated] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4752: --- Attachment: yarn-4752.3.patch > [Umbrella] FairScheduler: Improve preemption >

[jira] [Commented] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667812#comment-15667812 ] Karthik Kambatla commented on YARN-5885: Also, posted the [cumulative patch|https:

[jira] [Updated] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5885: --- Attachment: yarn-5885.2.patch > Cleanup YARN-4752 for merge > --- > >

[jira] [Updated] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5885: --- Attachment: yarn-5885.YARN-4752.2.patch > Cleanup YARN-4752 for merge > ---

[jira] [Updated] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5885: --- Attachment: yarn-5885.YARN-4752.3.patch Updated patch renames {{FSAppAttempt}} methods {{addPre

[jira] [Created] (YARN-5893) Experiment with using PriorityQueue for storing starved applications

2016-11-16 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5893: -- Summary: Experiment with using PriorityQueue for storing starved applications Key: YARN-5893 URL: https://issues.apache.org/jira/browse/YARN-5893 Project: Hadoop

[jira] [Updated] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5885: --- Attachment: yarn-5885.YARN-4752.4.patch Updated patch to address Daniels' latest round of comme

[jira] [Updated] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4752: --- Attachment: yarn-4752.4.patch Updated cumulative patch after YARN-5885 got committed. This patc

<    4   5   6   7   8   9   10   11   12   13   >