[jira] [Commented] (YARN-4492) Add documentation for preemption supported in Capacity scheduler

2016-01-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15094506#comment-15094506 ] Eric Payne commented on YARN-4492: -- Thanks for updating the patch so quickly, [~Naganarasi

[jira] [Commented] (YARN-4492) Add documentation for preemption supported in Capacity scheduler

2016-01-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15094908#comment-15094908 ] Eric Payne commented on YARN-4492: -- Thanks [~Naganarasimha]. +1 (non-binding) > Add docu

[jira] [Updated] (YARN-2024) IOException in AppLogAggregatorImpl does not give stacktrace and leaves aggregated TFile in a bad state.

2016-01-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2024: - Priority: Major (was: Critical) > IOException in AppLogAggregatorImpl does not give stacktrace and leaves

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-01-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096538#comment-15096538 ] Eric Payne commented on YARN-2009: -- {quote} Sunil G, pardon the long delay... From what yo

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-01-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096540#comment-15096540 ] Eric Payne commented on YARN-2009: -- bq. And, of course, all of this will probably have to

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-01-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096620#comment-15096620 ] Eric Payne commented on YARN-2009: -- Thanks [~sunilg]. One more note is that YARN-2113 was

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-01-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097113#comment-15097113 ] Eric Payne commented on YARN-4108: -- [~leftnoteasy], just a couple of quick things. {{YARN

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-01-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15098341#comment-15098341 ] Eric Payne commented on YARN-4108: -- bq. Do you have any comments/suggestions about the lat

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-01-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15099088#comment-15099088 ] Eric Payne commented on YARN-4108: -- [~leftnoteasy], great job! This approach looks like it

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-01-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15102200#comment-15102200 ] Eric Payne commented on YARN-4108: -- [~leftnoteasy], thanks for your reply. {quote} bq. don

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-01-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111605#comment-15111605 ] Eric Payne commented on YARN-4108: -- Thanks for the updated patch, [~leftnoteasy]. I'm sti

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-02-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127182#comment-15127182 ] Eric Payne commented on YARN-4108: -- Thanks [~leftnoteasy] for your work on the new patch,

[jira] [Commented] (YARN-3769) Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler

2016-02-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15131146#comment-15131146 ] Eric Payne commented on YARN-3769: -- Thanks [~djp]] I will look into it. > Consider user l

[jira] [Updated] (YARN-3769) Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler

2016-02-04 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3769: - Attachment: YARN-3769-branch-2.6.002.patch bq. Hi Eric Payne, it looks like the patch for branch-2.6 has so

[jira] [Commented] (YARN-1515) Provide ContainerManagementProtocol#signalContainer processing a batch of signals

2016-02-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143523#comment-15143523 ] Eric Payne commented on YARN-1515: -- Hi [~jira.shegalov]. I would like to see this function

[jira] [Commented] (YARN-1515) Provide ContainerManagementProtocol#signalContainer processing a batch of signals

2016-02-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15144578#comment-15144578 ] Eric Payne commented on YARN-1515: -- Sorry, I meant to post the above comment on MAPREDUCE-

[jira] [Commented] (YARN-4481) negative pending resource of queues lead to applications in accepted status inifnitly

2016-02-26 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15169550#comment-15169550 ] Eric Payne commented on YARN-4481: -- Not sure if this is related, but we are also seeing si

[jira] [Created] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-03-01 Thread Eric Payne (JIRA)
Eric Payne created YARN-4751: Summary: In 2.7, Labeled queue usage not shown properly in capacity scheduler UI Key: YARN-4751 URL: https://issues.apache.org/jira/browse/YARN-4751 Project: Hadoop YARN

[jira] [Updated] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-03-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4751: - Attachment: 2.7 CS UI No BarGraph.jpg In the attached screenshot, please note that the {{Used Capacity}}, {

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-03-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15174314#comment-15174314 ] Eric Payne commented on YARN-4751: -- Thanks, [~sunilg] for pointing out YARN-4304. I see th

[jira] [Updated] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-03-04 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4751: - Attachment: YARH-4752-branch-2.7.001.patch [~sunilg], perhaps we don't need the whole patch from YARN-4304.

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-03-04 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15180687#comment-15180687 ] Eric Payne commented on YARN-4751: -- {quote} In that patch, I added one method in AbstractC

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15189576#comment-15189576 ] Eric Payne commented on YARN-4686: -- [~ebadger], Thanks for working on a fix this issue. T

[jira] [Updated] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-03-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4751: - Attachment: YARH-4752-branch-2.7.002.patch Attaching {{YARH-4752-branch-2.7.002.patch}}. It addresses some

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-03-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15193832#comment-15193832 ] Eric Payne commented on YARN-4751: -- Thanks, [~sunilg]. I will look into trunk's version of

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196270#comment-15196270 ] Eric Payne commented on YARN-4686: -- [~ebadger], thanks for updating this patch. Just one m

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15196551#comment-15196551 ] Eric Payne commented on YARN-4108: -- Thanks, [~leftnoteasy], for all of the great effort on

[jira] [Reopened] (YARN-4390) Consider container request size during CS preemption

2016-03-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-4390: -- Assignee: Wangda Tan (was: Eric Payne) {quote} Since YARN-4108 doesn't solve all the issues. (I planne

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198081#comment-15198081 ] Eric Payne commented on YARN-4686: -- Thanks, [~ebadger], for this patch. +1 LGTM. I will w

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201886#comment-15201886 ] Eric Payne commented on YARN-4686: -- [~ebadger], Thanks for the work you have done resolvin

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-20 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198436#comment-15198436 ] Eric Payne commented on YARN-4108: -- Thanks, [~leftnoteasy]. The patch looks good to me. >

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-03-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15206963#comment-15206963 ] Eric Payne commented on YARN-4751: -- {quote} Yes, agreeing to the point that we have to agg

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208653#comment-15208653 ] Eric Payne commented on YARN-4686: -- {quote} Hi Eric Badger and Eric Payne, TestMRJobs#test

[jira] [Commented] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

2016-03-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15210867#comment-15210867 ] Eric Payne commented on YARN-4117: -- [~giovanni.fumarola], thanks for bringing this to my a

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-03-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15215015#comment-15215015 ] Eric Payne commented on YARN-4751: -- Thank you very much, [~leftnoteasy]! {quote} 1) The ul

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-03-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15218335#comment-15218335 ] Eric Payne commented on YARN-4751: -- [~leftnoteasy] / [~sunilg]: YARN-3362 (Add node label

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-04-04 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15224433#comment-15224433 ] Eric Payne commented on YARN-4751: -- bq. As mentioned, we are not setting usedCapacity per

[jira] [Updated] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-04-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4751: - Attachment: YARN-4751-branch-2.7.003.patch Thank you, [~leftnoteasy] and [~sunilg], for your reviews and he

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2016-04-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235451#comment-15235451 ] Eric Payne commented on YARN-2113: -- [~vinodkv], have you had any chance to think about the

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2016-04-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235611#comment-15235611 ] Eric Payne commented on YARN-2113: -- {quote} Vinod Kumar Vavilapalli, have you had any chan

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2016-04-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15237578#comment-15237578 ] Eric Payne commented on YARN-2113: -- bq. I planned to work on YARN-4781 soon but I'm workin

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-04-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15240016#comment-15240016 ] Eric Payne commented on YARN-4751: -- Thanks for the suggestion [~sunilg]: bq. Is it better

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-04-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15240046#comment-15240046 ] Eric Payne commented on YARN-4751: -- bq. Is it better to have YARN-3362 2.7 version patch t

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-04-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241650#comment-15241650 ] Eric Payne commented on YARN-4751: -- {quote} f I understand correctly, what Sunil G suggest

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

2016-04-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241683#comment-15241683 ] Eric Payne commented on YARN-4945: -- Thanks [~leftnoteasy]. I have seen the following use c

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-04-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241898#comment-15241898 ] Eric Payne commented on YARN-4751: -- Thanks [~leftnoteasy], [~sunilg]. I think there are en

[jira] [Updated] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-04-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3362: - Attachment: YARN-3362-branch-2.7.002.patch [~leftnoteasy] and [~sunilg], as we discussed in YARN-4751, I am

[jira] [Updated] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-04-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4751: - Attachment: YARN-4751-branch-2.7.004.patch [~leftnoteasy] / [~sunilg]. Thanks for your help on this issue.

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-04-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15242992#comment-15242992 ] Eric Payne commented on YARN-4751: -- bq. YARN-4751 does not apply to branch-2.7. Rebase req

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-04-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245610#comment-15245610 ] Eric Payne commented on YARN-3362: -- {quote} - When i submit a app to a queue with default

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-04-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15245728#comment-15245728 ] Eric Payne commented on YARN-3362: -- {quote} After applying the patch then partition usage

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-04-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251820#comment-15251820 ] Eric Payne commented on YARN-3362: -- {quote} bq. If you think it would be cleaner, I can co

[jira] [Commented] (YARN-4556) TestFifoScheduler.testResourceOverCommit fails

2016-04-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252732#comment-15252732 ] Eric Payne commented on YARN-4556: -- +1 > TestFifoScheduler.testResourceOverCommit fails

[jira] [Commented] (YARN-4390) Consider container request size during CS preemption

2016-04-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252803#comment-15252803 ] Eric Payne commented on YARN-4390: -- Thanks, [~leftnoteasy], for the detailed work on this

[jira] [Commented] (YARN-4390) Consider container request size during CS preemption

2016-04-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15253884#comment-15253884 ] Eric Payne commented on YARN-4390: -- {quote} And since it uses R/W lock, write lock will be

[jira] [Updated] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-04-26 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4390: - Attachment: QueueNotHittingMax.jpg Hi [~leftnoteasy]. I have been testing YARN-4390.6.patch. I have tried s

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-04-27 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260985#comment-15260985 ] Eric Payne commented on YARN-4390: -- [~leftnoteasy], {quote} have you set following config?

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-04-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262659#comment-15262659 ] Eric Payne commented on YARN-3362: -- [~naganarasimha...@apache.org], is there any update?

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-04-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263164#comment-15263164 ] Eric Payne commented on YARN-4390: -- [~leftnoteasy], I am seeing kind of corner case in my

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-04-29 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264172#comment-15264172 ] Eric Payne commented on YARN-4390: -- [~leftnoteasy] bq. What's your idea about this case? S

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-04-29 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15264250#comment-15264250 ] Eric Payne commented on YARN-4390: -- [~jlowe] pointed out to me offline that it is probably

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-05-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15266555#comment-15266555 ] Eric Payne commented on YARN-4390: -- bq. Long term solution should be fixing YARN-4280. Agr

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-05-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267203#comment-15267203 ] Eric Payne commented on YARN-3362: -- Thanks a lot, [~Naganarasimha]. I don't think the YAR

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-05-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267205#comment-15267205 ] Eric Payne commented on YARN-3362: -- {noformat} Processing: YARN-3362 YARN-3362 patch is be

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-05-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272503#comment-15272503 ] Eric Payne commented on YARN-4390: -- Sorry, [~leftnoteasy], for the delay. +1. LGTM (+) >

[jira] [Updated] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-05-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3362: - Attachment: YARN-3362-branch-2.7.003.patch [~Naganarasimha]], uploading YARN-3362-branch-2.7.003.patch Mos

[jira] [Updated] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-05-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3362: - Attachment: YARN-3362-branch-2.7.004.patch [~Naganarasimha], attaching YARN-3362-branch-2.7.004.patch with

[jira] [Commented] (YARN-4768) getAvailablePhysicalMemorySize can be inaccurate on linux

2016-05-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15276849#comment-15276849 ] Eric Payne commented on YARN-4768: -- bq. "Inactive(file)" would seem more accurate but it's

[jira] [Commented] (YARN-4768) getAvailablePhysicalMemorySize can be inaccurate on linux

2016-05-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278366#comment-15278366 ] Eric Payne commented on YARN-4768: -- The fix LGTM. +1 > getAvailablePhysicalMemorySize can

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-05-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282689#comment-15282689 ] Eric Payne commented on YARN-3362: -- Thanks, [~naganarasimha...@apache.org]. Have you been

[jira] [Commented] (YARN-5069) TestFifoScheduler.testResourceOverCommit race condition

2016-05-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15285244#comment-15285244 ] Eric Payne commented on YARN-5069: -- +1. Committing > TestFifoScheduler.testResourceOverCo

[jira] [Updated] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-05-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4751: - Attachment: YARN-4751-branch-2.7.005.patch Thanks, [~Naganarasimha]. You are correct, most of the findbugs

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

2016-05-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300175#comment-15300175 ] Eric Payne commented on YARN-4751: -- Thanks [~Naganarasimha]! > In 2.7, Labeled queue usag

[jira] [Assigned] (YARN-4459) container-executor might kill process wrongly

2016-05-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-4459: Assignee: Eric Payne (was: Jun Gong) > container-executor might kill process wrongly >

[jira] [Updated] (YARN-4459) container-executor might kill process wrongly

2016-05-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4459: - Assignee: Jun Gong (was: Eric Payne) > container-executor might kill process wrongly > ---

[jira] [Commented] (YARN-4459) container-executor might kill process wrongly

2016-05-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300266#comment-15300266 ] Eric Payne commented on YARN-4459: -- Thanks [~hex108] for the fix and [~jlowe] for the upda

[jira] [Commented] (YARN-5116) Failed to execute "yarn application"

2016-05-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300802#comment-15300802 ] Eric Payne commented on YARN-5116: -- Thanks, [~hex108], for reporting this issue and provid

[jira] [Commented] (YARN-5116) Failed to execute "yarn application"

2016-05-26 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302868#comment-15302868 ] Eric Payne commented on YARN-5116: -- Thanks [~sunilg] and [~aw] for your reviews. [~hex108

[jira] [Created] (YARN-4217) Failed AM attempt retries on same failed host

2015-10-01 Thread Eric Payne (JIRA)
Eric Payne created YARN-4217: Summary: Failed AM attempt retries on same failed host Key: YARN-4217 URL: https://issues.apache.org/jira/browse/YARN-4217 Project: Hadoop YARN Issue Type: Improveme

[jira] [Commented] (YARN-4217) Failed AM attempt retries on same failed host

2015-10-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940016#comment-14940016 ] Eric Payne commented on YARN-4217: -- One way to fix this would be by blacklisting the bad n

[jira] [Resolved] (YARN-4217) Failed AM attempt retries on same failed host

2015-10-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved YARN-4217. -- Resolution: Duplicate bq. Eric Payne - is this a duplicate of YARN-2005? [~vvasudev], yes it is. I did do

[jira] [Commented] (YARN-3216) Max-AM-Resource-Percentage should respect node labels

2015-10-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14942434#comment-14942434 ] Eric Payne commented on YARN-3216: -- Hi [~sunilg], [~leftnoteasy], and [~Naganarasimha]. Th

[jira] [Updated] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-10-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3769: - Attachment: YARN-3769-branch-2.7.002.patch YARN-3769-branch-2.002.patch Thank you very much

[jira] [Updated] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-10-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3769: - Attachment: (was: YARN-3769-branch-2.002.patch) > Preemption occurring unnecessarily because preemption

[jira] [Updated] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-10-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3769: - Attachment: YARN-3769-branch-2.002.patch > Preemption occurring unnecessarily because preemption doesn't co

[jira] [Created] (YARN-4225) Add preemption status to {{yarn queue -status}}

2015-10-05 Thread Eric Payne (JIRA)
Eric Payne created YARN-4225: Summary: Add preemption status to {{yarn queue -status}} Key: YARN-4225 URL: https://issues.apache.org/jira/browse/YARN-4225 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-4225) Add preemption status to yarn queue -status

2015-10-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4225: - Summary: Add preemption status to yarn queue -status (was: Add preemption status to {{yarn queue -status}}

[jira] [Updated] (YARN-4225) Add preemption status to yarn queue -status for capacity scheduler

2015-10-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4225: - Component/s: capacity scheduler > Add preemption status to yarn queue -status for capacity scheduler >

[jira] [Created] (YARN-4226) Make capacity scheduler queue's preemption status REST API consistent with GUI

2015-10-05 Thread Eric Payne (JIRA)
Eric Payne created YARN-4226: Summary: Make capacity scheduler queue's preemption status REST API consistent with GUI Key: YARN-4226 URL: https://issues.apache.org/jira/browse/YARN-4226 Project: Hadoop YA

[jira] [Updated] (YARN-4225) Add preemption status to yarn queue -status for capacity scheduler

2015-10-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4225: - Summary: Add preemption status to yarn queue -status for capacity scheduler (was: Add preemption status to

[jira] [Commented] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-10-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947847#comment-14947847 ] Eric Payne commented on YARN-3769: -- Investigating test failures and checkstyle warnings >

[jira] [Updated] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-10-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3769: - Attachment: YARN-3769.003.patch YARN-3769-branch-2.7.003.patch [~leftnoteasy], Thanks for a

[jira] [Updated] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-10-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3769: - Attachment: (was: YARN-3769.003.patch) > Preemption occurring unnecessarily because preemption doesn't

[jira] [Updated] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-10-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3769: - Attachment: YARN-3769.003.patch > Preemption occurring unnecessarily because preemption doesn't consider us

[jira] [Updated] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-11-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3769: - Attachment: YARN-3769.004.patch [~leftnoteasy], Thank you for your review, and sorry for the late reply. {

[jira] [Commented] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-11-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14987842#comment-14987842 ] Eric Payne commented on YARN-3769: -- Tests {{hadoop.yarn.server.resourcemanager.TestClientR

[jira] [Commented] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-11-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996886#comment-14996886 ] Eric Payne commented on YARN-3769: -- bq. you don't need to do componmentwiseMax here, since

[jira] [Updated] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-11-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3769: - Attachment: YARN-3769.005.patch [~leftnoteasy], Attaching YARN-3769.005.patch with the changes we discussed

[jira] [Updated] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-11-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3769: - Attachment: YARN-3769-branch-2.7.005.patch Unit tests {{TestAMAuthorization}} {{TestClientRMTokens}} {{Test

[jira] [Commented] (YARN-4226) Make capacity scheduler queue's preemption status REST API consistent with GUI

2015-11-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004297#comment-15004297 ] Eric Payne commented on YARN-4226: -- Since the {{preemptionDisabled}} tag has already shipp

<    2   3   4   5   6   7   8   9   10   11   >