[jira] [Commented] (YARN-4333) Fair scheduler should support preemption within queue

[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15162904#comment-15162904 ] Ashwin Shankar commented on YARN-4333: -- I'm out of town until end of this week. Will t

[jira] [Commented] (YARN-1961) Fair scheduler preemption doesn't work for non-leaf queues

[ https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187429#comment-15187429 ] Ashwin Shankar commented on YARN-1961: -- Sure, please feel to close this. > Fair sched

[jira] [Commented] (YARN-1961) Fair scheduler preemption doesn't work for non-leaf queues

[ https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15187431#comment-15187431 ] Ashwin Shankar commented on YARN-1961: -- s/feel/feel free > Fair scheduler preemption

[jira] [Updated] (YARN-4975) Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues

[ https://issues.apache.org/jira/browse/YARN-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-4975: - Description: We upgraded our clusters to 2.7.2 from 2.4.1 and saw the following exception in RM lo

[jira] [Created] (YARN-4975) Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues

Ashwin Shankar created YARN-4975: Summary: Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues Key: YARN-4975 URL: https://issues.apache.org/jira/browse/YARN-4975

[jira] [Updated] (YARN-4975) Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues

[ https://issues.apache.org/jira/browse/YARN-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-4975: - Description: We upgraded our clusters to 2.7.2 from 2.4.1 and saw the following exception in RM lo

[jira] [Commented] (YARN-4767) Network issues can cause persistent RM UI outage

[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15299233#comment-15299233 ] Ashwin Shankar commented on YARN-4767: -- At Netflix we are hitting this issue pretty co

[jira] [Commented] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574928#comment-14574928 ] Ashwin Shankar commented on YARN-3453: -- hey folks, Looking into the patch, will get ba

[jira] [Commented] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14579588#comment-14579588 ] Ashwin Shankar commented on YARN-3453: -- hey Arun, Thanks for working on this ! Couple

[jira] [Commented] (YARN-4767) Network issues can cause persistent RM UI outage

[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322969#comment-15322969 ] Ashwin Shankar commented on YARN-4767: -- hey [~templedf], Thanks much for rebasing the

[jira] [Comment Edited] (YARN-4767) Network issues can cause persistent RM UI outage

[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322969#comment-15322969 ] Ashwin Shankar edited comment on YARN-4767 at 6/9/16 5:53 PM: --

[jira] [Comment Edited] (YARN-4767) Network issues can cause persistent RM UI outage

[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322969#comment-15322969 ] Ashwin Shankar edited comment on YARN-4767 at 6/9/16 6:49 PM: --

[jira] [Created] (YARN-4011) Jobs fail since nm-local-dir not cleaned up when rogue job fills up disk

Ashwin Shankar created YARN-4011: Summary: Jobs fail since nm-local-dir not cleaned up when rogue job fills up disk Key: YARN-4011 URL: https://issues.apache.org/jira/browse/YARN-4011 Project: Hadoop

[jira] [Commented] (YARN-4011) Jobs fail since nm-local-dir not cleaned up when rogue job fills up disk

[ https://issues.apache.org/jira/browse/YARN-4011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652293#comment-14652293 ] Ashwin Shankar commented on YARN-4011: -- hey [~jlowe], have you encountered this issue

[jira] [Updated] (YARN-4011) Jobs fail since nm-local-dir not cleaned up when rogue job fills up disk

[ https://issues.apache.org/jira/browse/YARN-4011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-4011: - Description: We observed jobs failed since tasks couldn't launch on nodes due to "java.io.IOExcept

[jira] [Updated] (YARN-4011) Jobs fail since nm-local-dir not cleaned up when rogue job fills up disk

[ https://issues.apache.org/jira/browse/YARN-4011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-4011: - Description: We observed jobs failed since tasks couldn't launch on nodes due to "java.io.IOExcept

[jira] [Commented] (YARN-4011) Jobs fail since nm-local-dir not cleaned up when rogue job fills up disk

[ https://issues.apache.org/jira/browse/YARN-4011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653019#comment-14653019 ] Ashwin Shankar commented on YARN-4011: -- Thanks Jason, this is exactly what I was looki

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660404#comment-14660404 ] Ashwin Shankar commented on YARN-2098: -- [~sunilg], I saw that couple of tickets under

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660598#comment-14660598 ] Ashwin Shankar commented on YARN-3176: -- I believe [~ka...@cloudera.com] is right about

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660603#comment-14660603 ] Ashwin Shankar commented on YARN-3176: -- Sry, in my comment above I missed a closing ""

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660621#comment-14660621 ] Ashwin Shankar commented on YARN-2098: -- Thanks [~sunilg] ! Hey [~ywskycn], when you ge

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660760#comment-14660760 ] Ashwin Shankar commented on YARN-3176: -- [~l201514], Just trying to understand, what is

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660859#comment-14660859 ] Ashwin Shankar commented on YARN-3176: -- bq. In this case, MaxRunningAppEnforcer could

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660925#comment-14660925 ] Ashwin Shankar commented on YARN-3176: -- Yes, this is valid case when inheriting would

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661153#comment-14661153 ] Ashwin Shankar commented on YARN-3176: -- It depends on the use case, if a user has lots

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662056#comment-14662056 ] Ashwin Shankar commented on YARN-3176: -- There is still the UI issue with maxApp that y

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662228#comment-14662228 ] Ashwin Shankar commented on YARN-3176: -- Yeah, thats a problem. Maybe we should display

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662408#comment-14662408 ] Ashwin Shankar commented on YARN-3176: -- Yes agreed. > In Fair Scheduler, child queue

[jira] [Commented] (YARN-4120) FSAppAttempt.getResourceUsage() should not take preemptedResource into account

[ https://issues.apache.org/jira/browse/YARN-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14733916#comment-14733916 ] Ashwin Shankar commented on YARN-4120: -- [~ka...@cloudera.com], tracking usage and (usa

[jira] [Commented] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350017#comment-14350017 ] Ashwin Shankar commented on YARN-3111: -- [~ka...@cloudera.com], Yes when cluster capaci

[jira] [Commented] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14365722#comment-14365722 ] Ashwin Shankar commented on YARN-3111: -- bq. What do you guys think of overlaying CPU a

[jira] [Commented] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14365917#comment-14365917 ] Ashwin Shankar commented on YARN-3111: -- Hi [~ka...@cloudera.com] bq. For 4, what do yo

[jira] [Commented] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366002#comment-14366002 ] Ashwin Shankar commented on YARN-3111: -- Sounds good to me. > Fix ratio problem on Fai

[jira] [Commented] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14367563#comment-14367563 ] Ashwin Shankar commented on YARN-3111: -- I dont think 1 is done in the patch. My bad, I

[jira] [Updated] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-3111: - Attachment: parenttooltip.png > Fix ratio problem on FairScheduler page > -

[jira] [Commented] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369828#comment-14369828 ] Ashwin Shankar commented on YARN-3111: -- bq.This dominant resource type is decided by q

[jira] [Created] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

Ashwin Shankar created YARN-3453: Summary: Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing Key: YARN-3453 URL: https://issues.apache.org/jira/browse/YAR

[jira] [Commented] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14492792#comment-14492792 ] Ashwin Shankar commented on YARN-3453: -- [~peng.zhang], bq. Calculator should be config

[jira] [Commented] (YARN-2333) RM UI : show pending containers at cluster level in the application/scheduler page

[ https://issues.apache.org/jira/browse/YARN-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14523637#comment-14523637 ] Ashwin Shankar commented on YARN-2333: -- [~djp], it is definitely a nice feature to hav

[jira] [Commented] (YARN-4090) Make Collections.sort() more efficient by caching resource usage

[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16126309#comment-16126309 ] Ashwin Shankar commented on YARN-4090: -- [~zsl2007] [~yufeigu] is this patch going to b

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16594168#comment-16594168 ] Ashwin Shankar commented on YARN-2098: -- Hey [~ywskycn] [~templedf] any updates on thi

[jira] [Commented] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15849161#comment-15849161 ] Ashwin Shankar commented on YARN-4022: -- [~templedf],[~forrestchen],[~yufeigu], Whoever

[jira] [Created] (YARN-6636) Fair Scheduler: respect node labels at resource request level

Ashwin Shankar created YARN-6636: Summary: Fair Scheduler: respect node labels at resource request level Key: YARN-6636 URL: https://issues.apache.org/jira/browse/YARN-6636 Project: Hadoop YARN

[jira] [Updated] (YARN-6636) Fair Scheduler: respect node labels at resource request level

[ https://issues.apache.org/jira/browse/YARN-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-6636: - Description: This ticket is to track changes to fair scheduler to respect node labels at resource r

[jira] [Updated] (YARN-2540) Fair Scheduler : queue filters not working on scheduler page in RM UI

[ https://issues.apache.org/jira/browse/YARN-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2540: - Attachment: YARN-2540-v2.txt There is a case in which the filter can return wrong results : Say app

[jira] [Updated] (YARN-2540) Fair Scheduler : queue filters not working on scheduler page in RM UI

[ https://issues.apache.org/jira/browse/YARN-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2540: - Attachment: YARN-2540-v3.txt Updated the patch to take care of "same prefix" problem at parent queu

[jira] [Commented] (YARN-2540) Fair Scheduler : queue filters not working on scheduler page in RM UI

[ https://issues.apache.org/jira/browse/YARN-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143793#comment-14143793 ] Ashwin Shankar commented on YARN-2540: -- Hi [~kasha], when you get a chance can you ple

[jira] [Commented] (YARN-2540) FairScheduler: Queue filters not working on scheduler page in RM UI

[ https://issues.apache.org/jira/browse/YARN-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143980#comment-14143980 ] Ashwin Shankar commented on YARN-2540: -- Thanks [~kasha], [~ywskycn] ! > FairScheduler

[jira] [Commented] (YARN-1913) With Fair Scheduler, cluster can logjam when all resources are consumed by AMs

[ https://issues.apache.org/jira/browse/YARN-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14014357#comment-14014357 ] Ashwin Shankar commented on YARN-1913: -- Hey [~sandyr], quick comment bq.I think it mi

[jira] [Commented] (YARN-2120) Coloring queues running over minShare on RM Scheduler page

[ https://issues.apache.org/jira/browse/YARN-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14016027#comment-14016027 ] Ashwin Shankar commented on YARN-2120: -- [~l201514], It would be helpful if we don't re

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14016050#comment-14016050 ] Ashwin Shankar commented on YARN-2026: -- Hi [~sandyr], did you have any comments ? bas

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14016191#comment-14016191 ] Ashwin Shankar commented on YARN-2026: -- [~sandyr], Sure Sandy I'll patiently wait for

[jira] [Commented] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026839#comment-14026839 ] Ashwin Shankar commented on YARN-2134: -- Hi [~octo47], In your patch,there seems to be

[jira] [Commented] (YARN-2151) FairScheduler option for global preemption within hierarchical queues

[ https://issues.apache.org/jira/browse/YARN-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14030057#comment-14030057 ] Ashwin Shankar commented on YARN-2151: -- Hi [~octo47], Couple of questions : 1. The fir

[jira] [Created] (YARN-2162) Fair Scheduler :ability to configure minResources and maxResources in terms of percentage

Ashwin Shankar created YARN-2162: Summary: Fair Scheduler :ability to configure minResources and maxResources in terms of percentage Key: YARN-2162 URL: https://issues.apache.org/jira/browse/YARN-2162

[jira] [Updated] (YARN-2162) Fair Scheduler :ability to configure minResources and maxResources in terms of percentage

[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2162: - Description: minResources and maxResources in fair scheduler configs are expressed in terms of ab

[jira] [Updated] (YARN-2162) Fair Scheduler :ability to optionally configure minResources and maxResources in terms of percentage

[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2162: - Summary: Fair Scheduler :ability to optionally configure minResources and maxResources in terms of

[jira] [Commented] (YARN-2162) Fair Scheduler :ability to optionally configure minResources and maxResources in terms of percentage

[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034019#comment-14034019 ] Ashwin Shankar commented on YARN-2162: -- [~maysamyabandeh], yes that was the intention.

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14037647#comment-14037647 ] Ashwin Shankar commented on YARN-2026: -- [~sandyr], Sure. Just to be on the same page,I

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14038047#comment-14038047 ] Ashwin Shankar commented on YARN-2026: -- [~sandyr], makes sense. I'll post a patch soon

[jira] [Created] (YARN-2214) preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

Ashwin Shankar created YARN-2214: Summary: preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness Key: YARN-2214 URL: https://issues.apache.org/jira/browse/YARN-2214 Project:

[jira] [Assigned] (YARN-2214) preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

[ https://issues.apache.org/jira/browse/YARN-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar reassigned YARN-2214: Assignee: Ashwin Shankar > preemptContainerPreCheck() in FSParentQueue delays convergence to

[jira] [Updated] (YARN-2214) preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

[ https://issues.apache.org/jira/browse/YARN-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2214: - Attachment: YARN-2214-v1.txt Attached patch removes preemptContainerPreCheck from FSParentQueue.Ad

[jira] [Commented] (YARN-2214) preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

[ https://issues.apache.org/jira/browse/YARN-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14044964#comment-14044964 ] Ashwin Shankar commented on YARN-2214: -- test failure not related to this patch. There

[jira] [Updated] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2026: - Attachment: YARN-2026-v2.txt Attached patch implements two new scheduling policies - FairShareAct

[jira] [Created] (YARN-2218) TestSubmitApplicationWithRMHA fails intermittently in trunk

Ashwin Shankar created YARN-2218: Summary: TestSubmitApplicationWithRMHA fails intermittently in trunk Key: YARN-2218 URL: https://issues.apache.org/jira/browse/YARN-2218 Project: Hadoop YARN

[jira] [Created] (YARN-2219) TestWorkPreservingRMRestart fails intermittently on trunk

Ashwin Shankar created YARN-2219: Summary: TestWorkPreservingRMRestart fails intermittently on trunk Key: YARN-2219 URL: https://issues.apache.org/jira/browse/YARN-2219 Project: Hadoop YARN I

[jira] [Created] (YARN-2220) TestAMRestart#testAMPreemptedNotCountedForAMFailures times out on trunk intermittently

Ashwin Shankar created YARN-2220: Summary: TestAMRestart#testAMPreemptedNotCountedForAMFailures times out on trunk intermittently Key: YARN-2220 URL: https://issues.apache.org/jira/browse/YARN-2220 Pr

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14045401#comment-14045401 ] Ashwin Shankar commented on YARN-2026: -- Test failures are unrelated to the patch.First

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14051954#comment-14051954 ] Ashwin Shankar commented on YARN-2026: -- [~sandyr], did you have any comments ? > Fair

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14055326#comment-14055326 ] Ashwin Shankar commented on YARN-2026: -- [~sandyr],[~kasha] Sure, we can incorporate fa

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14055861#comment-14055861 ] Ashwin Shankar commented on YARN-2026: -- [~kasha], I see your point. I had a quick chat

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061296#comment-14061296 ] Ashwin Shankar commented on YARN-2026: -- Thanks [~sandyr],[~kasha] - I'll create a sepa

[jira] [Created] (YARN-2333) RM UI : show pending containers at cluster level in the application/scheduler page

Ashwin Shankar created YARN-2333: Summary: RM UI : show pending containers at cluster level in the application/scheduler page Key: YARN-2333 URL: https://issues.apache.org/jira/browse/YARN-2333 Projec

[jira] [Commented] (YARN-2214) preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

[ https://issues.apache.org/jira/browse/YARN-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072409#comment-14072409 ] Ashwin Shankar commented on YARN-2214: -- [~kasha], [~sandyr] Can one of you please look

[jira] [Updated] (YARN-2214) preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

[ https://issues.apache.org/jira/browse/YARN-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2214: - Attachment: YARN-2214-v2.txt > preemptContainerPreCheck() in FSParentQueue delays convergence towa

[jira] [Commented] (YARN-2214) preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

[ https://issues.apache.org/jira/browse/YARN-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074039#comment-14074039 ] Ashwin Shankar commented on YARN-2214: -- Thanks [~kasha] ! Patch refreshed. > preemptC

[jira] [Commented] (YARN-2214) FairScheduler: preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

[ https://issues.apache.org/jira/browse/YARN-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074548#comment-14074548 ] Ashwin Shankar commented on YARN-2214: -- Thanks Karthik ! > FairScheduler: preemptCont

[jira] [Created] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

Ashwin Shankar created YARN-2360: Summary: Fair Scheduler : Display dynamic fair share for queues on the scheduler page Key: YARN-2360 URL: https://issues.apache.org/jira/browse/YARN-2360 Project: Had

[jira] [Updated] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2026: - Attachment: YARN-2026-v3.txt > Fair scheduler : Fair share for inactive queues causes unfair alloc

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075011#comment-14075011 ] Ashwin Shankar commented on YARN-2026: -- Incorporated [~kasha] suggestion of having two

[jira] [Assigned] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar reassigned YARN-2360: Assignee: Ashwin Shankar > Fair Scheduler : Display dynamic fair share for queues on the sch

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2360: - Attachment: YARN-2360-v1.txt > Fair Scheduler : Display dynamic fair share for queues on the sched

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2360: - Attachment: Screen Shot 2014-07-28 at 1.12.19 PM.png > Fair Scheduler : Display dynamic fair share

[jira] [Commented] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14077125#comment-14077125 ] Ashwin Shankar commented on YARN-2360: -- Attached screenshot and patch for UI changes t

[jira] [Commented] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14077211#comment-14077211 ] Ashwin Shankar commented on YARN-2360: -- Expected -1 from Jenkins since patch depends o

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14077218#comment-14077218 ] Ashwin Shankar commented on YARN-2026: -- [~kasha],[~sandyr] , did you have any comments

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2360: - Attachment: YARN-2360-v2.txt > Fair Scheduler : Display dynamic fair share for queues on the sched

[jira] [Created] (YARN-2393) Fair Scheduler : Implement static fair share

Ashwin Shankar created YARN-2393: Summary: Fair Scheduler : Implement static fair share Key: YARN-2393 URL: https://issues.apache.org/jira/browse/YARN-2393 Project: Hadoop YARN Issue Type: Im

[jira] [Updated] (YARN-2394) Fair Scheduler : ability to configure fairSharePreemptionThreshold per queue

[ https://issues.apache.org/jira/browse/YARN-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2394: - Issue Type: New Feature (was: Improvement) > Fair Scheduler : ability to configure fairSharePreem

[jira] [Created] (YARN-2394) Fair Scheduler : ability to configure fairSharePreemptionThreshold per queue

Ashwin Shankar created YARN-2394: Summary: Fair Scheduler : ability to configure fairSharePreemptionThreshold per queue Key: YARN-2394 URL: https://issues.apache.org/jira/browse/YARN-2394 Project: Had

[jira] [Created] (YARN-2395) Fair Scheduler : implement fair share preemption at parent queue based on fairSharePreemptionTimeout

Ashwin Shankar created YARN-2395: Summary: Fair Scheduler : implement fair share preemption at parent queue based on fairSharePreemptionTimeout Key: YARN-2395 URL: https://issues.apache.org/jira/browse/YARN-2395

[jira] [Updated] (YARN-2393) Fair Scheduler : Implement static fair share

[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2393: - Description: Static fair share is a fair share allocation considering all(active/inactive) queues

[jira] [Updated] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2026: - Attachment: YARN-2026-v4.txt > Fair scheduler : Fair share for inactive queues causes unfair alloc

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14089907#comment-14089907 ] Ashwin Shankar commented on YARN-2026: -- Based on an offline discussion with [~kasha],

[jira] [Commented] (YARN-2395) Fair Scheduler : implement fair share preemption at parent queue based on fairSharePreemptionTimeout

[ https://issues.apache.org/jira/browse/YARN-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090039#comment-14090039 ] Ashwin Shankar commented on YARN-2395: -- I felt having timeout per queue would give mor

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement static fair share

[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091177#comment-14091177 ] Ashwin Shankar commented on YARN-2393: -- hey [~ywskycn], please go ahead. > Fair Sched

[jira] [Updated] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2026: - Attachment: YARN-2026-v5.txt > Fair scheduler : Fair share for inactive queues causes unfair alloc

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091308#comment-14091308 ] Ashwin Shankar commented on YARN-2026: -- Thanks [~kasha]. All comments addressed in v5

[jira] [Commented] (YARN-2026) Fair scheduler: Consider only active queues for computing fairshare

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091609#comment-14091609 ] Ashwin Shankar commented on YARN-2026: -- Thanks a lot [~kasha], [~sandyr] for reviewing

  1   2   >