[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594168#comment-16594168 ] Ashwin Shankar commented on YARN-2098: -- Hey [~ywskycn] [~templedf] any updates on this one? > App

[jira] [Commented] (YARN-4090) Make Collections.sort() more efficient by caching resource usage

[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126309#comment-16126309 ] Ashwin Shankar commented on YARN-4090: -- [~zsl2007] [~yufeigu] is this patch going to be committed?

[jira] [Updated] (YARN-6636) Fair Scheduler: respect node labels at resource request level

[ https://issues.apache.org/jira/browse/YARN-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-6636: - Description: This ticket is to track changes to fair scheduler to respect node labels at resource

[jira] [Created] (YARN-6636) Fair Scheduler: respect node labels at resource request level

Ashwin Shankar created YARN-6636: Summary: Fair Scheduler: respect node labels at resource request level Key: YARN-6636 URL: https://issues.apache.org/jira/browse/YARN-6636 Project: Hadoop YARN

[jira] [Commented] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15849161#comment-15849161 ] Ashwin Shankar commented on YARN-4022: -- [~templedf],[~forrestchen],[~yufeigu], Whoever is planning to

[jira] [Comment Edited] (YARN-4767) Network issues can cause persistent RM UI outage

[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322969#comment-15322969 ] Ashwin Shankar edited comment on YARN-4767 at 6/9/16 6:49 PM: -- hey

[jira] [Comment Edited] (YARN-4767) Network issues can cause persistent RM UI outage

[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322969#comment-15322969 ] Ashwin Shankar edited comment on YARN-4767 at 6/9/16 5:53 PM: -- hey

[jira] [Commented] (YARN-4767) Network issues can cause persistent RM UI outage

[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322969#comment-15322969 ] Ashwin Shankar commented on YARN-4767: -- hey [~templedf], Thanks much for rebasing the patch! Just to

[jira] [Commented] (YARN-4767) Network issues can cause persistent RM UI outage

[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15299233#comment-15299233 ] Ashwin Shankar commented on YARN-4767: -- At Netflix we are hitting this issue pretty consistently and

[jira] [Updated] (YARN-4975) Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues

[ https://issues.apache.org/jira/browse/YARN-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-4975: - Description: We upgraded our clusters to 2.7.2 from 2.4.1 and saw the following exception in RM

[jira] [Created] (YARN-4975) Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues

Ashwin Shankar created YARN-4975: Summary: Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues Key: YARN-4975 URL: https://issues.apache.org/jira/browse/YARN-4975

[jira] [Updated] (YARN-4975) Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues

[ https://issues.apache.org/jira/browse/YARN-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-4975: - Description: We upgraded our clusters to 2.7.2 from 2.4.1 and saw the following exception in RM

[jira] [Commented] (YARN-1961) Fair scheduler preemption doesn't work for non-leaf queues

[ https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187431#comment-15187431 ] Ashwin Shankar commented on YARN-1961: -- s/feel/feel free > Fair scheduler preemption doesn't work for

[jira] [Commented] (YARN-1961) Fair scheduler preemption doesn't work for non-leaf queues

[ https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187429#comment-15187429 ] Ashwin Shankar commented on YARN-1961: -- Sure, please feel to close this. > Fair scheduler preemption

[jira] [Commented] (YARN-4333) Fair scheduler should support preemption within queue

[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15162904#comment-15162904 ] Ashwin Shankar commented on YARN-4333: -- I'm out of town until end of this week. Will take a look when

[jira] [Commented] (YARN-4120) FSAppAttempt.getResourceUsage() should not take preemptedResource into account

[ https://issues.apache.org/jira/browse/YARN-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733916#comment-14733916 ] Ashwin Shankar commented on YARN-4120: -- [~ka...@cloudera.com], tracking usage and (usage - preemption)

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662408#comment-14662408 ] Ashwin Shankar commented on YARN-3176: -- Yes agreed. In Fair Scheduler, child queue

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662228#comment-14662228 ] Ashwin Shankar commented on YARN-3176: -- Yeah, thats a problem. Maybe we should display

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662056#comment-14662056 ] Ashwin Shankar commented on YARN-3176: -- There is still the UI issue with maxApp that

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660760#comment-14660760 ] Ashwin Shankar commented on YARN-3176: -- [~l201514], Just trying to understand, what is

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660859#comment-14660859 ] Ashwin Shankar commented on YARN-3176: -- bq. In this case, MaxRunningAppEnforcer could

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661153#comment-14661153 ] Ashwin Shankar commented on YARN-3176: -- It depends on the use case, if a user has lots

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660925#comment-14660925 ] Ashwin Shankar commented on YARN-3176: -- Yes, this is valid case when inheriting would

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660621#comment-14660621 ] Ashwin Shankar commented on YARN-2098: -- Thanks [~sunilg] ! Hey [~ywskycn], when you

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660598#comment-14660598 ] Ashwin Shankar commented on YARN-3176: -- I believe [~ka...@cloudera.com] is right about

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660603#comment-14660603 ] Ashwin Shankar commented on YARN-3176: -- Sry, in my comment above I missed a closing

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660404#comment-14660404 ] Ashwin Shankar commented on YARN-2098: -- [~sunilg], I saw that couple of tickets under

[jira] [Commented] (YARN-4011) Jobs fail since nm-local-dir not cleaned up when rogue job fills up disk

[ https://issues.apache.org/jira/browse/YARN-4011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653019#comment-14653019 ] Ashwin Shankar commented on YARN-4011: -- Thanks Jason, this is exactly what I was

[jira] [Created] (YARN-4011) Jobs fail since nm-local-dir not cleaned up when rogue job fills up disk

Ashwin Shankar created YARN-4011: Summary: Jobs fail since nm-local-dir not cleaned up when rogue job fills up disk Key: YARN-4011 URL: https://issues.apache.org/jira/browse/YARN-4011 Project: Hadoop

[jira] [Commented] (YARN-4011) Jobs fail since nm-local-dir not cleaned up when rogue job fills up disk

[ https://issues.apache.org/jira/browse/YARN-4011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652293#comment-14652293 ] Ashwin Shankar commented on YARN-4011: -- hey [~jlowe], have you encountered this issue

[jira] [Updated] (YARN-4011) Jobs fail since nm-local-dir not cleaned up when rogue job fills up disk

[ https://issues.apache.org/jira/browse/YARN-4011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-4011: - Description: We observed jobs failed since tasks couldn't launch on nodes due to

[jira] [Updated] (YARN-4011) Jobs fail since nm-local-dir not cleaned up when rogue job fills up disk

[ https://issues.apache.org/jira/browse/YARN-4011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-4011: - Description: We observed jobs failed since tasks couldn't launch on nodes due to

[jira] [Commented] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579588#comment-14579588 ] Ashwin Shankar commented on YARN-3453: -- hey Arun, Thanks for working on this ! Couple

[jira] [Commented] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574928#comment-14574928 ] Ashwin Shankar commented on YARN-3453: -- hey folks, Looking into the patch, will get

[jira] [Commented] (YARN-2333) RM UI : show pending containers at cluster level in the application/scheduler page

[ https://issues.apache.org/jira/browse/YARN-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523637#comment-14523637 ] Ashwin Shankar commented on YARN-2333: -- [~djp], it is definitely a nice feature to

[jira] [Commented] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492792#comment-14492792 ] Ashwin Shankar commented on YARN-3453: -- [~peng.zhang], bq. Calculator should be

[jira] [Created] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

Ashwin Shankar created YARN-3453: Summary: Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing Key: YARN-3453 URL:

[jira] [Updated] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-3111: - Attachment: parenttooltip.png Fix ratio problem on FairScheduler page

[jira] [Commented] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14369828#comment-14369828 ] Ashwin Shankar commented on YARN-3111: -- bq.This dominant resource type is decided by

[jira] [Commented] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367563#comment-14367563 ] Ashwin Shankar commented on YARN-3111: -- I dont think 1 is done in the patch. My bad, I

[jira] [Commented] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366002#comment-14366002 ] Ashwin Shankar commented on YARN-3111: -- Sounds good to me. Fix ratio problem on

[jira] [Commented] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14365722#comment-14365722 ] Ashwin Shankar commented on YARN-3111: -- bq. What do you guys think of overlaying CPU

[jira] [Commented] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14365917#comment-14365917 ] Ashwin Shankar commented on YARN-3111: -- Hi [~ka...@cloudera.com] bq. For 4, what do

[jira] [Commented] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14350017#comment-14350017 ] Ashwin Shankar commented on YARN-3111: -- [~ka...@cloudera.com], Yes when cluster

[jira] [Commented] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14340720#comment-14340720 ] Ashwin Shankar commented on YARN-3111: -- Hey [~kasha], When you get a chance, can you

[jira] [Commented] (YARN-3111) Fix ratio problem on FairScheduler page

[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341109#comment-14341109 ] Ashwin Shankar commented on YARN-3111: -- [~ka...@cloudera.com] Fix ratio problem on

[jira] [Commented] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14244854#comment-14244854 ] Ashwin Shankar commented on YARN-2003: -- [~sunilg], Thanks for letting me know. Just

[jira] [Created] (YARN-2959) Fair Scheduler fifo option can violate FIFO behavior and cause deadlock among jobs

Ashwin Shankar created YARN-2959: Summary: Fair Scheduler fifo option can violate FIFO behavior and cause deadlock among jobs Key: YARN-2959 URL: https://issues.apache.org/jira/browse/YARN-2959

[jira] [Commented] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243145#comment-14243145 ] Ashwin Shankar commented on YARN-2003: -- Hi [~sunilg], is there anything that needs to

[jira] [Commented] (YARN-2540) Fair Scheduler : queue filters not working on scheduler page in RM UI

[ https://issues.apache.org/jira/browse/YARN-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143793#comment-14143793 ] Ashwin Shankar commented on YARN-2540: -- Hi [~kasha], when you get a chance can you

[jira] [Commented] (YARN-2540) FairScheduler: Queue filters not working on scheduler page in RM UI

[ https://issues.apache.org/jira/browse/YARN-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143980#comment-14143980 ] Ashwin Shankar commented on YARN-2540: -- Thanks [~kasha], [~ywskycn] ! FairScheduler:

[jira] [Updated] (YARN-2540) Fair Scheduler : queue filters not working on scheduler page in RM UI

[ https://issues.apache.org/jira/browse/YARN-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2540: - Attachment: YARN-2540-v2.txt There is a case in which the filter can return wrong results : Say

[jira] [Updated] (YARN-2540) Fair Scheduler : queue filters not working on scheduler page in RM UI

[ https://issues.apache.org/jira/browse/YARN-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2540: - Attachment: YARN-2540-v3.txt Updated the patch to take care of same prefix problem at parent

[jira] [Updated] (YARN-2540) Fair Scheduler : queue filters not working on scheduler page in RM UI

[ https://issues.apache.org/jira/browse/YARN-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2540: - Attachment: YARN-2540-v1.txt Fair Scheduler : queue filters not working on scheduler page in RM

[jira] [Commented] (YARN-2540) Fair Scheduler : queue filters not working on scheduler page in RM UI

[ https://issues.apache.org/jira/browse/YARN-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14131773#comment-14131773 ] Ashwin Shankar commented on YARN-2540: -- Attached patch fixes this issue. The problem

[jira] [Commented] (YARN-2104) Scheduler queue filter failed to work because index of queue column changed

[ https://issues.apache.org/jira/browse/YARN-2104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14131781#comment-14131781 ] Ashwin Shankar commented on YARN-2104: -- Created YARN-2540 and posted a patch to fix

[jira] [Commented] (YARN-2539) FairScheduler: Update the default value for maxAMShare

[ https://issues.apache.org/jira/browse/YARN-2539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14131818#comment-14131818 ] Ashwin Shankar commented on YARN-2539: -- Sounds good, thanks. FairScheduler: Update

[jira] [Commented] (YARN-2540) Fair Scheduler : queue filters not working on scheduler page in RM UI

[ https://issues.apache.org/jira/browse/YARN-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14131886#comment-14131886 ] Ashwin Shankar commented on YARN-2540: -- Didn't add unit tests since it was a cosmetic

[jira] [Commented] (YARN-2104) Scheduler queue filter failed to work because index of queue column changed

[ https://issues.apache.org/jira/browse/YARN-2104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14130268#comment-14130268 ] Ashwin Shankar commented on YARN-2104: -- Hi [~wangda], This issues still happens for

[jira] [Commented] (YARN-2539) FairScheduler: Update the default value for maxAMShare

[ https://issues.apache.org/jira/browse/YARN-2539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14130881#comment-14130881 ] Ashwin Shankar commented on YARN-2539: -- Hey [~ywskycn], What about the problem

[jira] [Commented] (YARN-2540) Fair Scheduler : queue filters not working on scheduler page in RM UI

[ https://issues.apache.org/jira/browse/YARN-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14130889#comment-14130889 ] Ashwin Shankar commented on YARN-2540: -- Note : this problem happens when we want to

[jira] [Commented] (YARN-2306) leak of reservation metrics (fair scheduler)

[ https://issues.apache.org/jira/browse/YARN-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118617#comment-14118617 ] Ashwin Shankar commented on YARN-2306: -- [~kasha], we saw reservation metrics leak in

[jira] [Commented] (YARN-2394) FairScheduler: Configure fairSharePreemptionThreshold per queue

[ https://issues.apache.org/jira/browse/YARN-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119278#comment-14119278 ] Ashwin Shankar commented on YARN-2394: -- [~ywskycn], patch looks almost good. Couple of

[jira] [Commented] (YARN-2394) FairScheduler: Configure fairSharePreemptionThreshold per queue

[ https://issues.apache.org/jira/browse/YARN-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119379#comment-14119379 ] Ashwin Shankar commented on YARN-2394: -- Also, a subjective opinion(feel free to ignore

[jira] [Commented] (YARN-2394) Fair Scheduler : ability to configure fairSharePreemptionThreshold per queue

[ https://issues.apache.org/jira/browse/YARN-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114455#comment-14114455 ] Ashwin Shankar commented on YARN-2394: -- I have different opinion on this, but I spoke

[jira] [Commented] (YARN-2395) FairScheduler: Preemption timeout should be configurable per queue

[ https://issues.apache.org/jira/browse/YARN-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114730#comment-14114730 ] Ashwin Shankar commented on YARN-2395: -- [~ywskycn], Sure, I'm fine with this, I just

[jira] [Commented] (YARN-2395) FairScheduler: Preemption timeout should be configurable per queue

[ https://issues.apache.org/jira/browse/YARN-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113290#comment-14113290 ] Ashwin Shankar commented on YARN-2395: -- [~kasha], I'm fine with the plan. However I'm

[jira] [Commented] (YARN-2394) Fair Scheduler : ability to configure fairSharePreemptionThreshold per queue

[ https://issues.apache.org/jira/browse/YARN-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113323#comment-14113323 ] Ashwin Shankar commented on YARN-2394: -- [~ywskycn], [~kasha] Inheriting

[jira] [Commented] (YARN-2395) FairScheduler: Preemption timeout should be configurable per queue

[ https://issues.apache.org/jira/browse/YARN-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1448#comment-1448 ] Ashwin Shankar commented on YARN-2395: -- [~kasha], bq. If a parent queue is starved,

[jira] [Commented] (YARN-2395) FairScheduler: Preemption timeout should be configurable per queue

[ https://issues.apache.org/jira/browse/YARN-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110059#comment-14110059 ] Ashwin Shankar commented on YARN-2395: -- [~ywskycn], I'll post my comments soon. But

[jira] [Commented] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107351#comment-14107351 ] Ashwin Shankar commented on YARN-2360: -- [~ywskycn], patch looks good. Should we

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement static fair share

[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099082#comment-14099082 ] Ashwin Shankar commented on YARN-2393: -- Thanks [~ywskycn]. More comments : 1.

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement static fair share

[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093217#comment-14093217 ] Ashwin Shankar commented on YARN-2393: -- [~ywskycn], On skimming through the patch at

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement static fair share

[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091177#comment-14091177 ] Ashwin Shankar commented on YARN-2393: -- hey [~ywskycn], please go ahead. Fair

[jira] [Updated] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2026: - Attachment: YARN-2026-v5.txt Fair scheduler : Fair share for inactive queues causes unfair

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091308#comment-14091308 ] Ashwin Shankar commented on YARN-2026: -- Thanks [~kasha]. All comments addressed in v5

[jira] [Commented] (YARN-2026) Fair scheduler: Consider only active queues for computing fairshare

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091609#comment-14091609 ] Ashwin Shankar commented on YARN-2026: -- Thanks a lot [~kasha], [~sandyr] for reviewing

[jira] [Created] (YARN-2393) Fair Scheduler : Implement static fair share

Ashwin Shankar created YARN-2393: Summary: Fair Scheduler : Implement static fair share Key: YARN-2393 URL: https://issues.apache.org/jira/browse/YARN-2393 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-2394) Fair Scheduler : ability to configure fairSharePreemptionThreshold per queue

[ https://issues.apache.org/jira/browse/YARN-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2394: - Issue Type: New Feature (was: Improvement) Fair Scheduler : ability to configure

[jira] [Created] (YARN-2394) Fair Scheduler : ability to configure fairSharePreemptionThreshold per queue

Ashwin Shankar created YARN-2394: Summary: Fair Scheduler : ability to configure fairSharePreemptionThreshold per queue Key: YARN-2394 URL: https://issues.apache.org/jira/browse/YARN-2394 Project:

[jira] [Created] (YARN-2395) Fair Scheduler : implement fair share preemption at parent queue based on fairSharePreemptionTimeout

Ashwin Shankar created YARN-2395: Summary: Fair Scheduler : implement fair share preemption at parent queue based on fairSharePreemptionTimeout Key: YARN-2395 URL: https://issues.apache.org/jira/browse/YARN-2395

[jira] [Updated] (YARN-2393) Fair Scheduler : Implement static fair share

[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2393: - Description: Static fair share is a fair share allocation considering all(active/inactive)

[jira] [Updated] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2026: - Attachment: YARN-2026-v4.txt Fair scheduler : Fair share for inactive queues causes unfair

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089907#comment-14089907 ] Ashwin Shankar commented on YARN-2026: -- Based on an offline discussion with [~kasha],

[jira] [Commented] (YARN-2395) Fair Scheduler : implement fair share preemption at parent queue based on fairSharePreemptionTimeout

[ https://issues.apache.org/jira/browse/YARN-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090039#comment-14090039 ] Ashwin Shankar commented on YARN-2395: -- I felt having timeout per queue would give

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2360: - Attachment: YARN-2360-v2.txt Fair Scheduler : Display dynamic fair share for queues on the

[jira] [Assigned] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar reassigned YARN-2360: Assignee: Ashwin Shankar Fair Scheduler : Display dynamic fair share for queues on the

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2360: - Attachment: YARN-2360-v1.txt Fair Scheduler : Display dynamic fair share for queues on the

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2360: - Attachment: Screen Shot 2014-07-28 at 1.12.19 PM.png Fair Scheduler : Display dynamic fair share

[jira] [Commented] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077125#comment-14077125 ] Ashwin Shankar commented on YARN-2360: -- Attached screenshot and patch for UI changes

[jira] [Commented] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077211#comment-14077211 ] Ashwin Shankar commented on YARN-2360: -- Expected -1 from Jenkins since patch depends

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077218#comment-14077218 ] Ashwin Shankar commented on YARN-2026: -- [~kasha],[~sandyr] , did you have any comments

[jira] [Commented] (YARN-2214) FairScheduler: preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

[ https://issues.apache.org/jira/browse/YARN-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074548#comment-14074548 ] Ashwin Shankar commented on YARN-2214: -- Thanks Karthik ! FairScheduler:

[jira] [Updated] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2026: - Attachment: YARN-2026-v3.txt Fair scheduler : Fair share for inactive queues causes unfair

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075011#comment-14075011 ] Ashwin Shankar commented on YARN-2026: -- Incorporated [~kasha] suggestion of having two

[jira] [Updated] (YARN-2214) preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

[ https://issues.apache.org/jira/browse/YARN-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2214: - Attachment: YARN-2214-v2.txt preemptContainerPreCheck() in FSParentQueue delays convergence

[jira] [Commented] (YARN-2214) preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

[ https://issues.apache.org/jira/browse/YARN-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074039#comment-14074039 ] Ashwin Shankar commented on YARN-2214: -- Thanks [~kasha] ! Patch refreshed.

[jira] [Commented] (YARN-2214) preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

[ https://issues.apache.org/jira/browse/YARN-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14072409#comment-14072409 ] Ashwin Shankar commented on YARN-2214: -- [~kasha], [~sandyr] Can one of you please look

[jira] [Created] (YARN-2333) RM UI : show pending containers at cluster level in the application/scheduler page

Ashwin Shankar created YARN-2333: Summary: RM UI : show pending containers at cluster level in the application/scheduler page Key: YARN-2333 URL: https://issues.apache.org/jira/browse/YARN-2333

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061296#comment-14061296 ] Ashwin Shankar commented on YARN-2026: -- Thanks [~sandyr],[~kasha] - I'll create a

  1   2   >