[jira] [Resolved] (YARN-1853) Allow containers to be ran under real user even in insecure mode

[ https://issues.apache.org/jira/browse/YARN-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev resolved YARN-1853. Resolution: Duplicate > Allow containers to be ran under real user even in insecure mode > --

[jira] [Commented] (YARN-1853) Allow containers to be ran under real user even in insecure mode

[ https://issues.apache.org/jira/browse/YARN-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14336880#comment-14336880 ] Andrey Stepachev commented on YARN-1853: [~raviprak] not exactly. basically it does

[jira] [Resolved] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev resolved YARN-2134. Resolution: Won't Fix implemented as a part of https://issues.apache.org/jira/browse/YARN-21

[jira] [Commented] (YARN-2151) FairScheduler option for global preemption within hierarchical queues

[ https://issues.apache.org/jira/browse/YARN-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031488#comment-14031488 ] Andrey Stepachev commented on YARN-2151: [~ashwinshankar77] , thank you for suggest

[jira] [Commented] (YARN-2151) FairScheduler option for global preemption within hierarchical queues

[ https://issues.apache.org/jira/browse/YARN-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14029768#comment-14029768 ] Andrey Stepachev commented on YARN-2151: Actually there is not much code for the pr

[jira] [Updated] (YARN-2151) FairScheduler option for global preemption within hierarchical queues

[ https://issues.apache.org/jira/browse/YARN-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2151: --- Description: FairScheduler has hierarchical queues, but fair share calculation and preemption

[jira] [Updated] (YARN-2151) FairScheduler option for global preemption within hierarchical queues

[ https://issues.apache.org/jira/browse/YARN-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2151: --- Attachment: YARN-2151.patch > FairScheduler option for global preemption within hierarchical q

[jira] [Created] (YARN-2151) FairScheduler option for global preemption within hierarchical queues

Andrey Stepachev created YARN-2151: -- Summary: FairScheduler option for global preemption within hierarchical queues Key: YARN-2151 URL: https://issues.apache.org/jira/browse/YARN-2151 Project: Hadoop

[jira] [Commented] (YARN-2145) FairScheduler can assign more resources to queue with MaxShare set.

[ https://issues.apache.org/jira/browse/YARN-2145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14027815#comment-14027815 ] Andrey Stepachev commented on YARN-2145: yes, exactly the same problem. > FairSch

[jira] [Updated] (YARN-2145) FairScheduler can assign more resources to queue with MaxShare set.

[ https://issues.apache.org/jira/browse/YARN-2145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2145: --- Description: method fair.FSQueue#assignContainerPreCheck() uses Resources.fitsIn incorrectly,

[jira] [Updated] (YARN-2145) FairScheduler can assign more resources to queue with MaxShare set.

[ https://issues.apache.org/jira/browse/YARN-2145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2145: --- Description: method fair.FSQueue#assignContainerPreCheck() uses Resources.fitsIn incorrectly,

[jira] [Updated] (YARN-2145) FairScheduler can assign more resources to queue with MaxShare set.

[ https://issues.apache.org/jira/browse/YARN-2145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2145: --- Description: method fair.FSQueue#assignContainerPreCheck() uses Resources.fitsIn incorrectly,

[jira] [Updated] (YARN-2145) FairScheduler can assign more resources to queue with MaxShare set.

[ https://issues.apache.org/jira/browse/YARN-2145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2145: --- Description: method fair.FSQueue#assignContainerPreCheck() uses Resources.fitsIn incorrectly,

[jira] [Updated] (YARN-2145) FairScheduler can assign more resources to queue with MaxShare set.

[ https://issues.apache.org/jira/browse/YARN-2145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2145: --- Description: method fair.FSQueue#assignContainerPreCheck() uses Resources.fitsIn incorrectly,

[jira] [Updated] (YARN-2145) FairScheduler can assign more resources to queue with MaxShare set.

[ https://issues.apache.org/jira/browse/YARN-2145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2145: --- Attachment: YARN-2145.diff > FairScheduler can assign more resources to queue with MaxShare se

[jira] [Created] (YARN-2145) FairScheduler can assign more resources to queue with MaxShare set.

Andrey Stepachev created YARN-2145: -- Summary: FairScheduler can assign more resources to queue with MaxShare set. Key: YARN-2145 URL: https://issues.apache.org/jira/browse/YARN-2145 Project: Hadoop Y

[jira] [Commented] (YARN-2073) Fair Scheduler: Add a utilization threshold to prevent preempting resources when cluster is free

[ https://issues.apache.org/jira/browse/YARN-2073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14027644#comment-14027644 ] Andrey Stepachev commented on YARN-2073: I read code and don't cleanly understand w

[jira] [Commented] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026849#comment-14026849 ] Andrey Stepachev commented on YARN-2134: This is a first of two patches for deep hi

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: (was: YARN-2134-v2.diff) > FairSchduler AllocationConfiguration doesn't treat

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: YARN-2134-v2.diff > FairSchduler AllocationConfiguration doesn't treat hierarchica

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: YARN-2134-v2.diff > FairSchduler AllocationConfiguration doesn't treat hierarchica

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Description: Automatically created queues (f.e. by queue placement rules) doesn't allow to set

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Description: Automatically created queues (f.e. by queue placement rules) doesn't allow to set

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Description: Automatically created queues (f.e. by queue placement rules) doesn't allow to set

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Description: Automatically created queues doesn't allow to set default parameters. If queue no

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: (was: broken-hier-queues.diff) > FairSchduler AllocationConfiguration doesn't

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: (was: YARN-2134.diff) > FairSchduler AllocationConfiguration doesn't treat hie

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: YARN-2134.diff > FairSchduler AllocationConfiguration doesn't treat hierarchical q

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: (was: YARN-2134.diff) > FairSchduler AllocationConfiguration doesn't treat hie

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: YARN-2134.diff > FairSchduler AllocationConfiguration doesn't treat hierarchical q

[jira] [Commented] (YARN-1864) Fair Scheduler Dynamic Hierarchical User Queues

[ https://issues.apache.org/jira/browse/YARN-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021819#comment-14021819 ] Andrey Stepachev commented on YARN-1864: created queues doesn't respect parent queu

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Fix Version/s: 2.5.0 > FairSchduler AllocationConfiguration doesn't treat hierarchical queues

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Description: AllocationConfiguration doesn't fully qualify queue names with respect to 'root.

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Description: AllocationConfiguration doesn't fully qualify queue names with respect to 'root.

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: YARN-2134.diff > FairSchduler AllocationConfiguration doesn't treat hierarchical q

[jira] [Updated] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

[ https://issues.apache.org/jira/browse/YARN-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-2134: --- Attachment: broken-hier-queues.diff > FairSchduler AllocationConfiguration doesn't treat hiera

[jira] [Created] (YARN-2134) FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings

Andrey Stepachev created YARN-2134: -- Summary: FairSchduler AllocationConfiguration doesn't treat hierarchical queues settings Key: YARN-2134 URL: https://issues.apache.org/jira/browse/YARN-2134 Proje

[jira] [Updated] (YARN-1853) Allow containers to be ran under real user even in insecure mode

[ https://issues.apache.org/jira/browse/YARN-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1853: --- Attachment: YARN-1853-trunk.patch > Allow containers to be ran under real user even in insecur

[jira] [Updated] (YARN-1853) Allow containers to be ran under real user even in insecure mode

[ https://issues.apache.org/jira/browse/YARN-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1853: --- Attachment: (was: YARN-1853-trunk.patch) > Allow containers to be ran under real user even

[jira] [Updated] (YARN-1853) Allow containers to be ran under real user even in insecure mode

[ https://issues.apache.org/jira/browse/YARN-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1853: --- Attachment: YARN-1853-trunk.patch patch ported to trunk. > Allow containers to be ran under r

[jira] [Updated] (YARN-1853) Allow containers to be ran under real user even in insecure mode

[ https://issues.apache.org/jira/browse/YARN-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1853: --- Attachment: (was: YARN-1853.patch) > Allow containers to be ran under real user even in in

[jira] [Updated] (YARN-1853) Allow containers to be ran under real user even in insecure mode

[ https://issues.apache.org/jira/browse/YARN-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1853: --- Affects Version/s: (was: 2.2.0) 2.3.0 > Allow containers to be ran

[jira] [Commented] (YARN-1921) Allow to override queue prefix, where new queues will be created

[ https://issues.apache.org/jira/browse/YARN-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13966271#comment-13966271 ] Andrey Stepachev commented on YARN-1921: Looks like we can close this issue, in par

[jira] [Commented] (YARN-1864) Fair Scheduler Dynamic Hierarchical User Queues

[ https://issues.apache.org/jira/browse/YARN-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13966270#comment-13966270 ] Andrey Stepachev commented on YARN-1864: Thank you for clarification. ??I think you

[jira] [Commented] (YARN-1864) Fair Scheduler Dynamic Hierarchical User Queues

[ https://issues.apache.org/jira/browse/YARN-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13966224#comment-13966224 ] Andrey Stepachev commented on YARN-1864: And additiona rules still needed, because

[jira] [Commented] (YARN-1864) Fair Scheduler Dynamic Hierarchical User Queues

[ https://issues.apache.org/jira/browse/YARN-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13966222#comment-13966222 ] Andrey Stepachev commented on YARN-1864: Ashwin, I understand your solution. It is

[jira] [Updated] (YARN-1921) Allow to override queue prefix, where new queues will be created

[ https://issues.apache.org/jira/browse/YARN-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1921: --- Attachment: (was: YARN-1921.patch) > Allow to override queue prefix, where new queues will

[jira] [Updated] (YARN-1921) Allow to override queue prefix, where new queues will be created

[ https://issues.apache.org/jira/browse/YARN-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1921: --- Attachment: YARN-1921.patch > Allow to override queue prefix, where new queues will be created

[jira] [Commented] (YARN-1864) Fair Scheduler Dynamic Hierarchical User Queues

[ https://issues.apache.org/jira/browse/YARN-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13965855#comment-13965855 ] Andrey Stepachev commented on YARN-1864: I've updated patch with three additional r

[jira] [Updated] (YARN-1921) Allow to override queue prefix, where new queues will be created

[ https://issues.apache.org/jira/browse/YARN-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1921: --- Attachment: YARN-1921.patch > Allow to override queue prefix, where new queues will be created

[jira] [Commented] (YARN-1864) Fair Scheduler Dynamic Hierarchical User Queues

[ https://issues.apache.org/jira/browse/YARN-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13965819#comment-13965819 ] Andrey Stepachev commented on YARN-1864: BTW, PrimaryGroup and SecondaryGroup rules

[jira] [Commented] (YARN-1864) Fair Scheduler Dynamic Hierarchical User Queues

[ https://issues.apache.org/jira/browse/YARN-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13965815#comment-13965815 ] Andrey Stepachev commented on YARN-1864: It can be easily done with additional rule

[jira] [Updated] (YARN-1921) Allow to override queue prefix, where new queues will be created

[ https://issues.apache.org/jira/browse/YARN-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1921: --- Summary: Allow to override queue prefix, where new queues will be created (was: Allow to over

[jira] [Updated] (YARN-1921) Allow to override queue prefix, where new queues created

[ https://issues.apache.org/jira/browse/YARN-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1921: --- Description: Fair scheduler has a couple of QueuePlacementRules. Those rules can create queue

[jira] [Commented] (YARN-1921) Allow to override queue prefix, where new queues created

[ https://issues.apache.org/jira/browse/YARN-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13965732#comment-13965732 ] Andrey Stepachev commented on YARN-1921: Thanks for pointing on similar solution, b

[jira] [Commented] (YARN-1864) Fair Scheduler Dynamic Hierarchical User Queues

[ https://issues.apache.org/jira/browse/YARN-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13965701#comment-13965701 ] Andrey Stepachev commented on YARN-1864: I have a different solution. My patch http

[jira] [Updated] (YARN-1921) Allow to override queue prefix, where new queues created

[ https://issues.apache.org/jira/browse/YARN-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1921: --- Attachment: YARN-1921.patch > Allow to override queue prefix, where new queues created > -

[jira] [Created] (YARN-1921) Allow to override queue prefix, where new queues created

Andrey Stepachev created YARN-1921: -- Summary: Allow to override queue prefix, where new queues created Key: YARN-1921 URL: https://issues.apache.org/jira/browse/YARN-1921 Project: Hadoop YARN

[jira] [Updated] (YARN-1853) Allow containers to be ran under real user even in insecure mode

[ https://issues.apache.org/jira/browse/YARN-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1853: --- Component/s: resourcemanager > Allow containers to be ran under real user even in insecure mod

[jira] [Updated] (YARN-1853) Allow containers to be ran under real user even in insecure mode

[ https://issues.apache.org/jira/browse/YARN-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1853: --- Attachment: YARN-1853.patch Updated patch. RMAppManager should check existence of user before

[jira] [Updated] (YARN-1853) Allow containers to be ran under real user even in insecure mode

[ https://issues.apache.org/jira/browse/YARN-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1853: --- Affects Version/s: 2.2.0 > Allow containers to be ran under real user even in insecure mode >

[jira] [Updated] (YARN-1853) Allow containers to be ran under real user even in insecure mode

[ https://issues.apache.org/jira/browse/YARN-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1853: --- Attachment: YARN-1853.patch My propose it to use parameter 'yarn.nodemanager.linux-container-

[jira] [Created] (YARN-1853) Allow containers to be ran under real user even in insecure mode

Andrey Stepachev created YARN-1853: -- Summary: Allow containers to be ran under real user even in insecure mode Key: YARN-1853 URL: https://issues.apache.org/jira/browse/YARN-1853 Project: Hadoop YARN