[
https://issues.apache.org/jira/browse/YARN-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15391850#comment-15391850
]
Naganarasimha G R commented on YARN-5427:
-----------------------------------------
bq. "By default, this is empty, so application will get containers from nodes
without label." if my app can get containers from "default" firstly and when
default used up gets containers from x?
Its basically waits till certain number of heartbeats before allocating in the
other Non Exclusive Partition. So more or less we can say that default gets
usedup then if node of partition X is free then it will assign in it.
bq. In fact, my demand is jobs in queue A(batch data work) can use one
partition as 'MR' and another partition as 'SPARK'(high memory) such as 100%*MR
and 30%*SPARK. and jobs in queue B(ML jobs) can use 70%*SPARK. could i achieve
this by now(2.8)?
this can be acheived in any version but sharing between *Spark -> default
partition* or *MR -> default partition* depends on the type of SPARK and MR
Partition . And this sharing is supported for Non Exclusive Partition from 2.8
only !
> Labeled apps cant use <DEFAULT_PARTITION> resources in 2.8
> ----------------------------------------------------------
>
> Key: YARN-5427
> URL: https://issues.apache.org/jira/browse/YARN-5427
> Project: Hadoop YARN
> Issue Type: Bug
> Components: capacity scheduler
> Affects Versions: 2.8.0
> Reporter: Feng Yuan
> Fix For: 2.8.0
>
>
> Queue A use partition X,When x is used up,app cant get resource from
> <DEFAULT_PARTITION>.
> I find this behavior is different from 2.7.x.Also i find this in the document
> of 2.7.2 as blew:
> "All queues can access to nodes without
> label"--https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/NodeLabel.html
> I think it means if queue A`s partition x is used up,app can get containers
> from DEFAULT_PARTITION? Do i misstake?
> And I can confirm my configs is correct.Because i can run profectlly in 2.7.x
> use this configation too.
> I have observed this in 2.8: "<DEFAULT_PARTITION> is marked as
> <ECLUSIVE_PARTITION>" in webui.Is this the reason?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
