[
https://issues.apache.org/jira/browse/YARN-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15391933#comment-15391933
]
Feng Yuan commented on YARN-5427:
---------------------------------
{quote}
this can be acheived in any version but sharing between Spark -> default
partition or MR -> default partition depends on the type of SPARK and MR
Partition . And this sharing is supported for Non Exclusive Partition from 2.8
only !
{quote}
I think i understand your words,you mean set SPARK "Non Exclusive",sharing
SPARK to default? But i finded job with "No Label" cant control the usage of
SPARK.For example when default used up and SPARK is idel fully,resources will
be bleed white by this job,i cant control x% the job can use.(example:i set
yarn.scheduler.capacity.root.A.accessible-node-labels.x.capacity to 10% didnt
work when x is "Non Exclusive")
So i want to know if i can get this scene,job get share from default to
spark,so that i can control usage of spark and default both by set capacity(%)
and no label is "Non Exclusive".I do this in 2.7.2 as above comment.
Thanks [~Naganarasimha] for your detailed reply.
Have a good day!
> Labeled apps cant use <DEFAULT_PARTITION> resources in 2.8
> ----------------------------------------------------------
>
> Key: YARN-5427
> URL: https://issues.apache.org/jira/browse/YARN-5427
> Project: Hadoop YARN
> Issue Type: Bug
> Components: capacity scheduler
> Affects Versions: 2.8.0
> Reporter: Feng Yuan
> Fix For: 2.8.0
>
> Attachments: QQ截图20160725205642.png, capacity-scheduler.xml
>
>
> Queue A use partition X,When x is used up,app cant get resource from
> <DEFAULT_PARTITION>.
> I find this behavior is different from 2.7.x.Also i find this in the document
> of 2.7.2 as blew:
> "All queues can access to nodes without
> label"--https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/NodeLabel.html
> I think it means if queue A`s partition x is used up,app can get containers
> from DEFAULT_PARTITION? Do i misstake?
> And I can confirm my configs is correct.Because i can run profectlly in 2.7.x
> use this configation too.
> I have observed this in 2.8: "<DEFAULT_PARTITION> is marked as
> <ECLUSIVE_PARTITION>" in webui.Is this the reason?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
