[
https://issues.apache.org/jira/browse/YARN-9012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16704213#comment-16704213
]
Sunil Govindan commented on YARN-9012:
--------------------------------------
Hi [~jutia]
Thanks for testing this feature.
YARN-5881 is merged to trunk and you could test this in trunk. About the
feature, we initially planned to use a new config named min-resource and
max-resource for specifying capacity in terms of absolute resources.
During last phase of the work, we got the feedback to support in existing
configuration. Hence yarn.scheduler.capacity.<queue-path>.capacity can either
take a % values such as 45 or it can take [memory=20,vcores=10]. Giving empty
option for min-resource was an idea where absolute resource was configured
separate. Now both are same, this doesnt hold good.
I will correct the document attached in YARN-5881 for better clarity. Could you
please help to try this. Thanks.
> NPE in scheduler UI when min-capacity is not configured
> -------------------------------------------------------
>
> Key: YARN-9012
> URL: https://issues.apache.org/jira/browse/YARN-9012
> Project: Hadoop YARN
> Issue Type: Bug
> Affects Versions: 3.1.1
> Reporter: tianjuan
> Assignee: tianjuan
> Priority: Major
>
> I encountered the following while reviewing and testing branch YARN-5881.
> The design document from YARN-5881 says that for max-capacity:
> {quote} For any queue: If min-resource not set, it is automatically set to 0.
> (Same as today)
> {quote}
> When I try leaving blank {{yarn.scheduler.capacity.<queue-path>.capacity}},
> the RMUI scheduler page refuses to render. It looks like it's in
> {{CapacitySchedulerPage$ LeafQueueInfoBlock}}:
> {noformat}
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$LeafQueueInfoBlock.renderQueueCapacityInfo(CapacitySchedulerPage.java:163)
> at
> org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$LeafQueueInfoBlock.renderLeafQueueInfoWithPartition(CapacitySchedulerPage.java:108)
> at
> org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$LeafQueueInfoBlock.render(CapacitySchedulerPage.java:97)
> at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:69)
> at
> org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:79)
> at org.apache.hadoop.yarn.webapp.View.render(View.java:243)
> at
> org.apache.hadoop.yarn.webapp.view.HtmlBlock$Block.subView(HtmlBlock.java:43)
> at
> org.apache.hadoop.yarn.webapp.hamlet2.HamletImpl$EImp._v(HamletImpl.java:117)
> at org.apache.hadoop.yarn.webapp.hamlet2.Hamlet$LI.__(Hamlet.java:7709)
> at
> org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$QueueBlock.render(CapacitySchedulerPage.java:342){noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
