[
https://issues.apache.org/jira/browse/SAMZA-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318214#comment-17318214
]
Lakshmi Manasa Gaduputi commented on SAMZA-2619:
------------------------------------------------
In future on Yarn side:
Upcoming: Deprecate setResource (used by samza)
https://issues.apache.org/jira/browse/YARN-5913 -->
#
going to replace setReource (to be deprecated) with
setAMContainerResourceRequests --> this means we will have to create our own
AMcontainerreq -- but how?
#
patch in this jira -- shows that RMAppManager.validateAndCreateResourceRequest
will throw exception if appCtx.getAMContainerResourceRequest() is null instead
of creating the AMContianerResourceReq.
#
Samza will have to change when this upgrading to yarn with this jira/patch --
will mostly become a problem when yarn is upgraded in yarn clusters also
because validateAndCreateResourceRequest is done on RM side not Samza's
ClientHelper
> yarn.am.container.label is applied to entire samza job (all its containers)
> instead of only the AM.
> ---------------------------------------------------------------------------------------------------
>
> Key: SAMZA-2619
> URL: https://issues.apache.org/jira/browse/SAMZA-2619
> Project: Samza
> Issue Type: Bug
> Reporter: Lakshmi Manasa Gaduputi
> Assignee: Lakshmi Manasa Gaduputi
> Priority: Major
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> yarn.am.container.label is applied to entire samza job (all its containers)
> instead of only the AM.
> Yarn supports 3 forms of applying node label to containers – am only,
> container only and entire job.
> [https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/NodeLabel.html#Specifying_node_label_for_application
> ]Samza's ClientHelper.scala finds the am container label and applies it to
> the application submission context which applies the label to the entire job
> instead of only the am.
> this restricts jobs which prefer to have label only for am or different
> labels for am and containers.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
