[
https://issues.apache.org/jira/browse/YARN-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bibin A Chundatt updated YARN-4925:
-----------------------------------
Description:
Currently with nodelabel AMRMClient will not be able to specify nodelabels with
Node/Rack requests.For application like spark NODE_LOCAL requests cannot be
asked with label expression.
As per the check in {{AMRMClientImpl#checkNodeLabelExpression}}
{noformat}
// Don't allow specify node label against ANY request
if ((containerRequest.getRacks() != null &&
(!containerRequest.getRacks().isEmpty()))
||
(containerRequest.getNodes() != null &&
(!containerRequest.getNodes().isEmpty()))) {
throw new InvalidContainerRequestException(
"Cannot specify node label with rack and node");
}
{noformat}
{{AppSchedulingInfo#updateResourceRequests}} we do reset of labels to that of
OFF-SWITCH.
The above check is not required for ContainerRequest ask /cc [~wangda] thank
you for confirming
was:
Currently with nodelabel AMRMClient will not be able to specify nodelabels with
Node/Rack requests.For application like spark NODE_LOCAL requests cannot be
asked with label expression.
{noformat}
// Don't allow specify node label against ANY request
if ((containerRequest.getRacks() != null &&
(!containerRequest.getRacks().isEmpty()))
||
(containerRequest.getNodes() != null &&
(!containerRequest.getNodes().isEmpty()))) {
throw new InvalidContainerRequestException(
"Cannot specify node label with rack and node");
}
{noformat}
{{AppSchedulingInfo#updateResourceRequests}} we do reset of labels to that of
OFF-SWITCH.
The above check is not required for ContainerRequest ask /cc [~wangda] thank
you for confirming
> ContainerRequest in AMRMClient, application should be able to specify
> nodes/racks together with nodeLabelExpression
> -------------------------------------------------------------------------------------------------------------------
>
> Key: YARN-4925
> URL: https://issues.apache.org/jira/browse/YARN-4925
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Bibin A Chundatt
> Assignee: Bibin A Chundatt
>
> Currently with nodelabel AMRMClient will not be able to specify nodelabels
> with Node/Rack requests.For application like spark NODE_LOCAL requests cannot
> be asked with label expression.
> As per the check in {{AMRMClientImpl#checkNodeLabelExpression}}
> {noformat}
> // Don't allow specify node label against ANY request
> if ((containerRequest.getRacks() != null &&
> (!containerRequest.getRacks().isEmpty()))
> ||
> (containerRequest.getNodes() != null &&
> (!containerRequest.getNodes().isEmpty()))) {
> throw new InvalidContainerRequestException(
> "Cannot specify node label with rack and node");
> }
> {noformat}
> {{AppSchedulingInfo#updateResourceRequests}} we do reset of labels to that of
> OFF-SWITCH.
> The above check is not required for ContainerRequest ask /cc [~wangda] thank
> you for confirming
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
