[
https://issues.apache.org/jira/browse/SPARK-13232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-13232:
------------------------------------
Assignee: (was: Apache Spark)
> YARN executor node label expressions
> ------------------------------------
>
> Key: SPARK-13232
> URL: https://issues.apache.org/jira/browse/SPARK-13232
> Project: Spark
> Issue Type: Improvement
> Components: YARN
> Environment: Scala 2.11.7, Hadoop 2.7.2, Spark 1.6.0
> Reporter: Atkins
> Priority: Minor
>
> Using node label expression for executor failed to request container request
> and throws *InvalidContainerRequestException*.
> The code
> {code:title=AMRMClientImpl.java}
> /**
> * Valid if a node label expression specified on container request is valid
> or
> * not
> *
> * @param containerRequest
> */
> private void checkNodeLabelExpression(T containerRequest) {
> String exp = containerRequest.getNodeLabelExpression();
>
> if (null == exp || exp.isEmpty()) {
> return;
> }
> // Don't support specifying >= 2 node labels in a node label expression
> now
> if (exp.contains("&&") || exp.contains("||")) {
> throw new InvalidContainerRequestException(
> "Cannot specify more than two node labels"
> + " in a single node label expression");
> }
>
> // Don't allow specify node label against ANY request
> if ((containerRequest.getRacks() != null &&
> (!containerRequest.getRacks().isEmpty()))
> ||
> (containerRequest.getNodes() != null &&
> (!containerRequest.getNodes().isEmpty()))) {
> throw new InvalidContainerRequestException(
> "Cannot specify node label with rack and node");
> }
> }
> {code}
> doesn't allow node label with rack and node.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
