Akshat Bordia created YARN-10978:
------------------------------------
Summary: yarn.nodemanager.aux-services.%s.classpath configuration
fails to reflect on Windows Path
Key: YARN-10978
URL: https://issues.apache.org/jira/browse/YARN-10978
Project: Hadoop YARN
Issue Type: Bug
Reporter: Akshat Bordia
Steps to Reproduce:
1. Add auxillary service configuration such as spark_shuffle.
2. Add following configuration to provide custom classpath for the auxillary
service:
yarn.nodemanager.aux-services.spark_shuffle.classpath=D:\Spark\yarn\*
3. Start NM
Expected Behavior:
1. NM should start along with the auxillary service.
Actual Behavior:
1. NM keeps crashing due to auxillary service not being able to start as it is
not able to find required classes.
java.lang.ClassNotFoundException:
org.apache.spark.network.yarn.YarnShuffleService
Potential Fix:
Using File.separator instead of "\" to make glob expansion OS agnostic.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
