Tsuyoshi OZAWA created SPARK-4915:
-------------------------------------
Summary: Wrong class name of external shuffle service in the
dynamic allocation
Key: SPARK-4915
URL: https://issues.apache.org/jira/browse/SPARK-4915
Project: Spark
Issue Type: Documentation
Components: Documentation, YARN
Reporter: Tsuyoshi OZAWA
In docs/job-scheduling.md says as follows:
{quote}
To enable this service, set `spark.shuffle.service.enabled` to `true`. In YARN,
this external shuffle service is implemented in
`org.apache.spark.yarn.network.YarnShuffleService` that runs in each
`NodeManager` in your cluster.
{quote}
The class name org.apache.spark.yarn.network.YarnShuffleService is wrong.
org.apache.spark.network.yarn.YarnShuffleService is correct class name to be
specified.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
