[
https://issues.apache.org/jira/browse/SPARK-4915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsuyoshi OZAWA updated SPARK-4915:
----------------------------------
Description:
docs/job-scheduling.md says as follows:
{quote}
To enable this service, set `spark.shuffle.service.enabled` to `true`. In YARN,
this external shuffle service is implemented in
`org.apache.spark.yarn.network.YarnShuffleService` that runs in each
`NodeManager` in your cluster.
{quote}
The class name org.apache.spark.yarn.network.YarnShuffleService is wrong.
org.apache.spark.network.yarn.YarnShuffleService is correct class name to be
specified.
was:
In docs/job-scheduling.md says as follows:
{quote}
To enable this service, set `spark.shuffle.service.enabled` to `true`. In YARN,
this external shuffle service is implemented in
`org.apache.spark.yarn.network.YarnShuffleService` that runs in each
`NodeManager` in your cluster.
{quote}
The class name org.apache.spark.yarn.network.YarnShuffleService is wrong.
org.apache.spark.network.yarn.YarnShuffleService is correct class name to be
specified.
> Wrong class name of external shuffle service in the dynamic allocation
> ----------------------------------------------------------------------
>
> Key: SPARK-4915
> URL: https://issues.apache.org/jira/browse/SPARK-4915
> Project: Spark
> Issue Type: Documentation
> Components: Documentation, YARN
> Reporter: Tsuyoshi OZAWA
>
> docs/job-scheduling.md says as follows:
> {quote}
> To enable this service, set `spark.shuffle.service.enabled` to `true`. In
> YARN, this external shuffle service is implemented in
> `org.apache.spark.yarn.network.YarnShuffleService` that runs in each
> `NodeManager` in your cluster.
> {quote}
> The class name org.apache.spark.yarn.network.YarnShuffleService is wrong.
> org.apache.spark.network.yarn.YarnShuffleService is correct class name to be
> specified.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
