[
https://issues.apache.org/jira/browse/SPARK-11751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yangping wu updated SPARK-11751:
--------------------------------
Description:
In the *Task Launching Overheads* section,
{quote}*Task Serialization*: Using Kryo serialization for serializing tasks can
reduce the task sizes, and therefore reduce the time taken to send them to the
slaves.{quote}
As we known *Task Serialization* is configuration by *spark.closure.serializer*
parameter, but currently only the Java serializer is supported. If we set
*spark.closure.serializer* to *org.apache.spark.serializer.KryoSerializer*
was:
In the *Task Launching Overheads* section,
{quote}*Task Serialization*: Using Kryo serialization for serializing tasks can
reduce the task sizes, and therefore reduce the time taken to send them to the
slaves.{quote}
As we known *Task Serialization* is configuration by *spark.closure.serializer*
parameter, but currently only the Java serializer is supported.
> Doc describe error in the "Spark Streaming Programming Guide" page
> ------------------------------------------------------------------
>
> Key: SPARK-11751
> URL: https://issues.apache.org/jira/browse/SPARK-11751
> Project: Spark
> Issue Type: Bug
> Components: Documentation
> Affects Versions: 1.4.1, 1.5.0, 1.5.1
> Reporter: yangping wu
> Priority: Trivial
>
> In the *Task Launching Overheads* section,
> {quote}*Task Serialization*: Using Kryo serialization for serializing tasks
> can reduce the task sizes, and therefore reduce the time taken to send them
> to the slaves.{quote}
> As we known *Task Serialization* is configuration by
> *spark.closure.serializer* parameter, but currently only the Java serializer
> is supported. If we set *spark.closure.serializer* to
> *org.apache.spark.serializer.KryoSerializer*
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
