[
https://issues.apache.org/jira/browse/SPARK-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-11670:
------------------------------
Description:
The default is 64K, but the doc says it's 2?
https://spark.apache.org/docs/1.5.0/tuning.html#data-serialization
{quote}
If your objects are large, you may also need to increase the
spark.kryoserializer.buffer config property. The default is 2, but this value
needs to be large enough to hold the largest object you will serialize.
{quote}
was:
The default is 64K, but the doc says it's 2?
https://spark.apache.org/docs/1.5.0/tuning.html#data-serialization
{code}
If your objects are large, you may also need to increase the
spark.kryoserializer.buffer config property. The default is 2, but this value
needs to be large enough to hold the largest object you will serialize.
{code}
> Fix incorrect kryo buffer default value in docs
> -----------------------------------------------
>
> Key: SPARK-11670
> URL: https://issues.apache.org/jira/browse/SPARK-11670
> Project: Spark
> Issue Type: Bug
> Components: Documentation
> Affects Versions: 1.4.0
> Reporter: Andrew Or
> Assignee: Andrew Or
> Priority: Minor
>
> The default is 64K, but the doc says it's 2?
> https://spark.apache.org/docs/1.5.0/tuning.html#data-serialization
> {quote}
> If your objects are large, you may also need to increase the
> spark.kryoserializer.buffer config property. The default is 2, but this value
> needs to be large enough to hold the largest object you will serialize.
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
