Repository: spark Updated Branches: refs/heads/master 74c30049a -> cf38fc755
[SPARK-11670] Fix incorrect kryo buffer default value in docs <img width="931" alt="screen shot 2015-11-11 at 1 53 21 pm" src="https://cloud.githubusercontent.com/assets/2133137/11108261/35d183d4-889a-11e5-9572-85e9d6cebd26.png";> Author: Andrew Or <and...@databricks.com> Closes #9638 from andrewor14/fix-kryo-docs. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cf38fc75 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/cf38fc75 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/cf38fc75 Branch: refs/heads/master Commit: cf38fc7551f4743958c2fdc7931affd672755e68 Parents: 74c3004 Author: Andrew Or <and...@databricks.com> Authored: Thu Nov 12 15:47:29 2015 -0800 Committer: Andrew Or <and...@databricks.com> Committed: Thu Nov 12 15:47:29 2015 -0800 ---------------------------------------------------------------------- docs/tuning.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/cf38fc75/docs/tuning.md ---------------------------------------------------------------------- diff --git a/docs/tuning.md b/docs/tuning.md index 6936912..879340a 100644 --- a/docs/tuning.md +++ b/docs/tuning.md @@ -61,8 +61,8 @@ The [Kryo documentation](https://github.com/EsotericSoftware/kryo) describes mor registration options, such as adding custom serialization code. If your objects are large, you may also need to increase the `spark.kryoserializer.buffer` -config property. The default is 2, but this value needs to be large enough to hold the *largest* -object you will serialize. +[config](configuration.html#compression-and-serialization). This value needs to be large enough +to hold the *largest* object you will serialize. Finally, if you don't register your custom classes, Kryo will still work, but it will have to store the full class name with each object, which is wasteful. --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
![https://cloud.githubusercontent.com/assets/2133137/11108261/35d183d4-889a-11e5-9572-85e9d6cebd26.png"](https://cloud.githubusercontent.com/assets/2133137/11108261/35d183d4-889a-11e5-9572-85e9d6cebd26.png"){kind=link}