Repository: spark Updated Branches: refs/heads/branch-1.1 5e191fac0 -> 926f8ca53
[SPARK-2652] [PySpark] donot use KyroSerializer as default serializer KyroSerializer can not serialize customized class without registered explicitly, use it as default serializer in PySpark will introduce some regression in MLlib. cc mengxr Author: Davies Liu <[email protected]> Closes #2916 from davies/revert and squashes the following commits: 43eb6d3 [Davies Liu] donot use KyroSerializer as default serializer (cherry picked from commit 809c785bcc33e684a68ea14240a466def864199a) Signed-off-by: Xiangrui Meng <[email protected]> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/926f8ca5 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/926f8ca5 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/926f8ca5 Branch: refs/heads/branch-1.1 Commit: 926f8ca5370e506eee92cc82eb2153fe7c80a504 Parents: 5e191fa Author: Davies Liu <[email protected]> Authored: Thu Oct 23 23:58:00 2014 -0700 Committer: Xiangrui Meng <[email protected]> Committed: Thu Oct 23 23:58:15 2014 -0700 ---------------------------------------------------------------------- python/pyspark/context.py | 1 - 1 file changed, 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/926f8ca5/python/pyspark/context.py ---------------------------------------------------------------------- diff --git a/python/pyspark/context.py b/python/pyspark/context.py index 82f76de..357626e 100644 --- a/python/pyspark/context.py +++ b/python/pyspark/context.py @@ -40,7 +40,6 @@ from py4j.java_collections import ListConverter # These are special default configs for PySpark, they will overwrite # the default ones for Spark if they are not configured by user. DEFAULT_CONFIGS = { - "spark.serializer": "org.apache.spark.serializer.KryoSerializer", "spark.serializer.objectStreamReset": 100, "spark.rdd.compress": True, } --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
