[
https://issues.apache.org/jira/browse/SPARK-9595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14804840#comment-14804840
]
John Chen commented on SPARK-9595:
----------------------------------
Please do it, thanks a lot.
> Adding API to SparkConf for kryo serializers registration
> ---------------------------------------------------------
>
> Key: SPARK-9595
> URL: https://issues.apache.org/jira/browse/SPARK-9595
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.3.1, 1.4.1
> Reporter: John Chen
> Priority: Minor
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> Currently SparkConf has a registerKryoClasses API for kryo registration.
> However, this only works when you register classes. If you want to register
> customized kryo serializers, you'll have to extend the KryoSerializer class
> and write some codes.
> This is not only very inconvenient, but also require the registration to be
> done in compile-time, which is not always possible. Thus, I suggest another
> API to SparkConf for registering customized kryo serializers. It could be
> like this:
> def registerKryoSerializers(serializers: Map[Class[_], Serializer]): SparkConf
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
