[
https://issues.apache.org/jira/browse/SPARK-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493092#comment-14493092
]
Apache Spark commented on SPARK-6368:
-------------------------------------
User 'yhuai' has created a pull request for this issue:
https://github.com/apache/spark/pull/5497
> Build a specialized serializer for Exchange operator.
> ------------------------------------------------------
>
> Key: SPARK-6368
> URL: https://issues.apache.org/jira/browse/SPARK-6368
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Yin Huai
> Assignee: Yin Huai
> Priority: Critical
>
> Kryo is still pretty slow because it works on individual objects and relative
> expensive to allocate. For Exchange operator, because the schema for key and
> value are already defined, we can create a specialized serializer to handle
> the specific schemas of key and value.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
