Yin Huai created SPARK-6368:
-------------------------------
Summary: Build a specialized serializer for Exchange operator.
Key: SPARK-6368
URL: https://issues.apache.org/jira/browse/SPARK-6368
Project: Spark
Issue Type: Improvement
Components: SQL
Reporter: Yin Huai
Kryo is still pretty slow because it works on individual objects and relative
expensive to allocate. For Exchange operator, because the schema for key and
value are already defined, we can create a specialized serializer to handle the
specific schemas of key and value.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
