Yin Huai created SPARK-6759:
-------------------------------
Summary: Do not borrow/release a kryo instance for every value in
a complex type value when doing serialization/deserialization in in-memory
columnar store
Key: SPARK-6759
URL: https://issues.apache.org/jira/browse/SPARK-6759
Project: Spark
Issue Type: Improvement
Components: SQL
Reporter: Yin Huai
Right now, for columns of map, array, and struct types, we borrow/release a
kryo instance when serializing/deserializing every value, which is really
expensive (the kryo pool is backed by a ArrayBlockingQueue). It will be good if
we borrow before the serialization/deserialization and release it after we have
done all of the work.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
