Patrick Wendell created SPARK-4761:
--------------------------------------
Summary: With JDBC server, set Kryo as default serializer and
disable reference tracking
Key: SPARK-4761
URL: https://issues.apache.org/jira/browse/SPARK-4761
Project: Spark
Issue Type: Bug
Reporter: Patrick Wendell
Assignee: Cheng Lian
Priority: Blocker
I saw some regression in 1.2 Spark SQL due to our broadcast change which
requires significantly more serialization. It would be good if when the JDBC
server is running it automatically sets the serializer to Kryo and disables
Kryo reference tracking.
Doing this while still honoring a user-provided serializer is tricky. I think
the best way is to expose an internal (private) constructor to SparkConf that
takes a set of lowest-precedence defaults. Those could get merged in with the
lowest precedence before the config file is read.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
