Hyukjin Kwon created SPARK-16351:
------------------------------------
Summary: Avoid record-per type dispatch in JSON when writing
Key: SPARK-16351
URL: https://issues.apache.org/jira/browse/SPARK-16351
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 2.0.0
Reporter: Hyukjin Kwon
Currently, {{JacksonGenerator.apply}} is doing type-based dispatch for each row
to write appropriate values.
It might not have to be done like this because the schema of {{DataFrame}} is
already there.
So, appropriate writers can be created first according to the schema, and then
apply them to each row. This approach is similar with {{CatalystWriteSupport}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
