Yanbo Liang created SPARK-5738:
----------------------------------
Summary: [SQL] Reuse mutable row for each record at jsonStringToRow
Key: SPARK-5738
URL: https://issues.apache.org/jira/browse/SPARK-5738
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 1.3.0
Reporter: Yanbo Liang
Other table scan like operations include ParquetTableScan, HiveTableScan use a
reusable mutable row for seralization to decrease garbage. We also make
JSONRelation#buildScan() with this optimization.
When serialize json string to row, reuse a mutable row for each record instead
of creating a new one for every record. But every nested struct type in each
record, we still need to create a new row for them.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
