Davies Liu created SPARK-10065:
----------------------------------
Summary: Avoid triple copy of var-length objects in Array in
tungsten projection
Key: SPARK-10065
URL: https://issues.apache.org/jira/browse/SPARK-10065
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 1.5.0
Reporter: Davies Liu
The first copy happens when we calculate the size of each element, after that,
we copy the elements into array buffer, finally we copy the array buffer into
row buffer.
We could calculate the total size first, then convert the elements into row
buffer directly.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
