Kazuaki Ishizaki created SPARK-20783:
----------------------------------------
Summary: Enhance ColumnVector to keep UnsafeArrayData for array
Key: SPARK-20783
URL: https://issues.apache.org/jira/browse/SPARK-20783
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 2.3.0
Reporter: Kazuaki Ishizaki
Current {{ColumnVector}} accepts only primitive-type Java array as an input for
array. It is good to keep data from Parquet.
On the other hand, in Spark internal, {{UnsafeArrayData}} is frequently used to
represent array, map, and struct. To keep these data, this JIRA entry enhances
{{ColumnVector}} to keep UnsafeArrayData.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
