Yaohua Zhao created SPARK-37896:
-----------------------------------
Summary: ConstantColumnVector: a column vector with same values
Key: SPARK-37896
URL: https://issues.apache.org/jira/browse/SPARK-37896
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.2.0
Reporter: Yaohua Zhao
Introduce a new column vector named `ConstantColumnVector`, it represents a
column vector where every row has the same constant value.
It could help improve performance on hidden file metadata columnar file format,
since metadata fields for every row in each file are exactly the same, we don't
need to copy and keep multiple copies of data.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
