Yufei Gu created SPARK-36814:
--------------------------------
Summary: Make class ColumnarBatch extendable
Key: SPARK-36814
URL: https://issues.apache.org/jira/browse/SPARK-36814
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.3.0
Reporter: Yufei Gu
To support better vectorized reading in multiple data source, ColumnarBatch
need to be extendable. For example, To support row-level delete(
[https://github.com/apache/iceberg/issues/3141]) in Iceberg's vectorized read,
we need to filter out deleted rows in a batch, which requires ColumnarBatch to
be extendable.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
