[
https://issues.apache.org/jira/browse/HUDI-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17879395#comment-17879395
]
Ethan Guo commented on HUDI-8099:
---------------------------------
https://github.com/apache/hudi/pull/11770#discussion_r1743082812
ColumnarBatchUtils class contains logic that should be deprecated after Spark 2
integration is removed from the code base.
> Create inplace columnar batch projection
> ----------------------------------------
>
> Key: HUDI-8099
> URL: https://issues.apache.org/jira/browse/HUDI-8099
> Project: Apache Hudi
> Issue Type: Improvement
> Components: spark
> Reporter: Jonathan Vexler
> Assignee: Jonathan Vexler
> Priority: Major
> Fix For: 1.0.0
>
>
> After we deprecate spark 2, we will only support spark3.3+. ColumnarBatch is
> no longer final in spark 3.3, so we can extend it. Create columnar batch
> projection class that will reorder a columnar batch so we don't need to
> create a new array of column vectors.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
