Jonathan Vexler created HUDI-8099:
-------------------------------------

             Summary: Create inplace columnar batch projection
                 Key: HUDI-8099
                 URL: https://issues.apache.org/jira/browse/HUDI-8099
             Project: Apache Hudi
          Issue Type: Improvement
          Components: spark
            Reporter: Jonathan Vexler
            Assignee: Jonathan Vexler
             Fix For: 1.0.0


After we deprecate spark 2, we will only support spark3.3+. ColumnarBatch is no 
longer final in spark 3.3, so we can extend it. Create columnar batch 
projection class that will reorder a columnar batch so we don't need to create 
a new array of column vectors.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to