Hello Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/24190
to look at the new patch set (#19).
Change subject: WIP IMPALA-14882: Add efficient conversion between RowBatch and
arrow
......................................................................
WIP IMPALA-14882: Add efficient conversion between RowBatch and arrow
Convert Impala row batches to Arrow record batches and vice versa.
Updated paimon jni reader to use this conversion when parsing arrow
records.
Current implementation doesn't support conversion of nested types, it
writes nulls instead.
TODO:
-split up into two parts:
arrow -> impala conversion
impala->arrow conversion
-handle nested types (in a separate patch)
Change-Id: Iea544b3c71d9211c893f0fec3527ebe84155ebcd
---
M be/src/exec/CMakeLists.txt
A be/src/exec/arrow-converter-test.cc
A be/src/exec/arrow-converter.cc
A be/src/exec/arrow-converter.h
M be/src/exec/paimon/CMakeLists.txt
D be/src/exec/paimon/paimon-jni-row-reader.cc
D be/src/exec/paimon/paimon-jni-row-reader.h
M be/src/exec/paimon/paimon-jni-scan-node.cc
M be/src/exec/paimon/paimon-jni-scan-node.h
M be/src/exec/scratch-tuple-batch.h
10 files changed, 1,653 insertions(+), 515 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/90/24190/19
--
To view, visit http://gerrit.cloudera.org:8080/24190
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Iea544b3c71d9211c893f0fec3527ebe84155ebcd
Gerrit-Change-Number: 24190
Gerrit-PatchSet: 19
Gerrit-Owner: Balazs Hevele <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
