Hello Xuebin Su, Csaba Ringhofer, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/24338
to look at the new patch set (#5).
Change subject: IMPALA-14882: part2: Convert impala tuple batch to arrow record
batch
......................................................................
IMPALA-14882: part2: Convert impala tuple batch to arrow record batch
Added conversion from an impala batch of tuple rows to an arrow record
batch.
Memory for arrow arrays and buffers for var len data are allocated from
a MemPool. Buffers for arrow arrays are manually assembled from the
impala structures and arrow arrays are created through arrow's
arraydata.
This patch does not handle nested types (array/list, struct, map).
Testing:
-added test cases to arrow-converter-test.cc for different types
Measurement:
-added cases to arrow-converter-bencmark
Change-Id: I37be9989ad6d7016ae1223bc131cb3f6a1af1bb2
---
M be/src/benchmarks/arrow-converter-benchmark.cc
M be/src/exec/arrow-converter-test.cc
M be/src/exec/arrow-converter.cc
M be/src/exec/arrow-converter.h
M be/src/runtime/outbound-row-batch.cc
5 files changed, 732 insertions(+), 95 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/38/24338/5
--
To view, visit http://gerrit.cloudera.org:8080/24338
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I37be9989ad6d7016ae1223bc131cb3f6a1af1bb2
Gerrit-Change-Number: 24338
Gerrit-PatchSet: 5
Gerrit-Owner: Balazs Hevele <[email protected]>
Gerrit-Reviewer: Balazs Hevele <[email protected]>
Gerrit-Reviewer: Csaba Ringhofer <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Xuebin Su <[email protected]>
