Balazs Hevele has uploaded this change for review. ( http://gerrit.cloudera.org:8080/24338
Change subject: IMPALA-14882: part2: Convert impala tuple batch to arrow record batch ...................................................................... IMPALA-14882: part2: Convert impala tuple batch to arrow record batch Added conversion from an impala batch of tuple rows to an arrow record batch. Memory for arrow arrays and buffers for var len data are allocated from a MemPool. Buffers for arrow arrays are manually assembled from the impala structures and arrow arrays are created through arrow's arraydata. This patch does not handle nested types (array/list, struct, map). Testing: -added test cases to arrow-converter-test.cc for different types Measurement: -added cases to arrow-converter-bencmark Change-Id: I37be9989ad6d7016ae1223bc131cb3f6a1af1bb2 --- M be/src/benchmarks/arrow-converter-benchmark.cc M be/src/exec/arrow-converter-test.cc M be/src/exec/arrow-converter.cc M be/src/exec/arrow-converter.h 4 files changed, 705 insertions(+), 89 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/38/24338/1 -- To view, visit http://gerrit.cloudera.org:8080/24338 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I37be9989ad6d7016ae1223bc131cb3f6a1af1bb2 Gerrit-Change-Number: 24338 Gerrit-PatchSet: 1 Gerrit-Owner: Balazs Hevele <[email protected]>
