This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from 2ca66ff61ca [typo](test) Use correct sql stmt in regression test
(#27992)
add 54d062ddeee [feature](stream load) (step one)Add arrow data type for
stream load (#26709)
No new revisions were added by this update.
Summary of changes:
be/src/util/load_util.cpp | 3 +
.../serde/data_type_datetimev2_serde.cpp | 54 ++++++++++
.../data_types/serde/data_type_datetimev2_serde.h | 5 +-
.../data_types/serde/data_type_datev2_serde.cpp | 2 +-
.../data_types/serde/data_type_decimal_serde.cpp | 8 +-
.../exec/format/arrow/arrow_pip_input_stream.cpp | 101 ++++++++++++++++++
.../arrow_pip_input_stream.h} | 46 ++++----
.../vec/exec/format/arrow/arrow_stream_reader.cpp | 117 +++++++++++++++++++++
.../arrow_stream_reader.h} | 62 +++++------
be/src/vec/exec/scan/vfile_scanner.cpp | 9 +-
.../org/apache/doris/analysis/DataDescription.java | 4 +
.../doris/common/util/FileFormatConstants.java | 1 +
.../java/org/apache/doris/common/util/Util.java | 4 +-
.../src/main/java/org/apache/doris/load/Load.java | 14 ++-
gensrc/thrift/PlanNodes.thrift | 1 +
15 files changed, 368 insertions(+), 63 deletions(-)
create mode 100644 be/src/vec/exec/format/arrow/arrow_pip_input_stream.cpp
copy be/src/vec/exec/format/{file_reader/new_plain_binary_line_reader.h =>
arrow/arrow_pip_input_stream.h} (54%)
create mode 100644 be/src/vec/exec/format/arrow/arrow_stream_reader.cpp
copy be/src/vec/exec/format/{table/hudi_jni_reader.h =>
arrow/arrow_stream_reader.h} (57%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
