This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from 90dd8716ed [refactor](multicast) change the way multicast do filter,
project and shuffle (#21412)
add 9adbca685a [opt](hudi) use spark bundle to read hudi data (#21260)
No new revisions were added by this update.
Summary of changes:
be/src/vec/exec/scan/hudi_jni_reader.cpp | 6 +-
be/src/vec/exec/scan/hudi_jni_reader.h | 2 +-
bin/start_be.sh | 12 +-
.../org/apache/doris/avro/AvroColumnValue.java | 5 +
.../java/org/apache/doris/avro/AvroJNIScanner.java | 1 +
fe/be-java-extensions/hudi-scanner/pom.xml | 202 +++++-
.../org/apache/doris/hudi/HudiColumnValue.java | 141 +++--
.../java/org/apache/doris/hudi/HudiJniScanner.java | 194 ++----
.../java/org/apache/doris/hudi/HudiScanParam.java | 194 ------
.../java/org/apache/doris/hudi/HudiScanUtils.java | 62 --
.../src/main/java/org/apache/doris/hudi/Utils.java | 21 +
.../org/apache/doris/hudi/BaseSplitReader.scala | 702 +++++++++++++++++++++
.../apache/doris/hudi/HoodieRecordIterator.scala | 142 +++++
.../apache/doris/hudi/MORSnapshotSplitReader.scala | 183 ++++++
.../org/apache/doris/common/jni/JniScanner.java | 9 +-
.../apache/doris/common/jni/MockJniScanner.java | 11 +-
.../apache/doris/common/jni/vec/ColumnValue.java | 2 +
.../doris/common/jni/vec/NativeColumnValue.java} | 52 +-
.../apache/doris/common/jni/vec/ScanPredicate.java | 5 +
.../apache/doris/common/jni/vec/VectorColumn.java | 35 +-
.../apache/doris/common/jni/vec/VectorTable.java | 5 +
.../doris/maxcompute/MaxComputeColumnValue.java | 10 +-
.../doris/maxcompute/MaxComputeJniScanner.java | 7 -
.../org/apache/doris/paimon/PaimonColumnValue.java | 7 +-
.../org/apache/doris/paimon/PaimonJniScanner.java | 7 -
.../java/org/apache/doris/catalog/HudiUtils.java | 3 +
26 files changed, 1479 insertions(+), 541 deletions(-)
delete mode 100644
fe/be-java-extensions/hudi-scanner/src/main/java/org/apache/doris/hudi/HudiScanParam.java
delete mode 100644
fe/be-java-extensions/hudi-scanner/src/main/java/org/apache/doris/hudi/HudiScanUtils.java
create mode 100644
fe/be-java-extensions/hudi-scanner/src/main/scala/org/apache/doris/hudi/BaseSplitReader.scala
create mode 100644
fe/be-java-extensions/hudi-scanner/src/main/scala/org/apache/doris/hudi/HoodieRecordIterator.scala
create mode 100644
fe/be-java-extensions/hudi-scanner/src/main/scala/org/apache/doris/hudi/MORSnapshotSplitReader.scala
copy fe/{fe-core/src/main/java/org/apache/doris/plugin/PluginContext.java =>
be-java-extensions/java-common/src/main/java/org/apache/doris/common/jni/vec/NativeColumnValue.java}
(52%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
