This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from 2815f977d3b [exec](runtimefilter) support null aware in runtime filter
(#32152)
add aafd28fc015 [feature](hudi) support hudi incremental read (#32052)
No new revisions were added by this update.
Summary of changes:
conf/be.conf | 2 +-
docs/en/docs/lakehouse/multi-catalog/hudi.md | 33 ++-
docs/zh-CN/docs/lakehouse/multi-catalog/hudi.md | 37 ++-
.../java/org/apache/doris/hudi/HudiJniScanner.java | 12 +-
.../org/apache/doris/hudi/BaseSplitReader.scala | 8 +-
.../apache/doris/hudi/HoodieRecordIterator.scala | 67 ++++--
.../doris/hudi/MORIncrementalSplitReader.scala | 86 +++++++
.../apache/doris/hudi/MORSnapshotSplitReader.scala | 2 +-
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 6 +-
fe/fe-core/src/main/cup/sql_parser.cup | 16 +-
.../java/org/apache/doris/analysis/TableRef.java | 14 ++
.../{AlterClause.java => TableScanParams.java} | 28 ++-
.../doris/datasource/hive/HMSExternalTable.java | 100 +++++++-
.../hudi/source/COWIncrementalRelation.java | 254 +++++++++++++++++++++
.../doris/datasource/hudi/source/HudiScanNode.java | 175 +++++++++-----
.../source/IncrementalRelation.java} | 25 +-
.../hudi/source/MORIncrementalRelation.java | 217 ++++++++++++++++++
.../doris/nereids/analyzer/UnboundRelation.java | 34 ++-
.../doris/nereids/parser/LogicalPlanBuilder.java | 9 +-
.../doris/nereids/rules/analysis/BindRelation.java | 8 +-
.../doris/nereids/rules/analysis/CheckPolicy.java | 25 +-
.../data/external_table_p2/hive/test_hive_hudi.out | 12 +
.../external_table_p2/hive/test_hive_hudi.groovy | 6 +
23 files changed, 1041 insertions(+), 135 deletions(-)
create mode 100644
fe/be-java-extensions/hudi-scanner/src/main/scala/org/apache/doris/hudi/MORIncrementalSplitReader.scala
copy fe/fe-core/src/main/java/org/apache/doris/analysis/{AlterClause.java =>
TableScanParams.java} (58%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/hudi/source/COWIncrementalRelation.java
copy fe/fe-core/src/main/java/org/apache/doris/datasource/{SplitCreator.java
=> hudi/source/IncrementalRelation.java} (61%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/hudi/source/MORIncrementalRelation.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
