This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from fb5a3e118a [feature-wip](dlf) prepare to support aliyun dlf (#13969)
add 27549564a7 [feature](table-valued-function) Support S3 tvf (#13959)
No new revisions were added by this update.
Summary of changes:
be/src/exec/exec_node.cpp | 10 +-
be/src/runtime/fragment_mgr.cpp | 4 +-
be/src/service/internal_service.cpp | 74 +++++++
be/src/service/internal_service.h | 5 +
be/src/vec/CMakeLists.txt | 4 +-
.../vdata_gen_function_inf.h} | 6 +-
.../vnumbers_tvf.cpp} | 13 +-
.../vnumbers_tvf.h} | 8 +-
be/src/vec/exec/format/csv/csv_reader.cpp | 148 ++++++++++++-
be/src/vec/exec/format/csv/csv_reader.h | 19 ++
be/src/vec/exec/format/generic_reader.h | 5 +
...nction_scannode.cpp => vdata_gen_scan_node.cpp} | 35 ++--
...d_function_scannode.h => vdata_gen_scan_node.h} | 11 +-
.../doris/analysis/TableValuedFunctionRef.java | 14 +-
.../org/apache/doris/catalog/FunctionGenTable.java | 11 +-
.../java/org/apache/doris/common/util/S3URI.java | 4 +-
...dFunctionScanNode.java => DataGenScanNode.java} | 26 +--
.../apache/doris/planner/DistributedPlanner.java | 2 +-
.../apache/doris/planner/SingleNodePlanner.java | 3 +-
.../planner/external/ExternalFileScanNode.java | 63 ++++--
...anProviderIf.java => HMSTableScanProvider.java} | 12 +-
.../doris/planner/external/HiveScanProvider.java | 141 +------------
.../doris/planner/external/QueryScanProvider.java | 183 ++++++++++++++++
.../doris/planner/external/TVFScanProvider.java | 142 +++++++++++++
.../org/apache/doris/rpc/BackendServiceClient.java | 5 +
.../org/apache/doris/rpc/BackendServiceProxy.java | 12 ++
.../DataGenTableValuedFunction.java} | 12 +-
.../ExternalFileTableValuedFunction.java | 233 +++++++++++++++++++++
.../tablefunction/NumbersTableValuedFunction.java | 29 +--
.../doris/tablefunction/S3TableValuedFunction.java | 111 ++++++++++
...FunctionInf.java => TableValuedFunctionIf.java} | 33 +--
gensrc/proto/internal_service.proto | 12 ++
gensrc/thrift/PlanNodes.thrift | 14 +-
33 files changed, 1134 insertions(+), 270 deletions(-)
rename be/src/vec/exec/{tablefunction/vtable_valued_function_inf.h =>
data_gen_functions/vdata_gen_function_inf.h} (90%)
rename be/src/vec/exec/{tablefunction/vnumbers_tbf.cpp =>
data_gen_functions/vnumbers_tvf.cpp} (87%)
rename be/src/vec/exec/{tablefunction/vnumbers_tbf.h =>
data_gen_functions/vnumbers_tvf.h} (87%)
rename be/src/vec/exec/{vtable_valued_function_scannode.cpp =>
vdata_gen_scan_node.cpp} (69%)
rename be/src/vec/exec/{vtable_valued_function_scannode.h =>
vdata_gen_scan_node.h} (84%)
rename
fe/fe-core/src/main/java/org/apache/doris/planner/{TableValuedFunctionScanNode.java
=> DataGenScanNode.java} (78%)
rename
fe/fe-core/src/main/java/org/apache/doris/planner/external/{HMSTableScanProviderIf.java
=> HMSTableScanProvider.java} (75%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/planner/external/QueryScanProvider.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/planner/external/TVFScanProvider.java
copy
fe/fe-core/src/main/java/org/apache/doris/{common/proc/ProcDirInterface.java =>
tablefunction/DataGenTableValuedFunction.java} (70%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/tablefunction/ExternalFileTableValuedFunction.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/tablefunction/S3TableValuedFunction.java
rename
fe/fe-core/src/main/java/org/apache/doris/tablefunction/{TableValuedFunctionInf.java
=> TableValuedFunctionIf.java} (52%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
