This is an automated email from the ASF dual-hosted git repository.
kxiao pushed a change to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from 74198c1f30 [pipeline](task_queue) remove disable steal in task queue
to speed up query (#21737)
new b375a8bd21 [imporve](bloomfilter) refactor runtime_filter_mgr with
bloomfilter (#21715)
new 5d3fc457fa [feature](hive)add read of the hive table textfile format
array type (#21514)
new 022c404987 [opt](nereids) convert OR expression to IN expression
(#21326)
new 0b668d70bf [opt](stats)update tbl stats of statistics collection after
system statistics collection job succeeded (#21528)
new 1d74c78077 Remove unused code (#21735)
new 3304f62d57 [fix](multi-table-load) fix memory leak when processing
multi-table routine load (#21611)
The 6 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/exec/exec_node.cpp | 32 ----
be/src/exec/exec_node.h | 6 -
be/src/exec/scan_node.h | 5 -
be/src/exec/text_converter.cpp | 191 ++++++++++++++++++++-
be/src/exec/text_converter.h | 5 +-
be/src/io/fs/multi_table_pipe.h | 7 +-
be/src/olap/reader.cpp | 1 -
be/src/olap/reader.h | 2 -
be/src/pipeline/pipeline_fragment_context.cpp | 1 -
be/src/runtime/plan_fragment_executor.cpp | 2 -
be/src/runtime/runtime_filter_mgr.cpp | 38 ++--
be/src/runtime/runtime_filter_mgr.h | 13 +-
be/src/vec/exec/format/csv/csv_reader.cpp | 10 +-
be/src/vec/exec/format/csv/csv_reader.h | 2 +
be/src/vec/exec/scan/new_olap_scan_node.cpp | 3 +-
be/src/vec/exec/scan/new_olap_scanner.cpp | 8 +-
be/src/vec/exec/scan/new_olap_scanner.h | 3 +-
be/src/vec/exec/scan/vscan_node.h | 3 -
.../expression/AbstractExpressionRewriteRule.java | 2 +-
.../rules/expression/ExpressionOptimization.java | 5 +-
.../rules/expression/ExpressionRewriteContext.java | 2 +
.../rules/expression/ExpressionRewriteRule.java | 4 +-
.../nereids/rules/expression/rules/OrToIn.java | 149 ++++++++++++++++
.../doris/planner/external/HiveScanNode.java | 22 ++-
.../apache/doris/statistics/AnalysisManager.java | 12 +-
.../nereids/datasets/ssb/SSBJoinReorderTest.java | 8 +-
.../doris/nereids/rules/rewrite/OrToInTest.java | 93 ++++++++++
gensrc/thrift/PlanNodes.thrift | 1 +
.../hive/test_hive_to_array.out | 22 +++
.../nereids_tpcds_shape_sf100_p0/shape/query11.out | 41 +++--
.../nereids_tpcds_shape_sf100_p0/shape/query4.out | 68 ++++----
.../nereids_tpcds_shape_sf100_p0/shape/query41.out | 2 +-
.../nereids_tpcds_shape_sf100_p0/shape/query46.out | 2 +-
.../nereids_tpcds_shape_sf100_p0/shape/query74.out | 12 +-
.../nereids_tpcds_shape_sf100_p0/shape/query75.out | 6 +-
..._partition.groovy => test_hive_to_array.groovy} | 18 +-
36 files changed, 620 insertions(+), 181 deletions(-)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/rules/OrToIn.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/OrToInTest.java
create mode 100644
regression-test/data/external_table_emr_p2/hive/test_hive_to_array.out
copy
regression-test/suites/external_table_emr_p2/hive/{test_hive_remove_partition.groovy
=> test_hive_to_array.groovy} (80%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
