This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
from ab467f53dbf [fix](partition) Fix be tablet partition id eq 0 By report
tablet (#32179) (#32667)
new baf3ae1a932 [refactor](nereids)unify outputTupleDesc and projection be
part (#32439)
new 66336e59e6c [fix](join) the result of left semi join with empty right
side should be false, not null (#32477)
new 39382a97740 [fix](Nereids): just pull up alias project above join
through topn (#32305)
new 647a0606aa6 [pipelineX](refactor) Wait for 2-phase execution before
opening (#32613)
new 4b34ecefbe1 [fix](nereids)str_to_date function's signature for folding
constant is wrong (#32474)
new 3f36aa2d482 [chore](Nereids) remove ensure project on top join (#32562)
new 8f3f9a53be7 [feat](Nereids): add is null predicate for the first
partition when updating mv by partition (#32463)
new 4de8775e172 [feat](Nereids): rewrite sum literal to sum and count
(#32244)
new b2db5a4ded1 [fix](restore) fix restore odbc resource bug (#31989)
new 01a5413e45d [fix](Nereids) filter-limit-project translate to wrong
plan (#32496)
new 2f2d4886686 [opt](parquet) Support hive struct schema change (#32438)
new a10466598b4 [fix](jdbc catalog) Fix query errors without jdbc pool
default value on only BE upgrade (#32618)
new 1c521cd94e5 [fix](backup) clear snapshotInfos and backupMeta when
cancel (#32646)
new 6812b575b22 [fix](Nereids) fix bind having aggregate failed (#32490)
new d30ad2ba043 [test](regression) delete invalid test cases (#32654)
new 8a6fc79797d [fix](routine-load) avoid routine load pause for check
transaction status fail (#32638)
new e41311d77d0 [bug](fold) fix fold constant core dump with variant type
(#32265)
new f443d6de853 [Fix](variant) filter with variant access may lead to to
parition/tablet prune fall through (#32560)
new 326a264fcd4 [Improvement](executor)Add spill property for workload
group #32554
new cb3a3291690 [Update](test) update regression case for index change
(#32656)
new 3f093627f2a [fix](metrics) fix compaction_used_permits are negative
numbers (#32440)
new 0d0f787d3e9 [fix](routine-load) fix timeout backoff can not work
(#32661)
The 22 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/exec/exec_node.cpp | 26 +-
be/src/exec/exec_node.h | 4 +
.../schema_workload_groups_scanner.cpp | 7 +-
be/src/olap/olap_server.cpp | 10 +-
be/src/pipeline/exec/hashjoin_probe_operator.cpp | 3 +
be/src/pipeline/exec/join_probe_operator.cpp | 31 ++-
be/src/pipeline/exec/join_probe_operator.h | 12 +-
.../exec/nested_loop_join_probe_operator.cpp | 7 +-
.../exec/nested_loop_join_probe_operator.h | 2 +-
be/src/pipeline/pipeline_x/operator.cpp | 30 +-
be/src/pipeline/pipeline_x/operator.h | 4 +
be/src/pipeline/pipeline_x/pipeline_x_task.cpp | 8 +-
be/src/runtime/fold_constant_executor.cpp | 11 +-
be/src/runtime/workload_group/workload_group.cpp | 28 +-
be/src/runtime/workload_group/workload_group.h | 4 +
be/src/vec/common/hash_table/join_hash_table.h | 15 +-
be/src/vec/data_types/data_type_struct.h | 1 +
.../exec/format/parquet/vparquet_column_reader.cpp | 59 +++-
.../exec/format/parquet/vparquet_column_reader.h | 29 +-
be/src/vec/exec/join/vhash_join_node.cpp | 3 +
be/src/vec/exec/join/vjoin_node_base.cpp | 31 ++-
be/src/vec/exec/join/vjoin_node_base.h | 12 +-
be/src/vec/exec/join/vnested_loop_join_node.cpp | 4 +
be/src/vec/exec/join/vnested_loop_join_node.h | 2 +-
.../apache/doris/jdbc/JdbcDataSourceConfig.java | 10 +-
.../java/org/apache/doris/backup/BackupJob.java | 8 +-
.../org/apache/doris/backup/BackupJobInfo.java | 7 +-
.../java/org/apache/doris/backup/RestoreJob.java | 10 +-
.../org/apache/doris/catalog/FunctionRegistry.java | 41 ++-
.../java/org/apache/doris/catalog/SchemaTable.java | 4 +-
.../load/routineload/KafkaRoutineLoadJob.java | 2 +-
.../doris/load/routineload/KafkaTaskInfo.java | 18 +-
.../doris/load/routineload/RoutineLoadJob.java | 3 +-
.../load/routineload/RoutineLoadTaskInfo.java | 14 +-
.../main/java/org/apache/doris/mtmv/MTMVUtil.java | 15 +-
.../glue/translator/PhysicalPlanTranslator.java | 9 +-
.../doris/nereids/jobs/executor/Rewriter.java | 8 +-
.../org/apache/doris/nereids/rules/RuleType.java | 5 +-
.../nereids/rules/analysis/BindExpression.java | 135 ++++++++-
.../expression/rules/FoldConstantRuleOnBE.java | 30 +-
.../rules/rewrite/EnsureProjectOnTopJoin.java | 60 ----
.../rules/rewrite/PruneOlapScanPartition.java | 114 ++++----
.../nereids/rules/rewrite/PruneOlapScanTablet.java | 73 +++--
.../rules/rewrite/PullUpProjectUnderLimit.java | 6 +-
.../rules/rewrite/PullUpProjectUnderTopN.java | 38 ++-
.../nereids/rules/rewrite/SumLiteralRewrite.java | 185 +++++++++++++
.../functions/AggCombinerFunctionBuilder.java | 5 +
.../functions/BuiltinFunctionBuilder.java | 12 +-
.../expressions/functions/FunctionBuilder.java | 2 +
.../executable/DateTimeExtractAndTransform.java | 11 +-
.../expressions/functions/udf/AliasUdfBuilder.java | 5 +
.../expressions/functions/udf/JavaUdafBuilder.java | 5 +
.../expressions/functions/udf/JavaUdfBuilder.java | 5 +
.../apache/doris/nereids/trees/plans/JoinType.java | 4 +
.../plans/commands/UpdateMvByPartitionCommand.java | 103 ++++---
.../java/org/apache/doris/qe/SessionVariable.java | 9 +-
.../resource/workloadgroup/WorkloadGroup.java | 109 +++++++-
.../resource/workloadgroup/WorkloadGroupMgr.java | 1 +
.../doris/tablefunction/MetadataGenerator.java | 49 +---
.../org/apache/doris/analysis/SqlModeTest.java | 1 +
.../apache/doris/catalog/CreateFunctionTest.java | 3 +-
.../load/routineload/KafkaRoutineLoadJobTest.java | 2 +-
.../routineload/RoutineLoadTaskSchedulerTest.java | 2 +-
.../nereids/postprocess/TopNRuntimeFilterTest.java | 6 +-
.../nereids/rules/analysis/BindRelationTest.java | 2 -
.../nereids/rules/rewrite/InferPredicatesTest.java | 44 ---
.../rules/rewrite/PullUpProjectUnderLimitTest.java | 7 +-
.../rules/rewrite/PullUpProjectUnderTopNTest.java | 8 +-
.../rules/rewrite/PushDownTopNThroughJoinTest.java | 8 +-
.../nereids/rules/rewrite/ReorderJoinTest.java | 6 -
.../rules/rewrite/SumLiteralRewriteTest.java | 54 ++++
.../apache/doris/nereids/sqltest/InferTest.java | 4 -
.../commands/UpdateMvByPartitionCommandTest.java | 62 +++--
.../apache/doris/planner/ConstantExpressTest.java | 1 +
.../org/apache/doris/planner/QueryPlanTest.java | 1 +
.../ExtractCommonFactorsRuleFunctionTest.java | 2 +-
.../apache/doris/rewrite/InferFiltersRuleTest.java | 2 +-
.../doris/rewrite/RewriteInPredicateRuleTest.java | 2 +-
.../transaction/GlobalTransactionMgrTest.java | 4 +-
gensrc/thrift/BackendService.thrift | 2 +
gensrc/thrift/PlanNodes.thrift | 4 +
.../test_null_aware_left_anti_join.out | 5 +
.../data/nereids_clickbench_shape_p0/query30.out | 11 +-
.../data/nereids_clickbench_shape_p0/query35.out | 8 +-
.../data/nereids_clickbench_shape_p0/query36.out | 8 +-
.../data/nereids_clickbench_shape_p0/query40.out | 8 +-
.../data/nereids_p0/hint/fix_leading.out | 23 +-
.../data/nereids_p0/limit/filterLimitProject.out | 8 +
.../eliminate_outer_join/eliminate_outer_join.out | 180 ++++++------
.../push_down_alias_through_join.out | 72 +++--
.../data/nereids_rules_p0/sumRewrite.out | 142 ++++++++++
regression-test/data/nereids_shape_check/load.out | 36 ++-
.../data/nereids_syntax_p0/bind_priority.out | 40 +++
.../shape/query10.out | 8 +-
.../shape/query17.out | 8 +-
.../shape/query27.out | 61 ++--
.../shape/query28.out | 101 ++++---
.../shape/query35.out | 8 +-
.../shape/query39.out | 19 +-
.../shape/query54.out | 8 +-
.../shape/query58.out | 139 +++++-----
.../shape/query59.out | 59 ++--
.../shape/query61.out | 6 +-
.../shape/query69.out | 8 +-
.../shape/query83.out | 129 +++++----
.../shape/query88.out | 145 +++++-----
.../noStatsRfPrune/query10.out | 8 +-
.../noStatsRfPrune/query17.out | 8 +-
.../noStatsRfPrune/query27.out | 59 ++--
.../noStatsRfPrune/query28.out | 101 ++++---
.../noStatsRfPrune/query35.out | 8 +-
.../noStatsRfPrune/query39.out | 19 +-
.../noStatsRfPrune/query54.out | 8 +-
.../noStatsRfPrune/query58.out | 179 ++++++------
.../noStatsRfPrune/query59.out | 57 ++--
.../noStatsRfPrune/query61.out | 6 +-
.../noStatsRfPrune/query69.out | 8 +-
.../noStatsRfPrune/query83.out | 165 ++++++-----
.../noStatsRfPrune/query88.out | 145 +++++-----
.../no_stats_shape/query10.out | 8 +-
.../no_stats_shape/query17.out | 8 +-
.../no_stats_shape/query27.out | 59 ++--
.../no_stats_shape/query28.out | 101 ++++---
.../no_stats_shape/query35.out | 8 +-
.../no_stats_shape/query39.out | 19 +-
.../no_stats_shape/query54.out | 8 +-
.../no_stats_shape/query58.out | 179 ++++++------
.../no_stats_shape/query59.out | 57 ++--
.../no_stats_shape/query61.out | 6 +-
.../no_stats_shape/query69.out | 8 +-
.../no_stats_shape/query83.out | 165 ++++++-----
.../no_stats_shape/query88.out | 145 +++++-----
.../rf_prune/query10.out | 8 +-
.../rf_prune/query17.out | 8 +-
.../rf_prune/query27.out | 63 +++--
.../rf_prune/query28.out | 101 ++++---
.../rf_prune/query35.out | 8 +-
.../rf_prune/query39.out | 19 +-
.../rf_prune/query54.out | 8 +-
.../rf_prune/query58.out | 139 +++++-----
.../rf_prune/query59.out | 59 ++--
.../rf_prune/query61.out | 6 +-
.../rf_prune/query69.out | 8 +-
.../rf_prune/query83.out | 129 +++++----
.../rf_prune/query88.out | 145 +++++-----
.../nereids_tpcds_shape_sf100_p0/shape/query10.out | 8 +-
.../nereids_tpcds_shape_sf100_p0/shape/query17.out | 8 +-
.../nereids_tpcds_shape_sf100_p0/shape/query27.out | 63 +++--
.../nereids_tpcds_shape_sf100_p0/shape/query28.out | 101 ++++---
.../nereids_tpcds_shape_sf100_p0/shape/query35.out | 8 +-
.../nereids_tpcds_shape_sf100_p0/shape/query39.out | 19 +-
.../nereids_tpcds_shape_sf100_p0/shape/query54.out | 8 +-
.../nereids_tpcds_shape_sf100_p0/shape/query58.out | 139 +++++-----
.../nereids_tpcds_shape_sf100_p0/shape/query59.out | 59 ++--
.../nereids_tpcds_shape_sf100_p0/shape/query61.out | 6 +-
.../nereids_tpcds_shape_sf100_p0/shape/query69.out | 8 +-
.../nereids_tpcds_shape_sf100_p0/shape/query83.out | 129 +++++----
.../nereids_tpcds_shape_sf100_p0/shape/query88.out | 145 +++++-----
.../data/variant_p0/select_partition.out | 29 ++
.../data/workload_manager_p0/test_curd_wlg.out | 12 +
.../correctness/test_date_function_const.groovy | 2 +
.../correctness/test_time_diff_microseconds.groovy | 2 +
.../suites/correctness_p0/test_cast_null.groovy | 2 +-
.../test_null_aware_left_anti_join.groovy | 11 +
.../nereids/test_agg_state_nereids.groovy | 2 +-
.../index_change/test_pk_uk_index_change.groovy | 1 +
.../suites/job_p0/test_base_insert_job.groovy | 306 ---------------------
.../nereids_p0/limit/filterLimitProject.groovy | 58 ++++
.../test_date_function_prune.groovy | 5 +
.../suites/nereids_rules_p0/sumRewrite.groovy | 118 ++++++++
.../suites/nereids_syntax_p0/bind_priority.groovy | 143 +++++++++-
.../shape/query21.groovy | 1 +
.../noStatsRfPrune/query21.groovy | 1 +
.../no_stats_shape/query21.groovy | 1 +
.../rf_prune/query21.groovy | 1 +
.../shape/query21.groovy | 1 +
.../suites/variant_p0/select_partition.groovy | 152 ++++++++++
.../workload_manager_p0/test_curd_wlg.groovy | 76 +++++
178 files changed, 3993 insertions(+), 2800 deletions(-)
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/EnsureProjectOnTopJoin.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/SumLiteralRewrite.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/SumLiteralRewriteTest.java
create mode 100644 regression-test/data/nereids_p0/limit/filterLimitProject.out
create mode 100644 regression-test/data/nereids_rules_p0/sumRewrite.out
create mode 100644 regression-test/data/variant_p0/select_partition.out
delete mode 100644 regression-test/suites/job_p0/test_base_insert_job.groovy
create mode 100644
regression-test/suites/nereids_p0/limit/filterLimitProject.groovy
create mode 100644 regression-test/suites/nereids_rules_p0/sumRewrite.groovy
create mode 100644 regression-test/suites/variant_p0/select_partition.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
