This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
from 92a9e8265b4 [Imporve](RF) Support remote broadcast join build bf
exactly (#30247)
new 3d22543adde [pipelineX](fix) Fix coredump if prepare failed (#30250)
new 8c6e5202d4e [chore](ci) remove some unused code (#30253)
new f4a10c3fbc8 [enhancement](Nereids): add builder for hyper graph
(#30061)
new 1b9f1f6483e [feature](Planner): Push down TopNDistinct through Join
(#30216)
new 4cbacb5b39c [enhancement](recover) Support skipping bad tablet in
select by session variable (#30241)
new b98acf2d905 [fix](mtmv)mtmv default open enableNereidsDML #30235
new 72f4e7e2d1c [security] Don't print token (#30227)
new 02a27a587ac remove some unused member function of IFunctionBase
(#30260)
new 5e66e2519db [improve](column) support append_data_by_selector function
in const column (#29996)
new 1a51d04cb89 [fix](move-memtable) fix schema use-after-free in delta
writer v2 (#30254)
new 4af3fd2a2e2 [fix](Nereids) fix bug in case-when/if stats estimation
(#30265)
new 2b3e7589b74 [fix](nereids)group by expr may be lost in
EliminateGroupByConstant rule (#30274)
new 040ace126cf [fix](Nereids) group by key should be required (#30273)
new 5213f941dd4 [improvement](cooldown) print the cooldown version when
follow cooldown version (#30239)
new dde5ed5231b [fix](fe-memory) Fix fe schema change high memory usage
(#30231)
new c7360fd0149 [feature](function) support ip function named
ipv4_cidr_to_range(addr, cidr) (#29819)
The 16 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/comment-to-trigger-teamcity.yml | 21 +-
be/src/agent/heartbeat_server.cpp | 3 +-
be/src/olap/delta_writer_context.h | 4 +-
be/src/olap/delta_writer_v2.cpp | 2 +-
be/src/olap/rowset_builder.cpp | 3 +-
be/src/olap/tablet.cpp | 6 +-
be/src/pipeline/pipeline_x/operator.cpp | 6 +-
be/src/pipeline/pipeline_x/operator.h | 8 +-
be/src/pipeline/pipeline_x/pipeline_x_task.cpp | 14 +-
be/src/runtime/load_stream.cpp | 5 +-
be/src/runtime/load_stream.h | 3 +-
be/src/runtime/tablets_channel.cpp | 6 +-
be/src/runtime/tablets_channel.h | 2 +-
be/src/vec/columns/column_const.h | 4 +-
be/src/vec/functions/function.h | 113 ----
be/src/vec/functions/function_bit.cpp | 2 +-
be/src/vec/functions/function_bit_count.cpp | 2 +-
be/src/vec/functions/function_cast.h | 4 -
be/src/vec/functions/function_ip.cpp | 1 +
be/src/vec/functions/function_ip.h | 97 +++
be/src/vec/functions/function_java_udf.h | 13 +-
be/src/vec/functions/function_reverse.h | 2 -
be/src/vec/functions/function_rpc.h | 4 -
be/src/vec/functions/function_string.cpp | 2 -
be/src/vec/functions/function_string_to_string.h | 10 +-
be/src/vec/functions/function_unary_arithmetic.h | 3 +-
be/src/vec/functions/if.cpp | 5 -
be/src/vec/functions/is_not_null.cpp | 5 -
be/src/vec/functions/is_null.cpp | 4 -
be/src/vec/functions/math.cpp | 12 +-
be/src/vec/sink/writer/vtablet_writer_v2.cpp | 2 +-
be/test/olap/delta_writer_test.cpp | 16 +-
.../olap/engine_storage_migration_task_test.cpp | 4 +-
be/test/olap/memtable_memory_limiter_test.cpp | 4 +-
be/test/olap/remote_rowset_gc_test.cpp | 4 +-
be/test/olap/tablet_cooldown_test.cpp | 4 +-
be/test/runtime/load_stream_test.cpp | 6 +-
be/test/vec/core/block_spill_test.cpp | 6 +-
be/test/vec/core/block_test.cpp | 2 +-
be/test/vec/jsonb/serialize_test.cpp | 2 +-
docs/en/docs/advanced/variables.md | 4 +
docs/zh-CN/docs/advanced/variables.md | 4 +
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 2 +-
.../java/org/apache/doris/alter/RollupJobV2.java | 3 +
.../org/apache/doris/alter/SchemaChangeJobV2.java | 7 +-
.../org/apache/doris/analysis/DescriptorTable.java | 7 +
.../doris/catalog/BuiltinScalarFunctions.java | 2 +
.../main/java/org/apache/doris/catalog/Env.java | 2 +-
.../doris/job/extensions/insert/InsertTask.java | 1 +
.../java/org/apache/doris/mtmv/MTMVPlanUtil.java | 1 +
.../doris/nereids/jobs/executor/Rewriter.java | 5 +-
.../doris/nereids/jobs/joinorder/JoinOrderJob.java | 7 +-
.../jobs/joinorder/hypergraph/HyperGraph.java | 715 ++++++++++-----------
.../joinorder/hypergraph/node/StructInfoNode.java | 16 -
.../org/apache/doris/nereids/rules/RuleType.java | 2 +
.../rules/analysis/EliminateGroupByConstant.java | 2 +-
.../nereids/rules/exploration/mv/StructInfo.java | 2 +-
...n.java => PushDownTopNDistinctThroughJoin.java} | 66 +-
.../doris/nereids/stats/ExpressionEstimation.java | 68 +-
.../{Ipv6CIDRToRange.java => Ipv4CIDRToRange.java} | 28 +-
.../expressions/visitor/ScalarFunctionVisitor.java | 5 +
.../org/apache/doris/nereids/util/PlanUtils.java | 6 +
.../org/apache/doris/planner/OlapScanNode.java | 3 +
.../java/org/apache/doris/qe/SessionVariable.java | 11 +
.../org/apache/doris/task/AlterReplicaTask.java | 15 +-
.../joinorder/hypergraph/CompareOuterJoinTest.java | 24 +-
.../jobs/joinorder/hypergraph/InferJoinTest.java | 16 +-
.../joinorder/hypergraph/InferPredicateTest.java | 4 +-
.../joinorder/hypergraph/PullupExpressionTest.java | 16 +-
.../rules/exploration/mv/BuildStructInfoTest.java | 8 +-
.../rules/exploration/mv/HyperGraphAggTest.java | 6 +-
.../exploration/mv/HyperGraphComparatorTest.java | 16 +-
.../nereids/stats/ExpressionEstimationTest.java | 63 ++
.../doris/nereids/util/HyperGraphBuilder.java | 4 +-
gensrc/script/doris_builtins_functions.py | 2 +
gensrc/thrift/PaloInternalService.thrift | 5 +
.../limit_push_down/order_push_down.out | 22 +-
.../push_down_top_n_distinct_through_join.out | 47 ++
.../ip_functions/test_ipv4_cidr_to_range.out | 28 +
regression-test/pipeline/common/doris-utils.sh | 12 +-
regression-test/pipeline/common/github-utils.sh | 25 -
regression-test/pipeline/performance/run-tpcds.sh | 1 +
regression-test/pipeline/performance/run-tpch.sh | 1 +
regression-test/pipeline/tpch/tpch-sf100/clean.sh | 40 --
.../pipeline/tpch/tpch-sf100/conf/be.conf | 85 ---
.../pipeline/tpch/tpch-sf100/conf/external.json | 26 -
.../pipeline/tpch/tpch-sf100/conf/fe.conf | 78 ---
.../pipeline/tpch/tpch-sf100/conf/odbcinst.ini | 43 --
regression-test/pipeline/tpch/tpch-sf100/deploy.sh | 119 ----
.../pipeline/tpch/tpch-sf100/prepare.sh | 69 --
regression-test/pipeline/tpch/tpch-sf100/run.sh | 131 ----
.../push_down_top_n_distinct_through_join.groovy} | 49 +-
.../ip_functions/test_ipv4_cidr_to_range.groovy} | 43 +-
93 files changed, 973 insertions(+), 1410 deletions(-)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/{PushDownTopNThroughJoin.java
=> PushDownTopNDistinctThroughJoin.java} (59%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{Ipv6CIDRToRange.java
=> Ipv4CIDRToRange.java} (69%)
create mode 100644
regression-test/data/nereids_rules_p0/push_down_top_n/push_down_top_n_distinct_through_join.out
create mode 100644
regression-test/data/query_p0/sql_functions/ip_functions/test_ipv4_cidr_to_range.out
delete mode 100644 regression-test/pipeline/tpch/tpch-sf100/clean.sh
delete mode 100644 regression-test/pipeline/tpch/tpch-sf100/conf/be.conf
delete mode 100644 regression-test/pipeline/tpch/tpch-sf100/conf/external.json
delete mode 100644 regression-test/pipeline/tpch/tpch-sf100/conf/fe.conf
delete mode 100644 regression-test/pipeline/tpch/tpch-sf100/conf/odbcinst.ini
delete mode 100644 regression-test/pipeline/tpch/tpch-sf100/deploy.sh
delete mode 100644 regression-test/pipeline/tpch/tpch-sf100/prepare.sh
delete mode 100644 regression-test/pipeline/tpch/tpch-sf100/run.sh
copy
regression-test/suites/nereids_rules_p0/{push_down_limit_distinct/push_down_limit_distinct.groovy
=> push_down_top_n/push_down_top_n_distinct_through_join.groovy} (52%)
copy regression-test/suites/{datatype_p0/ip/test_ip_in_predicate.groovy =>
query_p0/sql_functions/ip_functions/test_ipv4_cidr_to_range.groovy} (50%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
