This is an automated email from the ASF dual-hosted git repository.
lijibing pushed a change to branch high-priority-column
in repository https://gitbox.apache.org/repos/asf/doris.git
from 60b02d3f62c Example Modify audit log documents (#31192)
add 2d2e9e661cb [fix](stream-load) print stream load profile for pipeline
and pipelinex (#31198)
add e0e3c3873d1 [fix](Nereids): OuterJoinAssoc reject literal condition
(#31172)
add 7c056601d14 [Enhancement](group commit) Add bvar and log for group
commit (#31017)
add 95a235121e7 [feature](cloud) add more cases to cloud_p0 (#31221)
add 9aa23a630ef [fix](regression) cloud_p0 should not enable group_commit
(#31232)
add 90d9707bb63 [regression test]Optimize testUniqueModelSchemaKeyChange
(#31150)
add c8a793ad6ae [Exec](RF) Support merge remote rf local first (#31067)
add b8675bc5d20 [Enhancement] [plsql] support drop store procedure
(#30966) (#31001)
add 92e1f687e40 [chore](columns) remove update_hashes_with_value for
SipHash (#31224)
add 35f05fd8713 [fix](audit) The time field in the audit log table is set
to the millisecond level (#31096)
add c46bcb2f86c Window function sum/avg does not support distinct document
modification (#31066)
add 8949307ecfa [log](query) add debug log for check query visible version
(#31217)
add a6f0a4616d6 [fix](group_commit)Fix bound checking problem when reading
wal block (#31112)
add bd782437631 [doc](create table) add since version for some new
features (#30506)
add 83ad7a6c210 [pipelineX](refactor) Delete subclasses inherited from
Dependency (#31216)
add 87ea5244a60 [refine](pipelinex) get sink local state does not require
an id. #31195
add b2c0a407a83 [bugfix](docs)Fix some spelling mistakes in english doc
(#31241)
add 0544f23f2d3 [Improve](InPredict) enhance in predict with struct type
(#30840)
add 54db467349a [fix](invert index) fix the error issue in the unit test
remove_element_only_in_table (#31238)
add ba333686d4c [fix](txn insert) Txn insert can not write to table with
mv (#31167)
add fbc68faea25 Update multi-tenant.md (#31256)
add c8376952252 [improvement](hudi)Obtain partition information through
HMS's API (#30962)
add dcd2afdb4e8 [test](regression) add regression test for schange change
of complex type (#31207)
add faeb4522814 [Fix](Job)TVF Query JOB Concurrent Reading and Writing
Causes Exception (#31248)
add 52f4bd51596 [fix][doc] one of the Chinese document references is
missing #31236
add d69b14e4903 [fix](chore) fix cloud bin/start.sh permission (#31184)
add abb98747a64 [fix](Nereids) simplify airthmetic should not change
return type (#31237)
add 001af83dbe8 [ci](cloud) add cloud p1 pipeline (#31239)
add 223419ff672 [chore](ci) Update .asf.yaml (#31272)
add 4f9ef13076b [doc](doc)add some k8s doc (#31194)
add ea948c42eb8 Revert "[chore](ci) Update .asf.yaml (#31272)" (#31281)
add b62d5ab81da [nereids] downgrade bucket shuffle if tablet num <
instance num (#31222)
add 07162c46389 [fix](keyword) add BELONG as reserve keyword (#31230)
add f8202f9e3d3 [update](hudi) update hudi version to 0.14.1 and
compatible with flink hive catalog (#31181)
add 8dd4528f37f [Fix](seq-col) Fix sequence column check fail #31252
add 8f60ecffb2a [fix](memory) Fix LRU cache frequent prune (#31220)
add 08afd3f4eaa [fix](mtmv) fix mtmv workload group case failed (#31218)
add 5797ad9bf73 [regression-test](VariantType) fix and disable unstable
case (#31269)
add 937909f7d50 [opt](Nereids)choose better column for count star (#31227)
add f74b138e3f4 [fix](Nereids) not equals and hashCode should contains
generate flag (#31123)
add 67ec4190205 [Feature](pipeline) Trace pipeline scheduling (part I)
(#31027)
add f46f7e2cb2d [fix](create table) Optimize create table function
`createPartitionWithIndices` parameters (#31234)
add bc9043f97ed [tools] update tools script (#31286)
add c08f356e64c [chore](ci) change bucket to keep track of costs (#31274)
add 7d1fd1b441b [fix](nereids)show error message if use wrong alias to
bind the table (#31264)
add b15e83fe1b2 [enhancement](fe) Accelerate replay journal when meta out
of date (#31161)
add 602af279696 [fix](inverted index) Fix inverted index for MOR unique
table (#31051)
add 83ec378b6b5 [Feature](explode) support explode map type (#30151)
add 1351e224f2b fix partial-update doc (#30612)
add 7479fa35ba9 [tools] remove useless conf (#31295)
add 4cfd9ee67f4 [fix](jdbc catalog) Fix Resource Closing Logic After
Connection Abort (#31219)
add 20506a02667 fix total task exec time is far more than actual (#31279)
add 449f0c010c0 [docs](fix) modify identity in DROP-USER.md (#30891)
add f3ece87b424 [test](mtmv)add p0 filter case (#31271)
add 3213c52114b [opt](cancel) Cancel get result future immediately if
query is cancelled (#31228)
add 18f73292c19 [fix](merge-cloud) support ip/variant type in cloud mode
(#31283)
add b3a54b4af4c Improve show column stats performance. (#31298)
add 48ad8bc52a0 [fix](join) incorrect result of mark join in nested loop
join (#31280)
add dbd3d31c424 [Feature](function) Support xxhash function like murmur
hash function (#31193)
add f8feaf4e7d4 [fix](script) Fix `start_fe.sh` missing
`METADATA_FAILURE_RECOVERY` with foreground (#31258)
add 4403e3012c1 Refactor get row count related interface, add row count
cache for external table. (#31276)
No new revisions were added by this update.
Summary of changes:
.github/workflows/comment-to-trigger-teamcity.yml | 58 +-
be/src/agent/be_exec_version_manager.h | 1 +
be/src/common/compiler_util.h | 2 +
be/src/common/config.cpp | 4 +-
be/src/common/config.h | 6 +-
be/src/exec/data_sink.cpp | 19 -
be/src/exec/data_sink.h | 3 -
be/src/exprs/runtime_filter.cpp | 77 +--
be/src/exprs/runtime_filter.h | 24 +-
be/src/exprs/runtime_filter_slots.h | 11 +-
.../action/adjust_tracing_dump.cpp} | 47 +-
.../src/http/action/adjust_tracing_dump.h | 26 +-
be/src/io/fs/file_system.h | 13 +-
be/src/io/fs/local_file_system.h | 13 +-
be/src/io/fs/local_file_writer.h | 9 +-
be/src/olap/compaction.cpp | 4 +-
be/src/olap/olap_server.cpp | 13 +-
be/src/olap/rowset/beta_rowset_reader.cpp | 22 +-
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 13 +-
be/src/olap/storage_engine.h | 1 +
be/src/pipeline/exec/aggregation_sink_operator.h | 12 +-
be/src/pipeline/exec/aggregation_source_operator.h | 12 +-
be/src/pipeline/exec/analytic_sink_operator.cpp | 2 +-
be/src/pipeline/exec/analytic_sink_operator.h | 12 +-
be/src/pipeline/exec/analytic_source_operator.cpp | 6 +-
be/src/pipeline/exec/analytic_source_operator.h | 10 +-
be/src/pipeline/exec/assert_num_rows_operator.h | 4 +-
be/src/pipeline/exec/data_queue.h | 5 -
be/src/pipeline/exec/datagen_operator.cpp | 9 +-
.../distinct_streaming_aggregation_operator.cpp | 2 +-
.../exec/distinct_streaming_aggregation_operator.h | 4 +-
be/src/pipeline/exec/empty_set_operator.h | 4 +-
be/src/pipeline/exec/es_scan_operator.cpp | 2 +-
be/src/pipeline/exec/exchange_sink_buffer.h | 5 +-
be/src/pipeline/exec/exchange_sink_operator.cpp | 5 +-
be/src/pipeline/exec/exchange_sink_operator.h | 62 +--
be/src/pipeline/exec/exchange_source_operator.cpp | 4 +-
be/src/pipeline/exec/exchange_source_operator.h | 26 +-
be/src/pipeline/exec/file_scan_operator.cpp | 2 +-
be/src/pipeline/exec/hashjoin_build_sink.cpp | 28 +-
be/src/pipeline/exec/hashjoin_build_sink.h | 18 +-
be/src/pipeline/exec/hashjoin_probe_operator.cpp | 4 +-
be/src/pipeline/exec/hashjoin_probe_operator.h | 10 +-
be/src/pipeline/exec/join_build_sink_operator.cpp | 20 +-
be/src/pipeline/exec/join_build_sink_operator.h | 6 +-
be/src/pipeline/exec/join_probe_operator.cpp | 24 +-
be/src/pipeline/exec/join_probe_operator.h | 8 +-
be/src/pipeline/exec/multi_cast_data_stream_sink.h | 12 +-
.../exec/multi_cast_data_stream_source.cpp | 3 +-
.../pipeline/exec/multi_cast_data_stream_source.h | 15 +-
be/src/pipeline/exec/multi_cast_data_streamer.h | 6 +-
.../exec/nested_loop_join_build_operator.cpp | 8 +-
.../exec/nested_loop_join_build_operator.h | 10 +-
.../exec/nested_loop_join_probe_operator.cpp | 16 +-
.../exec/nested_loop_join_probe_operator.h | 10 +-
be/src/pipeline/exec/olap_scan_operator.cpp | 4 +-
.../pipeline/exec/partition_sort_sink_operator.cpp | 2 +-
.../pipeline/exec/partition_sort_sink_operator.h | 12 +-
.../exec/partition_sort_source_operator.cpp | 2 +-
.../pipeline/exec/partition_sort_source_operator.h | 14 +-
be/src/pipeline/exec/repeat_operator.h | 4 +-
be/src/pipeline/exec/result_sink_operator.cpp | 3 +-
be/src/pipeline/exec/result_sink_operator.h | 13 +-
be/src/pipeline/exec/scan_operator.cpp | 24 +-
be/src/pipeline/exec/scan_operator.h | 47 +-
be/src/pipeline/exec/select_operator.h | 4 +-
be/src/pipeline/exec/set_probe_sink_operator.cpp | 5 +-
be/src/pipeline/exec/set_probe_sink_operator.h | 21 +-
be/src/pipeline/exec/set_sink_operator.cpp | 4 +-
be/src/pipeline/exec/set_sink_operator.h | 16 +-
be/src/pipeline/exec/set_source_operator.cpp | 2 +-
be/src/pipeline/exec/set_source_operator.h | 12 +-
be/src/pipeline/exec/sort_sink_operator.cpp | 2 +-
be/src/pipeline/exec/sort_sink_operator.h | 12 +-
be/src/pipeline/exec/sort_source_operator.cpp | 2 +-
be/src/pipeline/exec/sort_source_operator.h | 10 +-
.../pipeline/exec/streaming_aggregation_operator.h | 4 +-
be/src/pipeline/exec/union_sink_operator.h | 12 +-
be/src/pipeline/exec/union_source_operator.h | 12 +-
be/src/pipeline/pipeline.cpp | 13 +-
be/src/pipeline/pipeline.h | 18 +-
be/src/pipeline/pipeline_fragment_context.cpp | 52 +-
be/src/pipeline/pipeline_fragment_context.h | 13 +-
be/src/pipeline/pipeline_task.h | 11 +-
be/src/pipeline/pipeline_tracing.cpp | 158 ++++++
be/src/pipeline/pipeline_tracing.h | 83 +++
be/src/pipeline/pipeline_x/dependency.cpp | 2 +-
be/src/pipeline/pipeline_x/dependency.h | 46 +-
.../local_exchange/local_exchange_sink_operator.h | 13 +-
.../local_exchange_source_operator.cpp | 11 -
.../local_exchange_source_operator.h | 15 +-
.../pipeline_x/local_exchange/local_exchanger.h | 1 -
be/src/pipeline/pipeline_x/operator.cpp | 168 +++---
be/src/pipeline/pipeline_x/operator.h | 46 +-
.../pipeline_x/pipeline_x_fragment_context.cpp | 101 ++--
.../pipeline_x/pipeline_x_fragment_context.h | 9 +-
be/src/pipeline/pipeline_x/pipeline_x_task.cpp | 22 +-
be/src/pipeline/pipeline_x/pipeline_x_task.h | 7 +-
be/src/pipeline/task_scheduler.cpp | 80 ++-
be/src/pipeline/task_scheduler.h | 3 -
be/src/runtime/buffer_control_block.cpp | 2 +-
be/src/runtime/buffer_control_block.h | 6 +-
be/src/runtime/exec_env.h | 25 +-
be/src/runtime/exec_env_init.cpp | 2 +
be/src/runtime/fragment_mgr.cpp | 7 +-
be/src/runtime/group_commit_mgr.cpp | 4 +
be/src/runtime/group_commit_mgr.h | 4 +
be/src/runtime/memory/cache_manager.cpp | 18 +-
be/src/runtime/memory/cache_manager.h | 19 +
be/src/runtime/memory/cache_policy.h | 2 +-
be/src/runtime/memory/lru_cache_policy.h | 30 +-
be/src/runtime/query_context.cpp | 24 +-
be/src/runtime/query_context.h | 11 +-
be/src/runtime/runtime_filter_mgr.cpp | 91 ++-
be/src/runtime/runtime_filter_mgr.h | 32 +-
be/src/runtime/runtime_state.cpp | 42 +-
be/src/runtime/runtime_state.h | 26 +-
be/src/service/http_service.cpp | 16 +-
be/src/util/hash_util.hpp | 11 +
be/src/util/thrift_util.cpp | 34 +-
be/src/util/thrift_util.h | 20 +-
be/src/vec/columns/column.h | 22 -
be/src/vec/columns/column_array.cpp | 5 -
be/src/vec/columns/column_array.h | 3 -
be/src/vec/columns/column_complex.h | 11 +-
be/src/vec/columns/column_const.cpp | 16 -
be/src/vec/columns/column_const.h | 3 -
be/src/vec/columns/column_decimal.cpp | 6 -
be/src/vec/columns/column_decimal.h | 2 -
be/src/vec/columns/column_map.cpp | 5 -
be/src/vec/columns/column_map.h | 3 -
be/src/vec/columns/column_nullable.cpp | 19 -
be/src/vec/columns/column_nullable.h | 2 -
be/src/vec/columns/column_string.h | 5 -
be/src/vec/columns/column_struct.cpp | 5 -
be/src/vec/columns/column_struct.h | 3 -
be/src/vec/columns/column_vector.cpp | 6 -
be/src/vec/columns/column_vector.h | 3 -
be/src/vec/exec/format/wal/wal_reader.cpp | 21 +-
be/src/vec/exec/join/vhash_join_node.cpp | 6 +-
be/src/vec/exec/join/vnested_loop_join_node.cpp | 4 +-
be/src/vec/exec/join/vnested_loop_join_node.h | 9 +-
be/src/vec/exec/runtime_filter_consumer.cpp | 23 +-
be/src/vec/exec/runtime_filter_consumer.h | 4 +-
be/src/vec/exec/scan/pip_scanner_context.h | 6 +-
be/src/vec/exec/scan/scanner_context.h | 1 -
be/src/vec/exec/vdata_gen_scan_node.cpp | 9 +-
.../table_function/table_function_factory.cpp | 2 +
be/src/vec/exprs/table_function/vexplode_map.cpp | 125 +++++
be/src/vec/exprs/table_function/vexplode_map.h | 68 +++
be/src/vec/exprs/vin_predicate.cpp | 3 +
be/src/vec/functions/function_fake.cpp | 15 +
be/src/vec/functions/function_hash.cpp | 153 ++++--
.../src/vec/functions/function_struct_in.cpp | 21 +-
be/src/vec/functions/function_struct_in.h | 169 ++++++
be/src/vec/functions/in.h | 3 +-
be/src/vec/functions/simple_function_factory.h | 2 +
be/src/vec/runtime/shared_hash_table_controller.h | 7 +-
be/src/vec/runtime/vdata_stream_recvr.cpp | 10 +-
be/src/vec/runtime/vdata_stream_recvr.h | 18 +-
be/src/vec/sink/group_commit_block_sink.cpp | 8 +-
be/src/vec/sink/vdata_stream_sender.cpp | 3 +-
be/src/vec/sink/vdata_stream_sender.h | 4 +-
.../inverted_index_searcher_cache_test.cpp | 2 +-
be/test/vec/columns/column_hash_func_test.cpp | 59 +-
be/test/vec/exec/vwal_scanner_test.cpp | 155 +++---
be/test/vec/function/function_hash_test.cpp | 64 +++
bin/start_fe.sh | 2 +-
build.sh | 1 +
cloud/script/start.sh | 4 +-
.../hive/scripts/create_preinstalled_table.hql | 14 +
.../community/design/doris_storage_optimization.md | 4 +-
.../developer-guide/cpp-diagnostic-code.md | 2 +-
.../commit-format-specification.md | 2 +-
docs/en/community/join-community.md | 2 +-
.../release-and-verify/release-complete.md | 2 +-
.../http-actions/fe/debug-point-action.md | 6 +-
.../admin-manual/http-actions/fe/metrics-action.md | 2 +-
docs/en/docs/admin-manual/privilege-ldap/ranger.md | 2 +-
docs/en/docs/advanced/compute-node.md | 2 +-
docs/en/docs/advanced/partition/auto-partition.md | 2 +-
.../data-operate/update-delete/partial-update.md | 2 +-
docs/en/docs/data-table/hit-the-rollup.md | 2 +-
docs/en/docs/install/k8s-deploy/debug-crash.md | 73 +++
.../k8s-deploy/expansion-and-contraction.md | 100 ++++
docs/en/docs/install/k8s-deploy/root-user-use.md | 63 +++
docs/en/docs/lakehouse/multi-catalog/hudi.md | 6 +
.../hash-functions/murmur-hash3-32.md | 2 +
.../hash-functions/murmur-hash3-64.md | 2 +
.../{murmur-hash3-32.md => xxhash-32.md} | 52 +-
.../sql-functions/hash-functions/xxhash-64.md | 85 +++
.../sql-functions/table-functions/explode_map.md | 131 +++++
.../window-functions/window-function-avg.md | 2 +-
.../window-functions/window-function-sum.md | 2 +-
.../Create/CREATE-TABLE.md | 4 +-
docs/sidebars.json | 9 +-
docs/zh-CN/docs/admin-manual/multi-tenant.md | 1 +
.../data-operate/update-delete/partial-update.md | 2 +-
docs/zh-CN/docs/data-table/hit-the-rollup.md | 2 +-
docs/zh-CN/docs/install/k8s-deploy/debug-crash.md | 73 +++
.../k8s-deploy/expansion-and-contraction.md | 100 ++++
.../zh-CN/docs/install/k8s-deploy/root-user-use.md | 63 +++
docs/zh-CN/docs/lakehouse/multi-catalog/hudi.md | 6 +
.../hash-functions/murmur-hash3-32.md | 4 +-
.../hash-functions/murmur-hash3-64.md | 4 +-
.../{murmur-hash3-32.md => xxhash-32.md} | 53 +-
.../sql-functions/hash-functions/xxhash-64.md | 84 +++
.../sql-functions/table-functions/explode_map.md | 132 +++++
.../window-functions/window-function-avg.md | 2 +-
.../window-functions/window-function-sum.md | 2 +-
.../Account-Management-Statements/DROP-USER.md | 2 +-
.../Create/CREATE-TABLE.md | 4 +-
.../org/apache/doris/hudi/BaseSplitReader.scala | 2 +-
.../java/org/apache/doris/jdbc/JdbcExecutor.java | 60 +-
.../main/java/org/apache/doris/common/Config.java | 4 +
.../antlr4/org/apache/doris/nereids/DorisLexer.g4 | 1 +
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 4 +-
.../antlr4/org/apache/doris/nereids/PLParser.g4 | 4 +
fe/fe-core/src/main/cup/sql_parser.cup | 4 +-
.../java/org/apache/doris/analysis/IndexDef.java | 16 +-
.../apache/doris/analysis/NativeInsertStmt.java | 63 ++-
.../apache/doris/analysis/ShowColumnStatsStmt.java | 4 +
.../doris/catalog/BuiltinScalarFunctions.java | 4 +
.../catalog/BuiltinTableGeneratingFunctions.java | 4 +
.../main/java/org/apache/doris/catalog/Column.java | 8 +
.../main/java/org/apache/doris/catalog/Env.java | 94 ++--
.../java/org/apache/doris/catalog/FunctionSet.java | 1 +
.../org/apache/doris/catalog/InternalSchema.java | 2 +-
.../java/org/apache/doris/catalog/OlapTable.java | 7 +-
.../main/java/org/apache/doris/catalog/Table.java | 29 +-
.../java/org/apache/doris/catalog/TableIf.java | 9 +-
.../cloud/datasource/CloudInternalCatalog.java | 53 +-
.../main/java/org/apache/doris/common/Status.java | 1 +
.../apache/doris/common/util/PropertyAnalyzer.java | 4 +-
.../doris/datasource/ExternalMetaCacheMgr.java | 10 +-
.../doris/datasource/ExternalRowCountCache.java | 112 ++++
.../org/apache/doris/datasource/ExternalTable.java | 15 +-
.../apache/doris/datasource/InternalCatalog.java | 154 +++---
.../doris/datasource/hive/HMSExternalTable.java | 88 +--
.../hudi/source/HudiCachedPartitionProcessor.java | 27 +-
.../hudi/source/HudiPartitionProcessor.java | 4 +-
.../doris/datasource/hudi/source/HudiScanNode.java | 28 +-
.../doris/datasource/jdbc/JdbcExternalTable.java | 26 -
.../org/apache/doris/job/base/AbstractJob.java | 7 +-
.../doris/load/routineload/RoutineLoadJob.java | 9 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 21 +-
.../properties/ChildrenPropertiesRegulator.java | 58 ++
.../nereids/rules/analysis/BindExpression.java | 41 +-
.../doris/nereids/rules/analysis/BindSink.java | 11 +-
.../doris/nereids/rules/analysis/SlotBinder.java | 3 +
.../rules/exploration/join/OuterJoinAssoc.java | 2 +-
.../exploration/join/OuterJoinAssocProject.java | 2 +-
.../mv/AbstractMaterializedViewRule.java | 12 +-
.../expression/rules/SimplifyArithmeticRule.java | 3 +-
.../doris/nereids/rules/rewrite/ColumnPruning.java | 42 +-
.../nereids/rules/rewrite/EliminateNotNull.java | 11 +-
.../nereids/rules/rewrite/EliminateOuterJoin.java | 9 +-
.../nereids/rules/rewrite/InferAggNotNull.java | 25 +-
.../nereids/rules/rewrite/InferFilterNotNull.java | 26 +-
.../doris/nereids/stats/StatsCalculator.java | 2 +-
.../nereids/trees/expressions/Expression.java | 1 -
.../nereids/trees/expressions/InPredicate.java | 10 +
.../doris/nereids/trees/expressions/Not.java | 27 +-
.../functions/executable/NumericArithmetic.java | 8 +-
.../functions/generator/ExplodeMap.java | 80 +++
.../functions/generator/ExplodeMapOuter.java | 80 +++
.../expressions/functions/scalar/XxHash32.java | 72 +++
.../expressions/functions/scalar/XxHash64.java | 72 +++
.../trees/expressions/literal/StructLiteral.java | 13 +-
.../expressions/visitor/ScalarFunctionVisitor.java | 10 +
.../visitor/TableGeneratingFunctionVisitor.java | 10 +
.../apache/doris/nereids/trees/plans/PlanType.java | 3 +-
.../trees/plans/commands/DeleteFromCommand.java | 24 +-
.../trees/plans/commands/DropProcedureCommand.java | 62 +++
.../trees/plans/commands/info/IndexDefinition.java | 16 +-
.../trees/plans/logical/LogicalGenerate.java | 30 +-
.../trees/plans/visitor/CommandVisitor.java | 5 +
.../apache/doris/nereids/util/ExpressionUtils.java | 14 +-
.../doris/nereids/util/TypeCoercionUtils.java | 11 +-
.../org/apache/doris/planner/OlapScanNode.java | 5 +
.../src/main/java/org/apache/doris/plsql/Exec.java | 33 ++
.../doris/plugin/audit/AuditLoaderPlugin.java | 2 +-
.../main/java/org/apache/doris/qe/Coordinator.java | 10 +-
.../java/org/apache/doris/qe/ResultReceiver.java | 47 +-
.../java/org/apache/doris/qe/SessionVariable.java | 11 +-
.../java/org/apache/doris/qe/ShowExecutor.java | 40 +-
.../apache/doris/service/FrontendServiceImpl.java | 2 +-
.../apache/doris/statistics/AnalysisManager.java | 5 +-
...CacheLoader.java => BasicAsyncCacheLoader.java} | 17 +-
.../statistics/ColumnStatisticsCacheLoader.java | 2 +-
.../apache/doris/statistics/HMSAnalysisTask.java | 4 +-
.../doris/statistics/HistogramCacheLoader.java | 2 +-
.../doris/statistics/OlapScanStatsDerive.java | 2 +-
.../doris/statistics/StatisticConstants.java | 1 -
.../doris/statistics/StatisticsCacheKey.java | 1 +
.../doris/statistics/StatisticsRepository.java | 13 +
.../doris/statistics/util/StatisticsUtil.java | 9 +-
.../apache/doris/common/PropertyAnalyzerTest.java | 2 +-
.../doris/load/routineload/RoutineLoadJobTest.java | 4 +-
.../doris/nereids/jobs/joinorder/TPCHTest.java | 40 +-
.../nereids/rules/rewrite/InferAggNotNullTest.java | 4 +-
fe/pom.xml | 2 +-
gensrc/script/doris_builtins_functions.py | 6 +-
.../data/external_table_p2/hive/test_hive_hudi.out | 16 +
.../data/index_p0/test_bitmap_index.out | 6 +-
regression-test/data/insert_p0/txn_insert.out | 12 +
.../inverted_index_p0/test_inverted_index_mor.out | 30 +
.../join/test_nestedloop_semi_anti_join.out | 9 +
.../hash_functions/test_hash_function.out | 17 +
.../sql_functions/table_function/explode_map.out | 51 ++
.../eliminate_not_null/eliminate_not_null.out | 16 +-
.../test_simplify_arithmetic.out | 3 +
.../nereids_syntax_p0/inpredicate_with_struct.out | 19 +
.../join/test_nestedloop_semi_anti_join.out | 9 +
.../hash_functions/test_hash_function.out | 17 +
.../test_unique_model_schema_key_change.out | 121 ++++
...ut => test_segcompaction_unique_keys_index.out} | 0
.../doris/regression/action/ExplainAction.groovy | 7 +-
.../org/apache/doris/regression/suite/Suite.groovy | 4 +-
.../pipeline/cloud_p0/conf/be_custom.conf | 1 -
.../pipeline/cloud_p0/conf/fe_custom.conf | 3 -
.../cloud_p0/conf/regression-conf-custom.groovy | 2 +-
.../{cloud_p0 => cloud_p1}/conf/be_custom.conf | 1 -
.../{cloud_p0 => cloud_p1}/conf/fe_custom.conf | 3 -
.../cloud_p1/conf/regression-conf-custom.groovy | 1 +
.../conf/session_variables.sql | 0
regression-test/pipeline/common/doris-utils.sh | 13 +-
regression-test/pipeline/common/github-utils.sh | 4 +
regression-test/pipeline/common/teamcity-utils.sh | 2 +
.../suites/datatype_p0/scalar_types/load.groovy | 54 ++
.../sql/unique2_bitmap_index_q01_bool.sql | 0
.../sql/unique2_bitmap_index_q02_tinyint.sql | 0
.../sql/unique2_bitmap_index_q03_smallint.sql | 0
.../sql/unique2_bitmap_index_q04_int.sql | 0
.../sql/unique2_bitmap_index_q05_bigint.sql | 0
.../sql/unique2_bitmap_index_q06_largeint.sql | 0
.../sql/unique2_bitmap_index_q07_float.sql | 0
.../sql/unique2_bitmap_index_q08_double.sql | 0
.../sql/unique2_bitmap_index_q09_decimal.sql | 0
.../sql/unique2_bitmap_index_q10_decimalv3.sql | 0
.../sql/unique2_bitmap_index_q11_date.sql | 0
.../sql/unique2_bitmap_index_q12_datetime.sql | 0
.../sql/unique2_bitmap_index_q13_datev2.sql | 0
.../sql/unique2_bitmap_index_q14_datetimev2.sql | 0
.../sql/unique2_bitmap_index_q15_char.sql | 0
.../sql/unique2_bitmap_index_q16_varchar.sql | 0
.../sql/unique2_bitmap_index_q17_string.sql | 0
.../hive/test_hive_parquet.groovy | 10 +
.../external_table_p2/hive/test_hive_hudi.groovy | 6 +
.../test_build_index_fault.groovy | 4 +-
.../suites/index_p0/test_bitmap_index.groovy | 4 +-
regression-test/suites/insert_p0/txn_insert.groovy | 21 +-
.../test_index_compaction_null.groovy | 1 +
.../inverted_index_p0/test_bitmap_index.groovy | 2 +-
.../inverted_index_p0/test_build_index.groovy | 4 +-
.../inverted_index_p0/test_inverted_index.groovy | 2 +-
.../test_inverted_index_mor.groovy | 78 +++
.../suites/inverted_index_p0/test_show_data.groovy | 2 +
.../suites/mtmv_p0/test_workload_group_mtmv.groovy | 2 +-
.../join/test_nestedloop_semi_anti_join.groovy | 8 +
.../hash_functions/test_hash_function.groovy | 8 +
.../table_function/explode_map.groovy | 55 ++
.../bind_relation/bind_view.groovy | 7 +
.../test_simplify_arithmetic.groovy} | 26 +-
.../filter_equal_or_notequal.groovy | 609 +++++++++++++++++++++
.../inpredicate_with_struct.groovy | 41 ++
.../suites/plsql_p0/test_plsql_loop_cursor.groovy | 4 +
.../join/test_nestedloop_semi_anti_join.groovy | 9 +
.../hash_functions/test_hash_function.groovy | 8 +
.../test_unique_model_schema_key_change.groovy | 270 +++++++++
.../test_segcompaction_unique_keys_index.groovy | 55 +-
.../suites/statistics/test_analyze_mv.groovy | 42 +-
.../test_double_write_when_schema_change.groovy | 4 +-
...heListOfTopRepositoriesChangedOverTheYears7.sql | 59 +-
regression-test/suites/variant_p2/sql/sql08.sql | 2 +-
tools/tpcds-tools/bin/create-tpcds-tables.sh | 5 +
tools/tpcds-tools/bin/run-tpcds-queries.sh | 12 +-
.../constraints/build-fk-constraints.sql | 3 +
.../constraints/build-pk-constraints.sql | 2 +
.../constraints/build-uk-constraints.sql | 1 +
380 files changed, 6125 insertions(+), 2102 deletions(-)
copy be/src/{io/fs/local_file_writer.h => http/action/adjust_tracing_dump.cpp}
(52%)
copy
regression-test/suites/query_p0/sql_functions/hash_functions/test_hash_function.groovy
=> be/src/http/action/adjust_tracing_dump.h (65%)
create mode 100644 be/src/pipeline/pipeline_tracing.cpp
create mode 100644 be/src/pipeline/pipeline_tracing.h
create mode 100644 be/src/vec/exprs/table_function/vexplode_map.cpp
create mode 100644 be/src/vec/exprs/table_function/vexplode_map.h
copy
regression-test/suites/query_p0/sql_functions/hash_functions/test_hash_function.groovy
=> be/src/vec/functions/function_struct_in.cpp (65%)
create mode 100644 be/src/vec/functions/function_struct_in.h
create mode 100644 docs/en/docs/install/k8s-deploy/debug-crash.md
create mode 100644 docs/en/docs/install/k8s-deploy/expansion-and-contraction.md
create mode 100644 docs/en/docs/install/k8s-deploy/root-user-use.md
copy docs/en/docs/sql-manual/sql-functions/hash-functions/{murmur-hash3-32.md
=> xxhash-32.md} (53%)
create mode 100644
docs/en/docs/sql-manual/sql-functions/hash-functions/xxhash-64.md
create mode 100644
docs/en/docs/sql-manual/sql-functions/table-functions/explode_map.md
create mode 100644 docs/zh-CN/docs/install/k8s-deploy/debug-crash.md
create mode 100644
docs/zh-CN/docs/install/k8s-deploy/expansion-and-contraction.md
create mode 100644 docs/zh-CN/docs/install/k8s-deploy/root-user-use.md
copy
docs/zh-CN/docs/sql-manual/sql-functions/hash-functions/{murmur-hash3-32.md =>
xxhash-32.md} (53%)
create mode 100644
docs/zh-CN/docs/sql-manual/sql-functions/hash-functions/xxhash-64.md
create mode 100644
docs/zh-CN/docs/sql-manual/sql-functions/table-functions/explode_map.md
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/ExternalRowCountCache.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/generator/ExplodeMap.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/generator/ExplodeMapOuter.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/XxHash32.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/XxHash64.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/DropProcedureCommand.java
rename
fe/fe-core/src/main/java/org/apache/doris/statistics/{StatisticsCacheLoader.java
=> BasicAsyncCacheLoader.java} (80%)
create mode 100644
regression-test/data/inverted_index_p0/test_inverted_index_mor.out
create mode 100644
regression-test/data/nereids_p0/sql_functions/table_function/explode_map.out
create mode 100644
regression-test/data/nereids_rules_p0/expression/simplify_arithmetic/test_simplify_arithmetic.out
create mode 100644
regression-test/data/nereids_syntax_p0/inpredicate_with_struct.out
create mode 100644
regression-test/data/schema_change_p0/test_unique_model_schema_key_change.out
copy
regression-test/data/segcompaction_p2/{test_segcompaction_unique_keys_mow_index.out
=> test_segcompaction_unique_keys_index.out} (100%)
copy regression-test/pipeline/{cloud_p0 => cloud_p1}/conf/be_custom.conf (93%)
copy regression-test/pipeline/{cloud_p0 => cloud_p1}/conf/fe_custom.conf (92%)
create mode 100644
regression-test/pipeline/cloud_p1/conf/regression-conf-custom.groovy
copy regression-test/pipeline/{cloud_p0 =>
cloud_p1}/conf/session_variables.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q01_bool.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q02_tinyint.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q03_smallint.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q04_int.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q05_bigint.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q06_largeint.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q07_float.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q08_double.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q09_decimal.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q10_decimalv3.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q11_date.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q12_datetime.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q13_datev2.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q14_datetimev2.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q15_char.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q16_varchar.sql (100%)
copy regression-test/suites/{datatype_p2 =>
datatype_p0}/scalar_types/sql/unique2_bitmap_index_q17_string.sql (100%)
create mode 100644
regression-test/suites/inverted_index_p0/test_inverted_index_mor.groovy
create mode 100644
regression-test/suites/nereids_p0/sql_functions/table_function/explode_map.groovy
copy
regression-test/suites/{nereids_p0/sql_functions/hash_functions/test_hash_function.groovy
=>
nereids_rules_p0/expression/simplify_arithmetic/test_simplify_arithmetic.groovy}
(60%)
create mode 100644
regression-test/suites/nereids_rules_p0/mv/dimension_equal/filter_equal_or_notequal.groovy
create mode 100644
regression-test/suites/nereids_syntax_p0/inpredicate_with_struct.groovy
create mode 100644
regression-test/suites/schema_change_p0/test_unique_model_schema_key_change.groovy
create mode 100644 tools/tpcds-tools/constraints/build-fk-constraints.sql
create mode 100644 tools/tpcds-tools/constraints/build-pk-constraints.sql
create mode 100644 tools/tpcds-tools/constraints/build-uk-constraints.sql
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
