This is an automated email from the ASF dual-hosted git repository.
panxiaolei pushed a change to branch dev_join
in repository https://gitbox.apache.org/repos/asf/doris.git
omit d1080710039 fix tpch some bug of right semi/anti join (#25896)
omit 20cf41c2c3a support right anti/semi/outer join (#25785)
omit b3821c10ab8 update dev_join to pre calculate bucket num (#25663)
omit e45ee1bcb5e support batch size (#25629)
omit 8798be1440d update rf
omit 6e7f4c8115a merge block to single block on join/set node
add 91608346062 [FIX](resize) fix array and map offsets resize with
default value (#25669)
add 2972daaed94 [Bug](status) process error status on es_scroll_parser and
compaction_action (#25745)
add 5e5a331de44 [fix](trigger) fix pipeline bug that does not trigger
Doris_Performance_Clickbench_ClickbenchNew (#25827)
add 091cb0ce37e [Bug](materialized-view) add limit for group by with
float/double on create mv (#25823)
add 4cd0dae4b30 [improvement](auth) support show all properties (#25645)
add b7c4cc06674 [opt](Nereids) let DecimalV2Literal overflow check same
with V3 (#25699)
add ade475a52b3 [regression](outfile)add regression for select outfile
with underscore prefix #25797
add 3837e7b779e [opt](filecache) do not sync segment data into storage
system (#25691)
add ac79cbaf66d [enhancement](log) remove some temp debug log (#25809)
add 0147561c886 [Update](clucene) sync clucene version to latest (#25821)
add 2f600cdd89a [fix](Nereids) order by with cte cannot bind (#25794)
add b16af25f7ba [pipelineX](fix) fix union operator which return only
const values (#25837)
add 10f19573791 [feature](docker)add docker-iceberg init tables (#25424)
add d4fca3c67e7 [fix](load) fix load rpc timeout (#25701)
add 40e430ca557 [regression](multi-catalog) add aliyun dlf hive on oss and
huawei obs test case (#25650)
add b82136bdb9b [fix](report handler) fix report handler lock leak
(#25853)
add bab7581054e [fix](delete) fix potential delete fail after adding
columns (#25817)
add 69c3e08699d [improve](load) set load id in signal handler (#25813)
add 88dd480c2e3 [enhancement](CSV-reader) enhance err log for csv reading
containing enclose or escape (#25816)
add 440345169a5 [Fix](Nereids) fix column statistic derive in outer join
estimation (#25586)
add 6b2eed779c9 [feature](AuditLog) add scanRows scanBytes in auditlog
(#25435)
add 552091f21ff [performance](pipelineX) optimize pipelineX (#25713)
add 5e3277e8fbc [improvement](routine-load) add routine load rows check
(#25818)
add 411fae951ba [fix](trash core) fix get trash directory core when stop
be (#25428) (#25829)
add d94ae20d4a1 [improvement](nereids) support insert into
doris_internal_table_id(xxx) (#25722)
add 0068783e88e [fix](merge-on-write) change some static_cast<void> to
RETURN_IF_ERROR (#25863)
add f5db5703c98 [regression-test](remove case) remove
test_bitmap_filter_p1.groovy (#25812)
add 7ca3f7100f8 [testcases](datetime) temporarily remove str_to_date
related case (#25877)
add e3317ac1b94 [fix](compile) fix BE compile failure on Mac (#25876)
add 4ac82fd3677 [opt](Nereids) add group_array as collect_list alias
(#25836)
add ba75f3457cd [opt](Nereids) update first_value and last_value signature
(#25790)
add a979d5a1f03 [improve](regression test) Add case for if function
(#25780)
add 235ae9ded49 [improvement](fragment) optimize to get query context
logic (#25621)
add 3b9ae91910d [Fix](Nereids) fix test leading suite and add tpch shape
checking base on leading (#25842)
add ae66464d6b0 [refactor](Nereids) refactor infer predicate rule to avoid
lost cast (#25637)
add 49b73483fd2 [fix](field) fix coredump of field function when the first
argument is const (#25859)
add 4f17c2a8b13 [feature](alter backends)backend modify & drop &
decommission by ids (#25444)
add 97c2fe75d19 [feature](pipelineX) use expected<T, Status> in
local_state (#25878)
add 693982fd1a2 [feature](decimal) support decimal256 (#25386)
add 8a03a073399 [feature](Nereids): pull up Project under Limit/TopN
(#25866)
add 0eea19403e2 [fix](stats) analyze specific column only if indicate
column in analyze stmt (#25660)
new f645fd48046 merge block to single block on join/set node
new 0c94dcbcaff update rf
new fe26648c685 support batch size (#25629)
new 6d8e2192baf update dev_join to pre calculate bucket num (#25663)
new 9489914c8a7 support right anti/semi/outer join (#25785)
new 20eff6d34cb fix tpch some bug of right semi/anti join (#25896)
new e47d9502fcb update
new 7e5b252274a update
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (d1080710039)
\
N -- N -- N refs/heads/dev_join (7e5b252274a)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 8 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/auto_trigger_teamcity.yml | 5 +-
be/src/clucene | 2 +-
be/src/common/consts.h | 12 +
be/src/common/status.h | 9 +-
be/src/exec/es/es_scroll_parser.cpp | 28 +-
be/src/exec/exec_node.cpp | 8 +
be/src/exec/exec_node.h | 2 +
be/src/exec/olap_common.h | 21 +-
.../exec/schema_scanner/schema_columns_scanner.cpp | 4 +-
be/src/exec/table_connector.cpp | 3 +-
be/src/exprs/create_predicate_function.h | 3 +-
be/src/exprs/runtime_filter.cpp | 43 +
be/src/gutil/endian.h | 12 +
be/src/http/action/compaction_action.cpp | 10 +-
be/src/http/action/stream_load.cpp | 10 +
be/src/io/cache/block/block_file_segment.cpp | 3 +-
be/src/io/fs/file_writer.h | 1 +
be/src/io/fs/local_file_system.cpp | 5 +-
be/src/io/fs/local_file_writer.cpp | 6 +-
be/src/io/fs/local_file_writer.h | 3 +-
be/src/olap/data_dir.cpp | 7 +-
be/src/olap/delete_handler.cpp | 49 +-
be/src/olap/delete_handler.h | 2 +-
be/src/olap/field.h | 4 +
be/src/olap/in_list_predicate.h | 2 +-
be/src/olap/key_coder.cpp | 1 +
be/src/olap/key_coder.h | 33 +-
be/src/olap/memtable_flush_executor.cpp | 2 +
be/src/olap/olap_common.h | 4 +-
be/src/olap/olap_server.cpp | 72 +-
be/src/olap/predicate_creator.h | 7 +-
be/src/olap/push_handler.cpp | 25 -
be/src/olap/rowset/beta_rowset_writer.h | 2 +
be/src/olap/rowset/beta_rowset_writer_v2.h | 2 +
be/src/olap/rowset/rowset_writer.h | 2 +
.../olap/rowset/segment_v2/bitmap_index_writer.cpp | 3 +
be/src/olap/rowset/segment_v2/bitshuffle_page.h | 1 +
.../segment_v2/bloom_filter_index_writer.cpp | 1 +
be/src/olap/rowset/segment_v2/encoding_info.cpp | 4 +
.../rowset/segment_v2/inverted_index_writer.cpp | 6 +
be/src/olap/rowset/segment_v2/zone_map_index.cpp | 3 +-
be/src/olap/schema.cpp | 3 +
be/src/olap/tablet.cpp | 12 +-
be/src/olap/tablet_schema.cpp | 8 +
be/src/olap/txn_manager.cpp | 2 +-
be/src/olap/types.cpp | 1 +
be/src/olap/types.h | 34 +
be/src/olap/utils.h | 1 +
be/src/pipeline/exec/aggregation_sink_operator.cpp | 7 +-
be/src/pipeline/exec/aggregation_sink_operator.h | 5 +-
.../pipeline/exec/aggregation_source_operator.cpp | 11 +-
be/src/pipeline/exec/aggregation_source_operator.h | 4 +-
be/src/pipeline/exec/analytic_sink_operator.cpp | 13 +-
be/src/pipeline/exec/analytic_sink_operator.h | 5 +-
be/src/pipeline/exec/analytic_source_operator.cpp | 11 +-
be/src/pipeline/exec/analytic_source_operator.h | 4 +-
be/src/pipeline/exec/assert_num_rows_operator.cpp | 6 +-
be/src/pipeline/exec/assert_num_rows_operator.h | 3 +-
be/src/pipeline/exec/datagen_operator.cpp | 14 +-
be/src/pipeline/exec/datagen_operator.h | 3 +-
...istinct_streaming_aggregation_sink_operator.cpp | 5 +-
.../distinct_streaming_aggregation_sink_operator.h | 7 +-
...tinct_streaming_aggregation_source_operator.cpp | 5 +-
...istinct_streaming_aggregation_source_operator.h | 2 +-
be/src/pipeline/exec/empty_set_operator.h | 5 +-
be/src/pipeline/exec/es_scan_operator.cpp | 4 +-
be/src/pipeline/exec/es_scan_operator.h | 3 +-
be/src/pipeline/exec/exchange_sink_buffer.cpp | 8 +
be/src/pipeline/exec/exchange_sink_buffer.h | 3 +
be/src/pipeline/exec/exchange_sink_operator.cpp | 29 +-
be/src/pipeline/exec/exchange_sink_operator.h | 5 +-
be/src/pipeline/exec/exchange_source_operator.cpp | 18 +-
be/src/pipeline/exec/exchange_source_operator.h | 7 +-
be/src/pipeline/exec/file_scan_operator.cpp | 5 +-
be/src/pipeline/exec/file_scan_operator.h | 7 +-
be/src/pipeline/exec/hashjoin_build_sink.cpp | 24 +-
be/src/pipeline/exec/hashjoin_build_sink.h | 12 +-
be/src/pipeline/exec/hashjoin_probe_operator.cpp | 15 +-
be/src/pipeline/exec/hashjoin_probe_operator.h | 6 +-
be/src/pipeline/exec/jdbc_scan_operator.cpp | 4 +-
be/src/pipeline/exec/jdbc_scan_operator.h | 3 +-
be/src/pipeline/exec/jdbc_table_sink_operator.cpp | 13 +-
be/src/pipeline/exec/jdbc_table_sink_operator.h | 4 +-
be/src/pipeline/exec/join_build_sink_operator.cpp | 4 +-
be/src/pipeline/exec/join_build_sink_operator.h | 3 +-
be/src/pipeline/exec/join_probe_operator.cpp | 4 +-
be/src/pipeline/exec/join_probe_operator.h | 3 +-
be/src/pipeline/exec/meta_scan_operator.cpp | 4 +-
be/src/pipeline/exec/meta_scan_operator.h | 3 +-
be/src/pipeline/exec/multi_cast_data_stream_sink.h | 2 +-
.../exec/multi_cast_data_stream_source.cpp | 4 +-
.../pipeline/exec/multi_cast_data_stream_source.h | 10 +-
.../exec/nested_loop_join_build_operator.cpp | 6 +-
.../exec/nested_loop_join_build_operator.h | 2 +-
.../exec/nested_loop_join_probe_operator.cpp | 15 +-
.../exec/nested_loop_join_probe_operator.h | 3 +-
be/src/pipeline/exec/olap_scan_operator.cpp | 4 +-
be/src/pipeline/exec/olap_scan_operator.h | 3 +-
be/src/pipeline/exec/olap_table_sink_operator.h | 14 +-
be/src/pipeline/exec/operator.h | 21 +
.../pipeline/exec/partition_sort_sink_operator.cpp | 7 +-
.../pipeline/exec/partition_sort_sink_operator.h | 2 +-
.../exec/partition_sort_source_operator.cpp | 7 +-
.../pipeline/exec/partition_sort_source_operator.h | 6 +-
be/src/pipeline/exec/repeat_operator.cpp | 10 +-
be/src/pipeline/exec/repeat_operator.h | 3 +-
be/src/pipeline/exec/result_file_sink_operator.cpp | 18 +-
be/src/pipeline/exec/result_file_sink_operator.h | 8 +-
be/src/pipeline/exec/result_sink_operator.cpp | 19 +-
be/src/pipeline/exec/result_sink_operator.h | 7 +-
be/src/pipeline/exec/scan_operator.cpp | 34 +-
be/src/pipeline/exec/scan_operator.h | 18 +-
be/src/pipeline/exec/schema_scan_operator.cpp | 6 +-
be/src/pipeline/exec/schema_scan_operator.h | 3 +-
be/src/pipeline/exec/select_operator.h | 7 +-
be/src/pipeline/exec/set_probe_sink_operator.cpp | 13 +-
be/src/pipeline/exec/set_probe_sink_operator.h | 5 +-
be/src/pipeline/exec/set_sink_operator.cpp | 2 +-
be/src/pipeline/exec/set_sink_operator.h | 3 +-
be/src/pipeline/exec/set_source_operator.cpp | 2 +-
be/src/pipeline/exec/set_source_operator.h | 13 +-
be/src/pipeline/exec/sort_sink_operator.cpp | 6 +-
be/src/pipeline/exec/sort_sink_operator.h | 3 +-
be/src/pipeline/exec/sort_source_operator.cpp | 11 +-
be/src/pipeline/exec/sort_source_operator.h | 5 +-
.../exec/streaming_aggregation_sink_operator.cpp | 7 +-
.../exec/streaming_aggregation_sink_operator.h | 8 +-
.../exec/streaming_aggregation_source_operator.cpp | 5 +-
.../exec/streaming_aggregation_source_operator.h | 2 +-
be/src/pipeline/exec/table_function_operator.cpp | 4 +-
be/src/pipeline/exec/table_function_operator.h | 9 +-
be/src/pipeline/exec/union_sink_operator.cpp | 2 +-
be/src/pipeline/exec/union_sink_operator.h | 2 +-
be/src/pipeline/exec/union_source_operator.cpp | 14 +-
be/src/pipeline/exec/union_source_operator.h | 19 +-
be/src/pipeline/pipeline.h | 10 +
be/src/pipeline/pipeline_fragment_context.cpp | 2 +
be/src/pipeline/pipeline_task.cpp | 25 +
be/src/pipeline/pipeline_task.h | 3 +
be/src/pipeline/pipeline_x/dependency.h | 74 +-
be/src/pipeline/pipeline_x/operator.cpp | 70 +-
be/src/pipeline/pipeline_x/operator.h | 117 +-
.../pipeline_x/pipeline_x_fragment_context.cpp | 100 +-
.../pipeline_x/pipeline_x_fragment_context.h | 6 +-
be/src/pipeline/pipeline_x/pipeline_x_task.cpp | 37 +-
be/src/pipeline/pipeline_x/pipeline_x_task.h | 11 +-
be/src/pipeline/task_scheduler.cpp | 6 +-
be/src/runtime/decimalv2_value.h | 7 +
be/src/runtime/define_primitive_type.h | 3 +-
be/src/runtime/fold_constant_executor.cpp | 3 +-
be/src/runtime/fragment_mgr.cpp | 15 +-
be/src/runtime/load_stream.cpp | 15 +-
be/src/runtime/load_stream.h | 4 +-
be/src/runtime/primitive_type.cpp | 12 +
be/src/runtime/primitive_type.h | 6 +
be/src/runtime/query_statistics.cpp | 32 +-
be/src/runtime/query_statistics.h | 20 +-
be/src/runtime/raw_value.h | 2 +
.../runtime/routine_load/data_consumer_group.cpp | 3 +-
be/src/runtime/routine_load/data_consumer_group.h | 6 +
.../routine_load/routine_load_task_executor.cpp | 9 +
be/src/runtime/runtime_predicate.cpp | 4 +
be/src/runtime/runtime_predicate.h | 6 +
be/src/runtime/runtime_state.cpp | 53 +-
be/src/runtime/runtime_state.h | 29 +-
be/src/runtime/type_limit.h | 8 +
be/src/runtime/types.cpp | 12 +-
be/src/runtime/types.h | 38 +-
be/src/service/internal_service.cpp | 1 +
be/src/util/binary_cast.hpp | 6 +-
be/src/util/string_parser.hpp | 11 +-
.../aggregate_functions/aggregate_function_avg.cpp | 11 +
.../aggregate_functions/aggregate_function_avg.h | 29 +-
.../aggregate_function_product.h | 2 +-
.../aggregate_function_simple_factory.h | 8 +-
.../aggregate_functions/aggregate_function_sum.cpp | 2 +
.../aggregate_functions/aggregate_function_sum.h | 16 +-
be/src/vec/aggregate_functions/helpers.h | 3 +-
be/src/vec/columns/column_array.cpp | 4 +-
be/src/vec/columns/column_array.h | 7 +-
be/src/vec/columns/column_decimal.cpp | 11 +-
be/src/vec/columns/column_decimal.h | 2 +-
be/src/vec/columns/column_map.cpp | 5 +-
be/src/vec/columns/columns_number.h | 1 +
be/src/vec/common/arithmetic_overflow.h | 25 +
be/src/vec/common/field_visitors.h | 2 +
be/src/vec/common/hash_table/hash.h | 21 +
be/src/vec/common/int_exp.h | 92 ++
be/src/vec/core/accurate_comparison.h | 353 ++---
be/src/vec/core/block.cpp | 8 +-
be/src/vec/core/call_on_type_index.h | 9 +
be/src/vec/core/decimal_comparison.h | 35 +-
be/src/vec/core/decomposed_float.h | 219 +++
be/src/vec/core/extended_types.h | 86 ++
be/src/vec/core/field.cpp | 1 +
be/src/vec/core/field.h | 80 +-
be/src/vec/core/types.h | 425 +++++-
be/src/vec/core/wide_integer.h | 296 ++++
be/src/vec/core/wide_integer_impl.h | 1479 ++++++++++++++++++++
be/src/vec/core/wide_integer_to_string.h | 84 ++
be/src/vec/data_types/convert_field_to_type.cpp | 3 +
be/src/vec/data_types/data_type.cpp | 2 +
be/src/vec/data_types/data_type.h | 4 +-
be/src/vec/data_types/data_type_decimal.cpp | 15 +-
be/src/vec/data_types/data_type_decimal.h | 67 +-
be/src/vec/data_types/data_type_factory.cpp | 10 +
be/src/vec/data_types/get_least_supertype.cpp | 15 +-
be/src/vec/data_types/number_traits.h | 9 +
.../data_types/serde/data_type_decimal_serde.cpp | 2 +
.../vec/data_types/serde/data_type_decimal_serde.h | 12 +-
be/src/vec/exec/format/csv/csv_reader.cpp | 20 +-
.../format/parquet/byte_array_dict_decoder.cpp | 1 +
.../format/parquet/byte_array_plain_decoder.cpp | 1 +
.../format/parquet/fix_length_dict_decoder.hpp | 2 +
.../format/parquet/fix_length_plain_decoder.cpp | 1 +
be/src/vec/exec/join/process_hash_table_probe.h | 13 +-
.../vec/exec/join/process_hash_table_probe_impl.h | 326 +----
be/src/vec/exec/join/vhash_join_node.h | 15 +-
be/src/vec/exec/scan/new_olap_scan_node.cpp | 9 +-
be/src/vec/exec/scan/new_olap_scan_node.h | 1 +
be/src/vec/exec/scan/new_olap_scanner.cpp | 3 +-
be/src/vec/exec/scan/vscan_node.cpp | 7 +-
be/src/vec/exec/scan/vscan_node.h | 1 +
be/src/vec/exec/scan/vscanner.cpp | 2 +
be/src/vec/exec/scan/vscanner.h | 2 +
be/src/vec/exec/vexchange_node.cpp | 6 +-
be/src/vec/exec/vexchange_node.h | 1 +
be/src/vec/exec/vjdbc_connector.cpp | 3 +-
be/src/vec/exec/vset_operation_node.cpp | 3 -
.../exprs/lambda_function/varray_map_function.cpp | 2 +-
be/src/vec/exprs/vectorized_agg_fn.cpp | 2 +-
be/src/vec/exprs/vexpr.cpp | 5 +
be/src/vec/exprs/vexpr.h | 8 +
.../vec/functions/array/function_array_apply.cpp | 2 +
.../functions/array/function_array_difference.h | 3 +
.../vec/functions/array/function_array_distance.h | 4 +-
.../vec/functions/array/function_array_distinct.h | 3 +
.../vec/functions/array/function_array_element.h | 3 +
.../array/function_array_enumerate_uniq.cpp | 2 +
be/src/vec/functions/array/function_array_index.h | 4 +
be/src/vec/functions/array/function_array_join.h | 3 +
be/src/vec/functions/array/function_array_remove.h | 3 +
.../vec/functions/array/function_arrays_overlap.h | 12 +-
be/src/vec/functions/function.h | 11 +-
be/src/vec/functions/function_binary_arithmetic.h | 91 +-
be/src/vec/functions/function_bitmap.cpp | 32 +-
be/src/vec/functions/function_cast.h | 24 +-
be/src/vec/functions/function_multi_same_args.h | 3 +-
be/src/vec/functions/function_string.h | 23 +-
be/src/vec/functions/function_unary_arithmetic.h | 4 +-
be/src/vec/functions/function_width_bucket.cpp | 3 +
be/src/vec/functions/functions_comparison.h | 1 -
be/src/vec/functions/if.cpp | 1 -
be/src/vec/functions/least_greast.cpp | 6 +-
be/src/vec/olap/olap_data_convertor.cpp | 3 +
be/src/vec/runtime/vdata_stream_recvr.cpp | 11 +
be/src/vec/runtime/vdata_stream_recvr.h | 3 +
be/src/vec/sink/vdata_stream_sender.cpp | 15 +-
be/src/vec/sink/vdata_stream_sender.h | 1 +
be/src/vec/sink/vtablet_block_convertor.cpp | 17 +-
be/src/vec/sink/vtablet_block_convertor.h | 2 +
be/src/vec/sink/vtablet_sink.h | 2 +-
be/src/vec/sink/vtablet_sink_v2.cpp | 2 +
be/src/vec/sink/writer/vmysql_table_writer.cpp | 3 +-
be/src/vec/sink/writer/vtablet_writer.cpp | 67 +-
be/src/vec/sink/writer/vtablet_writer.h | 7 +-
be/test/vec/columns/column_resize_test.cpp | 146 ++
be/test/vec/data_types/decimal_test.cpp | 212 +++
.../thirdparties/docker-compose/iceberg/README.md | 47 +-
.../docker-compose/iceberg/iceberg.env | 2 +-
.../docker-compose/iceberg/iceberg.yaml.tpl | 55 +-
.../docker-compose/iceberg/tools/gen_data.py | 106 ++
.../iceberg/{iceberg.env => tools/save_docker.sh} | 11 +-
docker/thirdparties/run-thirdparties-docker.sh | 13 +-
.../ALTER-SYSTEM-DECOMMISSION-BACKEND.md | 12 +
.../ALTER-SYSTEM-DROP-BACKEND.md | 11 +
.../ALTER-SYSTEM-MODIFY-BACKEND.md | 21 +
.../sql-reference/Show-Statements/SHOW-PROPERTY.md | 35 +-
.../ALTER-SYSTEM-DECOMMISSION-BACKEND.md | 12 +
.../ALTER-SYSTEM-DROP-BACKEND.md | 12 +
.../ALTER-SYSTEM-MODIFY-BACKEND.md | 23 +
.../sql-reference/Show-Statements/SHOW-PROPERTY.md | 33 +-
.../org/apache/doris/catalog/PrimitiveType.java | 50 +-
.../java/org/apache/doris/catalog/ScalarType.java | 85 +-
.../main/java/org/apache/doris/catalog/Type.java | 65 +-
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 3 +-
fe/fe-core/src/main/cup/sql_parser.cup | 6 +-
.../main/java/org/apache/doris/alter/Alter.java | 4 +-
.../doris/alter/MaterializedViewHandler.java | 25 +-
.../java/org/apache/doris/alter/RollupJobV2.java | 20 -
.../java/org/apache/doris/alter/SystemHandler.java | 34 +-
.../apache/doris/analysis/AddBackendClause.java | 12 +-
.../org/apache/doris/analysis/AlterSystemStmt.java | 12 +-
.../org/apache/doris/analysis/BackendClause.java | 31 +-
.../java/org/apache/doris/analysis/CastExpr.java | 1 +
.../java/org/apache/doris/analysis/ColumnDef.java | 1 +
.../doris/analysis/DecommissionBackendClause.java | 6 +-
.../apache/doris/analysis/DropBackendClause.java | 41 +-
.../main/java/org/apache/doris/analysis/Expr.java | 2 +
.../org/apache/doris/analysis/LiteralExpr.java | 1 +
.../apache/doris/analysis/ModifyBackendClause.java | 14 +-
.../doris/analysis/ShowUserPropertyStmt.java | 78 +-
.../org/apache/doris/analysis/StringLiteral.java | 1 +
.../java/org/apache/doris/analysis/TypeDef.java | 30 +
.../org/apache/doris/catalog/AliasFunction.java | 1 +
.../doris/catalog/BuiltinAggregateFunctions.java | 2 +-
.../main/java/org/apache/doris/catalog/Column.java | 1 +
.../java/org/apache/doris/catalog/OlapTable.java | 2 +-
.../doris/common/proc/UserPropertyProcNode.java | 4 +
.../java/org/apache/doris/common/util/Util.java | 1 +
.../org/apache/doris/master/ReportHandler.java | 9 +-
.../org/apache/doris/mysql/MysqlSerializer.java | 4 +-
.../org/apache/doris/mysql/privilege/Auth.java | 3 +
.../nereids/exceptions/NotSupportedException.java | 14 +-
.../org/apache/doris/nereids/hint/LeadingHint.java | 2 +-
.../doris/nereids/jobs/executor/Rewriter.java | 8 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 14 +-
.../org/apache/doris/nereids/rules/RuleType.java | 2 +
.../nereids/rules/analysis/BindExpression.java | 16 +-
.../expression/rules/FoldConstantRuleOnBE.java | 5 +-
.../rules/SimplifyDecimalV3Comparison.java | 2 +-
.../rules/rewrite/PredicatePropagation.java | 223 ++-
.../rules/rewrite/PullUpProjectUnderLimit.java | 55 +
.../rules/rewrite/PullUpProjectUnderTopN.java | 60 +
.../apache/doris/nereids/stats/JoinEstimation.java | 11 +-
.../doris/nereids/trees/expressions/Divide.java | 4 +-
.../doris/nereids/trees/expressions/Multiply.java | 10 +-
.../functions/ComputePrecisionForSum.java | 6 +-
.../trees/expressions/functions/agg/Avg.java | 16 +-
.../functions/executable/NumericArithmetic.java | 4 +-
.../functions/window/FirstOrLastValue.java | 18 +-
.../trees/expressions/literal/DecimalLiteral.java | 34 +-
.../expressions/literal/DecimalV3Literal.java | 27 +-
.../org/apache/doris/nereids/types/DataType.java | 2 +-
.../apache/doris/nereids/types/DecimalV3Type.java | 55 +-
.../apache/doris/nereids/util/ExpressionUtils.java | 29 -
.../java/org/apache/doris/qe/ConnectProcessor.java | 10 +
.../java/org/apache/doris/qe/SessionVariable.java | 14 +-
.../org/apache/doris/qe/cache/PartitionRange.java | 1 +
.../apache/doris/rewrite/FoldConstantsRule.java | 3 +-
.../apache/doris/statistics/AnalysisManager.java | 4 +-
.../org/apache/doris/system/SystemInfoService.java | 39 +-
.../main/java/org/apache/doris/task/PushTask.java | 1 -
.../doris/analysis/ShowUserPropertyStmtTest.java | 36 +-
.../doris/cluster/DecommissionBackendTest.java | 46 +-
.../doris/cluster/SystemInfoServiceTest.java | 27 +
.../rules/rewrite/PullUpProjectUnderLimitTest.java | 60 +
.../rules/rewrite/PullUpProjectUnderTopNTest.java | 60 +
.../doris/nereids/stats/JoinEstimateTest.java | 54 +
gensrc/proto/internal_service.proto | 1 +
gensrc/proto/types.proto | 1 +
gensrc/thrift/PaloInternalService.thrift | 2 +
gensrc/thrift/Types.thrift | 3 +-
regression-test/conf/regression-conf.groovy | 7 +
.../decimalv3/test_arithmetic_expressions.out | 109 +-
.../data/datatype_p0/decimalv3/test_decimalv3.out | 66 +
.../data/datatype_p0/decimalv3/test_predicate.out | 77 +
.../test_outfile_csv_with_success_prefix.out} | 8 +-
.../hive/test_cloud_accessible_obs.out | 7 +
.../hive/test_cloud_accessible_oss.out | 10 +
.../data/inverted_index_p0/test_tokenize.out | 12 +-
.../data/mv_p0/group_check/group_check.out | 8 +-
.../shape/q1.out | 0
.../data/nereids_hint_tpch_p0/shape/q10.out | 34 +
.../data/nereids_hint_tpch_p0/shape/q11.out | 46 +
.../data/nereids_hint_tpch_p0/shape/q12.out | 21 +
.../data/nereids_hint_tpch_p0/shape/q13.out | 25 +
.../data/nereids_hint_tpch_p0/shape/q14.out | 20 +
.../data/nereids_hint_tpch_p0/shape/q15.out | 31 +
.../data/nereids_hint_tpch_p0/shape/q16.out | 27 +
.../data/nereids_hint_tpch_p0/shape/q17.out | 21 +
.../data/nereids_hint_tpch_p0/shape/q18.out | 26 +
.../data/nereids_hint_tpch_p0/shape/q19.out | 21 +
.../data/nereids_hint_tpch_p0/shape/q2.out | 39 +
.../data/nereids_hint_tpch_p0/shape/q20.out | 34 +
.../data/nereids_hint_tpch_p0/shape/q21.out | 34 +
.../data/nereids_hint_tpch_p0/shape/q22.out | 28 +
.../data/nereids_hint_tpch_p0/shape/q3.out | 28 +
.../data/nereids_hint_tpch_p0/shape/q4.out | 22 +
.../data/nereids_hint_tpch_p0/shape/q5.out | 48 +
.../shape/q6.out | 0
.../data/nereids_hint_tpch_p0/shape/q7.out | 44 +
.../data/nereids_hint_tpch_p0/shape/q8.out | 49 +
.../data/nereids_hint_tpch_p0/shape/q9.out | 46 +
.../data/nereids_p0/hint/test_leading.out | 50 +-
.../insert_into_table/insert_use_table_id.out | 48 +
.../datetime_functions/test_date_function.out | 27 -
.../shape/query10.out | 8 +-
.../shape/query17.out | 8 +-
.../shape/query27.out | 61 +-
.../shape/query35.out | 8 +-
.../shape/query54.out | 8 +-
.../shape/query58.out | 165 +--
.../shape/query59.out | 61 +-
.../shape/query61.out | 4 +-
.../shape/query69.out | 8 +-
.../shape/query83.out | 119 +-
.../nereids_tpcds_shape_sf100_p0/shape/query10.out | 8 +-
.../nereids_tpcds_shape_sf100_p0/shape/query17.out | 8 +-
.../nereids_tpcds_shape_sf100_p0/shape/query27.out | 61 +-
.../nereids_tpcds_shape_sf100_p0/shape/query35.out | 8 +-
.../nereids_tpcds_shape_sf100_p0/shape/query54.out | 8 +-
.../nereids_tpcds_shape_sf100_p0/shape/query58.out | 129 +-
.../nereids_tpcds_shape_sf100_p0/shape/query59.out | 61 +-
.../nereids_tpcds_shape_sf100_p0/shape/query61.out | 4 +-
.../nereids_tpcds_shape_sf100_p0/shape/query69.out | 8 +-
.../nereids_tpcds_shape_sf100_p0/shape/query83.out | 119 +-
.../query_p0/aggregate/aggregate_decimal256.out | 97 ++
.../data/query_p0/join/test_join_decimal256.out | 41 +
.../join/test_runtime_filter_decimal256.out | 201 +++
.../conditional_functions/test_if.out | 11 +
.../datetime_functions/test_date_function.out | 27 -
.../test_string_function_regexp.out | 6 +
.../org/apache/doris/regression/suite/Suite.groovy | 16 +
.../pipeline/p0/conf/regression-conf.groovy | 3 +
.../datatype_p0/agg_state/test_agg_state.groovy | 2 +-
.../decimalv3/test_arithmetic_expressions.groovy | 274 +++-
.../datatype_p0/decimalv3/test_decimalv3.groovy | 114 +-
.../datatype_p0/decimalv3/test_predicate.groovy | 52 +
.../test_outfile_csv_with_success_prefix.groovy | 105 ++
.../es/test_es_query_nereids.groovy | 11 +-
.../hive/test_cloud_accessible_obs.groovy | 47 +
.../hive/test_cloud_accessible_oss.groovy | 73 +
.../suites/mv_p0/group_check/group_check.groovy | 21 +-
.../suites/nereids_hint_tpch_p0/load.groovy | 223 +++
.../suites/nereids_hint_tpch_p0/shape/q1.groovy | 56 +
.../suites/nereids_hint_tpch_p0/shape/q10.groovy | 71 +
.../suites/nereids_hint_tpch_p0/shape/q12.groovy | 67 +
.../suites/nereids_hint_tpch_p0/shape/q13.groovy | 56 +
.../suites/nereids_hint_tpch_p0/shape/q14.groovy | 49 +
.../suites/nereids_hint_tpch_p0/shape/q16.groovy | 69 +
.../suites/nereids_hint_tpch_p0/shape/q19.groovy | 76 +
.../suites/nereids_hint_tpch_p0/shape/q3.groovy | 66 +
.../suites/nereids_hint_tpch_p0/shape/q4.groovy | 62 +
.../suites/nereids_hint_tpch_p0/shape/q5.groovy | 60 +
.../suites/nereids_hint_tpch_p0/shape/q6.groovy | 44 +
.../suites/nereids_hint_tpch_p0/shape/q9.groovy | 68 +
.../infer_predicate/infer_predicate.groovy | 2 +-
.../insert_into_table/insert_use_table_id.groovy | 107 ++
.../datetime_functions/test_date_function.groovy | 26 +-
.../table_function/explode_split.groovy | 2 +-
.../query_p0/aggregate/aggregate_decimal256.groovy | 154 ++
.../query_p0/join/test_join_decimal256.groovy | 97 ++
.../join/test_runtime_filter_decimal256.groovy | 302 ++++
.../conditional_functions/test_if.groovy | 7 +
.../datetime_functions/test_date_function.groovy | 26 +-
.../test_string_function_regexp.groovy | 3 +
.../suites/query_p1/test_bitmap_filter_p1.groovy | 307 ----
.../suites/statistics/analyze_stats.groovy | 14 +
.../function/test_not_supported_agg_fn.groovy | 42 -
450 files changed, 10609 insertions(+), 2948 deletions(-)
create mode 100644 be/src/vec/core/decomposed_float.h
create mode 100644 be/src/vec/core/extended_types.h
create mode 100644 be/src/vec/core/wide_integer.h
create mode 100644 be/src/vec/core/wide_integer_impl.h
create mode 100644 be/src/vec/core/wide_integer_to_string.h
create mode 100644 be/test/vec/columns/column_resize_test.cpp
create mode 100644 be/test/vec/data_types/decimal_test.cpp
copy
docs/zh-CN/docs/sql-manual/sql-reference/Cluster-Management-Statements/ALTER-SYSTEM-DROP-BACKEND.md
=> docker/thirdparties/docker-compose/iceberg/README.md (50%)
create mode 100644 docker/thirdparties/docker-compose/iceberg/tools/gen_data.py
copy docker/thirdparties/docker-compose/iceberg/{iceberg.env =>
tools/save_docker.sh} (80%)
copy
regression-test/suites/query_p0/sql_functions/conditional_functions/test_if.groovy
=>
fe/fe-core/src/main/java/org/apache/doris/nereids/exceptions/NotSupportedException.java
(61%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/PullUpProjectUnderLimit.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/PullUpProjectUnderTopN.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/PullUpProjectUnderLimitTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/PullUpProjectUnderTopNTest.java
copy regression-test/data/{mv_p0/group_check/group_check.out =>
export_p0/test_outfile_csv_with_success_prefix.out} (63%)
create mode 100644
regression-test/data/external_table_p2/hive/test_cloud_accessible_obs.out
create mode 100644
regression-test/data/external_table_p2/hive/test_cloud_accessible_oss.out
copy regression-test/data/{nereids_tpch_shape_sf1000_p0 =>
nereids_hint_tpch_p0}/shape/q1.out (100%)
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q10.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q11.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q12.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q13.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q14.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q15.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q16.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q17.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q18.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q19.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q2.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q20.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q21.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q22.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q3.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q4.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q5.out
copy regression-test/data/{nereids_tpch_shape_sf1000_p0 =>
nereids_hint_tpch_p0}/shape/q6.out (100%)
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q7.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q8.out
create mode 100644 regression-test/data/nereids_hint_tpch_p0/shape/q9.out
create mode 100644
regression-test/data/nereids_p0/insert_into_table/insert_use_table_id.out
create mode 100644
regression-test/data/query_p0/aggregate/aggregate_decimal256.out
create mode 100644 regression-test/data/query_p0/join/test_join_decimal256.out
create mode 100644
regression-test/data/query_p0/join/test_runtime_filter_decimal256.out
create mode 100644
regression-test/suites/export_p0/test_outfile_csv_with_success_prefix.groovy
create mode 100644
regression-test/suites/external_table_p2/hive/test_cloud_accessible_obs.groovy
create mode 100644
regression-test/suites/external_table_p2/hive/test_cloud_accessible_oss.groovy
create mode 100644 regression-test/suites/nereids_hint_tpch_p0/load.groovy
create mode 100644 regression-test/suites/nereids_hint_tpch_p0/shape/q1.groovy
create mode 100644 regression-test/suites/nereids_hint_tpch_p0/shape/q10.groovy
create mode 100644 regression-test/suites/nereids_hint_tpch_p0/shape/q12.groovy
create mode 100644 regression-test/suites/nereids_hint_tpch_p0/shape/q13.groovy
create mode 100644 regression-test/suites/nereids_hint_tpch_p0/shape/q14.groovy
create mode 100644 regression-test/suites/nereids_hint_tpch_p0/shape/q16.groovy
create mode 100644 regression-test/suites/nereids_hint_tpch_p0/shape/q19.groovy
create mode 100644 regression-test/suites/nereids_hint_tpch_p0/shape/q3.groovy
create mode 100644 regression-test/suites/nereids_hint_tpch_p0/shape/q4.groovy
create mode 100644 regression-test/suites/nereids_hint_tpch_p0/shape/q5.groovy
create mode 100644 regression-test/suites/nereids_hint_tpch_p0/shape/q6.groovy
create mode 100644 regression-test/suites/nereids_hint_tpch_p0/shape/q9.groovy
create mode 100644
regression-test/suites/nereids_p0/insert_into_table/insert_use_table_id.groovy
create mode 100644
regression-test/suites/query_p0/aggregate/aggregate_decimal256.groovy
create mode 100644
regression-test/suites/query_p0/join/test_join_decimal256.groovy
create mode 100644
regression-test/suites/query_p0/join/test_runtime_filter_decimal256.groovy
delete mode 100644 regression-test/suites/query_p1/test_bitmap_filter_p1.groovy
delete mode 100644
regression-test/suites/tpch_sf0.1_p1/function/test_not_supported_agg_fn.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
