This is an automated email from the ASF dual-hosted git repository.
huajianlan pushed a change to branch nested_column_prune
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 4da3edd0274 remove debug log
discard 5bbdab65a13 fix: missed pruned type with map/array types
discard 46b503aee5f Clean external table implementation's code.
omit 9628af43edb use selected column ids for parquet merge io ranges.
omit a8f60b2ea8e update orc thirdparty lib commit.
omit de04e5b102d should not prune project nested column if the bottom table
can not prune, e.g. hive(textfile)
omit 490886b37b2 fix npe
omit 462d4657c7b Fix some tests's bugs of external table.
omit e63fed2f49c only support prune olapTable/iceberg/hive(parquet/orc)
omit e807410f7f2 fix be ut
omit 0af94c7abc6 support push project in aggregate/join
omit 2151bcdcdf0 fix topN late materialzation access_path.
omit 78a46f59acc fix case error in BE
omit 3943ee61664 fix "Index 2 out of bounds for length 2" when use tvf
omit e038fb267de use slot->col_name_lower_case().
omit 392aafdd1a8 Fix parquet_thrift_test unit test.
omit ae92dbce841 [Feature](catalog) Prune nested columns for hive/iceberg
parquet and orc reader.
omit 6757c8db8c2 support prune nested columns
add 6fe6656d955 [enhancement](parquet)Optimize the performance of parquet
reader when decode RLE_DICTIONARY encoding (#57208)
add e4c029b5227 [opt](nereids)push down assert one row join (#57414)
add ad6c7f3bb27 [fix](nereids)varchar(-1) and varchar(65533) should be
treated as the same data type (#57176)
add 13c0449d2e1 [fix](maxcompute)fix maxcompute push down predicates null
pointer. (#57474)
add 0a1905fdaa4 [Opt](function) Optimize the performance of FROM_UNIXTIME
(#57423)
add 3912e523fb0 [enhancemment](planner)check sql regex block rule before
plan phase (#57477)
add 3eb94a14e4e [Enhancement](schema_table)Improve the field information
of the information_schema.table_options table. (#56122)
add 33b2efa86a8 [refactor](expr) remove castTo in Catalog's Expr (#57560)
add 1e77d345e5b [fix] (parquet-reader) Fix parquet all row groups are
filtered. (#57490)
add eacaa4b5926 [enhancement](s3)Add TotalGetRequestTime profile metric to
the S3 reader. (#57519)
add 7b9948ddeee [chore](ci) fix bad resource (#57585)
add bf0b87c1cb7 [fix](scanner) Make Scanner close() method thread-safe
using atomic operations (#57436)
add 4187476d77a [chore](third party) bump librdkafka from 1.9.2 to 2.11.0
for Kafka higher version compatibility (#57565)
add 748e8679956 [function](agg) support agg function of group_array_union
(#57166)
add f3ac7db1ef7 [Bug](Jni)should delete local ref after convert to global
ref (#57513)
add c757cb88053 [fix](mysql) Fix SSL unwrap infinite loop on handshake
failure (#57364)
add 11eabf02b8a [opt](inverted index) support builtin analyzer names in
custom analyzer field (#57512)
add 2742eacad75 [fix](schema-change) Prevent coredump when reading
non-overlapping segments from a single rowset during heavy schema change
(#57191)
add 77380ff1e2d [fix](cloud)Fix read from peer use thread pool not asyncio
(#57587)
add f11570b9614 [Opt](storage) Add pre decoder for BinaryPlainPageV2 and
BinaryDictPage (#57327)
add 781f428a276 [chore](dep)upgrade netty and hadoop (#57226)
add f9411472943 [improve](glue) Glue endpoint is required. (#57543)
add 0c2597997e1 [fix](docker) fix iceberg docker error: unable to prepare
context: path "spark/" not found (#57417)
add f2e75cbb156 [improve](job) Adding FailureReason after manually
changing the status of a streaming job (#57551)
add 4cef3b1223c [fix](mtmv) Fix mv rewrite fail when mv contains group
sets and filter above scan (#57343)
add 192225bcedd [chore](cast) Make the result of casting a struct to
string consistent with its output to MySQL. (#57451)
add 56fdf39c65e [fix](cloud) Avoid recycle orphan partitions if data
migrating is not finished (#57550)
add 0d304f1738c [feat](cloud) Ignore the staled clusters of the rollbacked
instance (#57478)
add 91465afaf8e [fix](cloud) Remove global snapshot data migrating context
(#57553)
add dc3bb256021 [fix](cloud) Recycle operation logs if multi version
status is WRITE_ONLY (#57552)
add fdef53596b2 [feature](partition prune) support remove predicates that
are always true after partition prune in list partition (#57169)
add 909cdfde989 [fix](variant) fix deserialize array from sparse column
(#57561)
add e676738e171 [feat](hdfs) upgrade libhdfs to 3.4.2 (#57621)
add 022dce9d9bd [chore](dep)Exclude AWS SDK bundle to reduce dependency
size and include only required S3 modules (#57629)
add 312be21f205 [test](inverted index) add test for query type and add
test for searcher (#57603)
add ef4993b0336 [fix](faiss) fix faiss compile on noavx2 enviroment
(#57642)
add f5adb679e7f [chore](cloud) Add thread name for snapshot data migrator
and compactor (#57627)
add f6b9a7d7be4 [fix](cloud) Avoid to enable snapshot switch when multi
version is disabled (#57626)
add a82699ba087 [fix](auto-partition) Replace std::mutex with
bthread::Mutex in VTabletWriter (#57508)
add 194cbe36dd7 [enhancement](load)add LogicalPostProject to cast outputs
according to dest table's schema (#57579)
add 177061201e2 Revert "[fix](varbinary) Rename StringView to
StringContainer" (#57656)
add 32c91fd17a2 [fix](insert) fix insert job duplicate registration
(#57572)
add 43cea886f3e [Improvement](Variant) hash-shard sparse subcolumns via
`variant_sparse_hash_shard_count` (#56502)
add efbfa950d9a [fix](cloud) fix wrong private endpoint when only
configured port number (#57429)
add 576d0e6101f [chore](ci) cloud_p0 add regression conf (#57677)
add 3bf4db3a0f7 [chore](UT) Add --gdb option to run-be-ut.sh and
run-cloud-ut.sh (#57655)
add 25bfafc119a [opt](coercion) let matchType do right thing (#57586)
add 75c8291e5c4 [chore](UT) Add UT for SegmentWriter::_full_encode_keys
(#57653)
add a22f24a85c4 [feat](function) Add new function of strip_null_value
(#57386)
add eb771a485fe [fix](spill) Memory leak in the arena used by the
aggregation operator (#57657)
add 78a0d78016f [fix](function) str_to_date and from_iso8601_date return
null instead of raise error (#57669)
add aef112c95bd [chore](ci) fix typo (#57594)
add 4809cf596d9 [feat](snapshot) clone snapshot support absolute path file
(#57685)
add 6f4468bd9d0 [be](comment) add some comment to page zonemap (#57703)
add ae72d5d1919 [Fix](Variant) handle spase column type correctly (#57701)
add daf013ad93f [fix](cloud) Do not recycle operation logs referenced by
active snapshots (#57694)
add a9093cea761 [feat](cloud) Write and recycle restore job log (#57405)
add 2dee657a397 [Feature](agg) add sem agg function (#57545)
add 7a3ff665668 [Chore](exchange) reduce create wait_channel_timer (#57683)
add 925b7e70b82 [refactor](variant) remove unused function
`same_with_storage_type` (#57624)
add 4dd828ec15c [fix](cosn) fix be jni read on cosn failed (#57241)
add 7631f2b8de5 [feature](partition prune) Add variable
skip_prune_predicate to skip prune predicate after partition prune (#57688)
add 94fe6aae389 [feature](inverted index) add custom analyzer support with
pinyin tokenzer and pinyin filter (#57097)
add e870f7bbb5e [fix](jdbc catalog) Compatible with different versions of
`zeroDateTimeBehavior=convertToNull` writing method (#57682)
add 7a77c085982 [fix](catalog) Clean up refresh thread when deleting
catalog (#57680)
add 5285135c126 [Fix](funtion) Fix utc_time result when input null (#57716)
add a77e7c587a3 [fix](function) Align function signatures between backend
and frontend and remove datev1 types (#56807)
add 30406d6d827 [enhancement](filecache) use rocksdb to persist cache
block meta (#57072)
add a5e4e1c7018 [fix](nereids) Fix not in aggregate's output err after
eliminate by uniform when group sets exist (#56942)
add ef81e72aae0 [fix](cloud) Make tablet stats compatible between
single/multi version keys (#57690)
add 9b5a2132d3f [ann] Ann index only scan (#57243)
add 9429add71b8 [feat](profile) add automatic profile archiving to
compressed ZIP files (#57575)
add da41f40ee90 [fix](tablet report)Replace tablet report with
ForkJoinPool (#57382)
add 54720872b13 [fix](cloud) Add more prompt information when compute
group is invalid (#56946)
new 6ccc8ca260a support prune nested columns
new 1e5c9614055 [Feature](catalog) Prune nested columns for hive/iceberg
parquet and orc reader.
new 28ba969f5b5 Fix parquet_thrift_test unit test.
new 3dfbdea9e40 use slot->col_name_lower_case().
new b7f17ea8820 fix "Index 2 out of bounds for length 2" when use tvf
new 9b00e6fa107 fix case error in BE
new 4000802e5fb fix topN late materialzation access_path.
new bbc61b4cdab support push project in aggregate/join
new cd95b8eed1d fix be ut
new 37beb93061f only support prune olapTable/iceberg/hive(parquet/orc)
new 0279d9c5758 Fix some tests's bugs of external table.
new b2a048deff9 fix npe
new 9efa81907b5 should not prune project nested column if the bottom table
can not prune, e.g. hive(textfile)
new 6fdbdbd020d update orc thirdparty lib commit.
new 4f4b423b6ad use selected column ids for parquet merge io ranges.
new 6572e52de83 Clean external table implementation's code.
new 05c28879f0b fix: missed pruned type with map/array types
new 5119904664c remove debug log
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (4da3edd0274)
\
N -- N -- N refs/heads/nested_column_prune (5119904664c)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 18 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/comment-to-trigger-teamcity.yml | 2 +-
.licenserc.yaml | 1 +
be/CMakeLists.txt | 7 +-
be/dict/pinyin/pinyin.txt | 20902 +
be/dict/pinyin/pinyin_alphabet.dict | 442 +
be/dict/pinyin/polyphone.txt | 462490 ++++++++++++++++++
be/src/cloud/cloud_internal_service.cpp | 225 +-
be/src/cloud/config.cpp | 2 +-
be/src/common/config.cpp | 10 +-
be/src/common/config.h | 3 +
be/src/common/consts.h | 1 +
.../schema_table_options_scanner.cpp | 16 +-
.../schema_scanner/schema_table_options_scanner.h | 1 +
be/src/exec/tablet_info.cpp | 6 +
be/src/exprs/hybrid_set.h | 53 +-
be/src/io/cache/block_file_cache.cpp | 34 +-
be/src/io/cache/block_file_cache.h | 2 +
be/src/io/cache/block_file_cache_downloader.cpp | 8 +
be/src/io/cache/cache_block_meta_store.cpp | 582 +
be/src/io/cache/cache_block_meta_store.h | 142 +
be/src/io/cache/cached_remote_file_reader.cpp | 3 +
be/src/io/cache/file_block.cpp | 42 +-
be/src/io/cache/file_block.h | 9 +-
be/src/io/cache/file_cache_common.cpp | 84 +-
be/src/io/cache/file_cache_common.h | 11 +-
be/src/io/cache/file_cache_storage.h | 9 +-
be/src/io/cache/fs_file_cache_storage.cpp | 676 +-
be/src/io/cache/fs_file_cache_storage.h | 40 +-
be/src/io/cache/mem_file_cache_storage.cpp | 9 +-
be/src/io/cache/mem_file_cache_storage.h | 8 +-
be/src/io/fs/hdfs.h | 2 +-
be/src/io/fs/hdfs_file_writer.cpp | 3 +-
be/src/io/fs/local_file_system.cpp | 1 +
be/src/io/fs/s3_file_reader.cpp | 4 +
be/src/io/fs/s3_file_reader.h | 1 +
be/src/io/fs/s3_file_writer.cpp | 10 +-
be/src/olap/compaction.cpp | 4 +
.../ann_index/cmake-protect/CMakeLists.txt | 9 +
be/src/olap/rowset/segment_v2/binary_dict_page.h | 26 +-
.../segment_v2/binary_dict_page_pre_decoder.h | 134 +
.../olap/rowset/segment_v2/binary_plain_page_v2.h | 183 +-
.../segment_v2/binary_plain_page_v2_pre_decoder.h | 166 +
.../segment_v2/bitshuffle_page_pre_decoder.h | 53 +-
be/src/olap/rowset/segment_v2/column_reader.cpp | 10 +-
be/src/olap/rowset/segment_v2/column_reader.h | 2 +-
be/src/olap/rowset/segment_v2/column_writer.cpp | 4 +-
be/src/olap/rowset/segment_v2/encoding_info.cpp | 12 +-
be/src/olap/rowset/segment_v2/encoding_info.h | 4 +-
.../inverted_index/analysis_factory_mgr.cpp | 6 +
.../inverted_index/analyzer/analyzer.cpp | 141 +-
.../segment_v2/inverted_index/analyzer/analyzer.h | 11 +-
.../inverted_index/token_filter/pinyin_filter.cpp | 441 +
.../inverted_index/token_filter/pinyin_filter.h | 105 +
.../token_filter/pinyin_filter_factory.cpp | 76 +
.../token_filter/pinyin_filter_factory.h} | 37 +-
.../tokenizer/pinyin/chinese_util.cpp | 45 +-
.../tokenizer/pinyin/chinese_util.h} | 20 +-
.../tokenizer/pinyin/pinyin_alphabet_tokenizer.cpp | 224 +
.../tokenizer/pinyin/pinyin_alphabet_tokenizer.h | 49 +
.../tokenizer/pinyin/pinyin_config.h} | 44 +-
.../tokenizer/pinyin/pinyin_format.cpp | 70 +
.../tokenizer/pinyin/pinyin_format.h | 78 +
.../tokenizer/pinyin/pinyin_formatter.cpp | 214 +
.../tokenizer/pinyin/pinyin_formatter.h} | 24 +-
.../tokenizer/pinyin/pinyin_tokenizer.cpp | 339 +
.../tokenizer/pinyin/pinyin_tokenizer.h | 84 +
.../tokenizer/pinyin/pinyin_tokenizer_factory.cpp | 43 +
.../tokenizer/pinyin/pinyin_tokenizer_factory.h} | 25 +-
.../tokenizer/pinyin/pinyin_util.cpp | 292 +
.../inverted_index/tokenizer/pinyin/pinyin_util.h | 55 +
.../inverted_index/tokenizer/pinyin/rune.h} | 29 +-
.../tokenizer/pinyin/smart_forest.cpp | 195 +
.../inverted_index/tokenizer/pinyin/smart_forest.h | 143 +
.../tokenizer/pinyin/smart_get_word.cpp | 219 +
.../tokenizer/pinyin/smart_get_word.h | 95 +
.../inverted_index/tokenizer/pinyin/term_item.h | 73 +
be/src/olap/rowset/segment_v2/page_io.cpp | 23 +-
be/src/olap/rowset/segment_v2/page_io.h | 5 +
be/src/olap/rowset/segment_v2/segment.cpp | 18 +-
be/src/olap/rowset/segment_v2/segment.h | 2 -
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 100 +-
be/src/olap/rowset/segment_v2/segment_iterator.h | 2 +
be/src/olap/rowset/segment_v2/segment_writer.cpp | 5 +-
be/src/olap/rowset/segment_v2/segment_writer.h | 2 +-
.../variant/sparse_column_merge_iterator.cpp | 3 +-
.../segment_v2/variant/variant_column_reader.cpp | 251 +-
.../segment_v2/variant/variant_column_reader.h | 48 +-
.../variant/variant_column_writer_impl.cpp | 278 +-
.../variant/variant_column_writer_impl.h | 72 +-
.../rowset/segment_v2/variant_stats_calculator.cpp | 3 +-
.../rowset/segment_v2/virtual_column_iterator.cpp | 12 +-
be/src/olap/rowset/segment_v2/zone_map_index.cpp | 2 +-
be/src/olap/rowset/segment_v2/zone_map_index.h | 4 +-
be/src/olap/schema_change.cpp | 4 +-
be/src/olap/tablet_meta.cpp | 3 +
be/src/olap/tablet_schema.cpp | 4 +
be/src/olap/tablet_schema.h | 8 +
be/src/pipeline/exec/aggregation_sink_operator.cpp | 1 +
be/src/pipeline/exec/exchange_sink_operator.cpp | 27 +-
be/src/pipeline/exec/olap_scan_operator.cpp | 2 +-
be/src/pipeline/exec/olap_scan_operator.h | 2 +-
.../exec/partitioned_aggregation_sink_operator.cpp | 1 +
be/src/runtime/primitive_type.h | 14 +-
be/src/util/jni-util.cpp | 1 +
.../aggregate_function_group_array_intersect.cpp | 66 -
.../aggregate_function_group_array_intersect.h | 507 -
.../aggregate_function_group_array_set_op.cpp | 158 +
.../aggregate_function_group_array_set_op.h | 480 +
.../aggregate_function_map_v2.cpp | 2 -
.../aggregate_functions/aggregate_function_sem.cpp | 41 +
.../aggregate_functions/aggregate_function_sem.h | 149 +
.../aggregate_function_simple_factory.cpp | 6 +-
.../aggregate_function_window.cpp | 22 -
be/src/vec/columns/column_varbinary.cpp | 6 +-
be/src/vec/columns/column_varbinary.h | 18 +-
be/src/vec/columns/column_variant.cpp | 4 +-
be/src/vec/common/schema_util.cpp | 43 +-
be/src/vec/common/schema_util.h | 6 +
.../{string_container.cpp => string_view.cpp} | 6 +-
.../common/{string_container.h => string_view.h} | 40 +-
be/src/vec/core/field.h | 17 +-
be/src/vec/data_types/data_type_varbinary.cpp | 6 +-
be/src/vec/data_types/data_type_varbinary.h | 7 +-
.../data_types/serde/data_type_struct_serde.cpp | 2 +
be/src/vec/exec/format/parquet/decoder.cpp | 12 +-
.../format/parquet/fix_length_dict_decoder.hpp | 65 +-
be/src/vec/exec/scan/es_scanner.cpp | 2 +-
be/src/vec/exec/scan/file_scanner.cpp | 10 +-
be/src/vec/exec/scan/jdbc_scanner.cpp | 3 +
be/src/vec/exec/scan/meta_scanner.cpp | 3 +
be/src/vec/exec/scan/olap_scanner.cpp | 4 +-
be/src/vec/exec/scan/scan_node.h | 2 +-
be/src/vec/exec/scan/scanner.cpp | 9 +-
be/src/vec/exec/scan/scanner.h | 8 +-
be/src/vec/exprs/vectorized_fn_call.cpp | 24 +-
be/src/vec/exprs/vexpr.cpp | 6 +-
be/src/vec/exprs/vexpr.h | 11 +-
be/src/vec/exprs/vexpr_context.cpp | 43 +-
be/src/vec/exprs/vexpr_context.h | 3 +
.../vec/functions/array/function_array_apply.cpp | 4 -
be/src/vec/functions/array/function_array_index.h | 16 +-
be/src/vec/functions/array/function_array_remove.h | 11 -
be/src/vec/functions/function_bit.cpp | 16 +-
be/src/vec/functions/function_bit_count.cpp | 19 +-
.../function_date_or_datetime_computation.cpp | 167 +-
.../function_date_or_datetime_computation.h | 13 +-
.../function_date_or_datetime_computation_v2.cpp | 165 -
.../function_date_or_datetime_to_string.cpp | 4 -
.../vec/functions/function_datetime_floor_ceil.cpp | 31 +-
.../function_datetime_string_to_string.cpp | 4 -
be/src/vec/functions/function_jsonb.cpp | 67 +
.../vec/functions/function_other_types_to_date.cpp | 58 +-
be/src/vec/functions/function_unary_arithmetic.h | 54 +-
be/src/vec/functions/function_varbinary.cpp | 8 +-
be/src/vec/functions/functions_comparison.h | 4 -
be/src/vec/functions/least_greast.cpp | 14 -
be/src/vec/functions/math.cpp | 150 +-
be/src/vec/functions/round.cpp | 1 -
be/src/vec/functions/simple_function_factory.h | 2 -
be/src/vec/functions/time_of_function.cpp | 17 -
be/src/vec/functions/to_time_function.cpp | 31 -
be/src/vec/olap/vcollect_iterator.cpp | 20 +
be/src/vec/sink/writer/vtablet_writer.cpp | 4 +-
be/src/vec/sink/writer/vtablet_writer.h | 4 +-
be/src/vec/utils/varbinaryop_subbinary.h | 8 +-
be/test/io/cache/block_file_cache_test.cpp | 87 +-
.../io/cache/block_file_cache_test_meta_store.cpp | 421 +
be/test/io/cache/cache_block_meta_store_test.cpp | 860 +
.../rowset/segment_v2/binary_dict_page_test.cpp | 78 +-
.../segment_v2/binary_plain_page_v2_test.cpp | 57 +-
.../rowset/segment_v2/bitshuffle_page_test.cpp | 14 +-
.../olap/rowset/segment_v2/encoding_info_test.cpp | 171 +
.../inverted_index/ananlyzer/analyzer_test.cpp | 348 +
.../inverted_index/query_v2/doc_set_test.cpp | 154 +
.../token_filter/pinyin_filter_test.cpp | 409 +
.../tokenizer/pinyin_alphabet_tokenizer_test.cpp | 248 +
.../tokenizer/pinyin_analysis_test.cpp | 1372 +
.../inverted_index/tokenizer/pinyin_util_test.cpp | 685 +
.../inverted_index/tokenizer/smart_forest_test.cpp | 204 +
.../tokenizer/smart_get_word_test.cpp | 361 +
.../segment_v2/inverted_index_query_type_test.cpp | 125 +
.../segment_v2/inverted_index_searcher_test.cpp | 242 +
.../variant_column_writer_reader_test.cpp | 31 +-
.../olap/segment_writer_full_encode_keys_test.cpp | 101 +
.../olap/vector_search/ann_range_search_test.cpp | 17 +-
.../vec/aggregate_functions/agg_collect_test.cpp | 15 +-
.../agg_group_array_intersect_test.cpp | 38 +-
be/test/vec/aggregate_functions/agg_test.cpp | 161 +
be/test/vec/columns/column_varbinary_test.cpp | 66 +-
be/test/vec/columns/column_variant_test.cpp | 94 +
be/test/vec/common/schema_util_rowset_test.cpp | 29 +
...ing_container_test.cpp => string_view_test.cpp} | 86 +-
be/test/vec/data_types/data_type_struct_test.cpp | 2 +-
.../vec/data_types/data_type_varbinary_test.cpp | 8 +-
.../serde/data_type_from_string_test.cpp | 4 +-
.../data_types/serde/data_type_to_string_test.cpp | 2 +-
.../serde/data_type_write_to_jsonb_test.cpp | 14 +-
.../parquet/fix_length_dict_decoder_test.cpp | 4 +-
be/test/vec/exec/orc/orc_reader_fill_data_test.cpp | 152 +-
.../vec/function/function_array_element_test.cpp | 36 -
be/test/vec/function/function_array_index_test.cpp | 57 -
.../vec/function/function_arrays_overlap_test.cpp | 31 -
be/test/vec/function/function_math_test.cpp | 40 -
be/test/vec/function/function_test_util.h | 6 +-
be/test/vec/function/function_time_test.cpp | 58 +-
be/test/vec/function/table_function_test.cpp | 24 -
cloud/script/run_all_tests.sh | 20 +-
cloud/src/meta-service/meta_service.cpp | 81 +-
cloud/src/meta-service/meta_service_job.cpp | 176 +-
cloud/src/meta-service/meta_service_resource.cpp | 17 +-
.../src/meta-service/meta_service_tablet_stats.cpp | 50 +-
cloud/src/meta-service/meta_service_tablet_stats.h | 20 +-
cloud/src/meta-service/meta_service_txn.cpp | 8 +-
cloud/src/meta-service/txn_lazy_committer.cpp | 4 +-
cloud/src/recycler/recycler.cpp | 8 +-
cloud/src/recycler/recycler.h | 7 +-
cloud/src/recycler/recycler_operation_log.cpp | 21 +-
cloud/src/recycler/snapshot_chain_compactor.cpp | 1 +
cloud/src/recycler/snapshot_data_migrator.cpp | 15 +-
cloud/src/recycler/snapshot_data_migrator.h | 24 +-
cloud/src/resource-manager/resource_manager.cpp | 17 +-
cloud/test/meta_service_operation_log_test.cpp | 1394 -
cloud/test/meta_service_test.cpp | 36 +-
cloud/test/recycler_operation_log_test.cpp | 20 +-
cloud/test/resource_test.cpp | 97 +
contrib/faiss | 2 +-
dist/LICENSE-dist.txt | 2 +-
.../docker-compose/iceberg/iceberg.yaml.tpl | 1 -
.../iceberg-metadata-scanner/pom.xml | 1 -
fe/be-java-extensions/preload-extensions/pom.xml | 21 +-
.../java/org/apache/doris/catalog/ScalarType.java | 33 +-
.../main/java/org/apache/doris/catalog/Type.java | 8 +
.../java/org/apache/doris/catalog/VariantType.java | 20 +-
.../main/java/org/apache/doris/common/Config.java | 46 +-
fe/fe-core/pom.xml | 19 +-
.../src/main/java/org/apache/doris/DorisFE.java | 7 +-
.../org/apache/doris/analysis/ArrayLiteral.java | 72 -
.../java/org/apache/doris/analysis/CastExpr.java | 96 -
.../org/apache/doris/analysis/DateLiteral.java | 62 -
.../org/apache/doris/analysis/DecimalLiteral.java | 31 -
.../apache/doris/analysis/DefaultValueExprDef.java | 30 +-
.../main/java/org/apache/doris/analysis/Expr.java | 144 -
.../org/apache/doris/analysis/FloatLiteral.java | 28 -
.../apache/doris/analysis/FunctionCallExpr.java | 22 -
.../java/org/apache/doris/analysis/IntLiteral.java | 44 -
.../org/apache/doris/analysis/JsonLiteral.java | 6 -
.../org/apache/doris/analysis/LargeIntLiteral.java | 18 -
.../org/apache/doris/analysis/LiteralExpr.java | 34 -
.../java/org/apache/doris/analysis/MapLiteral.java | 86 -
.../org/apache/doris/analysis/NullLiteral.java | 13 -
.../org/apache/doris/analysis/StringLiteral.java | 154 -
.../org/apache/doris/analysis/StructLiteral.java | 32 -
.../org/apache/doris/analysis/TryCastExpr.java | 11 -
.../doris/catalog/BuiltinAggregateFunctions.java | 4 +
.../doris/catalog/BuiltinScalarFunctions.java | 6 +
.../main/java/org/apache/doris/catalog/Column.java | 31 +-
.../java/org/apache/doris/catalog/SchemaTable.java | 4 +
.../apache/doris/catalog/TabletInvertedIndex.java | 518 +-
.../doris/cloud/catalog/CloudTabletRebalancer.java | 4 +-
.../doris/cloud/load/CloudBrokerLoadJob.java | 4 +-
.../apache/doris/cloud/qe/CloudCoordinator.java | 7 +-
.../common/profile/ProfileArchiveManager.java | 682 +
.../doris/common/profile/ProfileManager.java | 157 +-
.../apache/doris/common/util/PropertyAnalyzer.java | 21 +
.../org/apache/doris/datasource/CatalogMgr.java | 1 +
.../org/apache/doris/datasource/FileScanNode.java | 15 +-
.../doris/datasource/jdbc/JdbcExternalCatalog.java | 9 +-
.../datasource/jdbc/client/JdbcMySQLClient.java | 6 +-
.../maxcompute/MaxComputeExternalTable.java | 11 +-
.../maxcompute/MaxComputeSchemaCacheValue.java | 9 +-
.../maxcompute/source/MaxComputeScanNode.java | 10 +
.../metastore/AWSGlueMetaStoreBaseProperties.java | 6 +-
.../org/apache/doris/httpv2/rest/LoadAction.java | 3 +-
.../org/apache/doris/indexpolicy/IndexPolicy.java | 7 +-
.../apache/doris/indexpolicy/IndexPolicyMgr.java | 31 +-
.../indexpolicy/PinyinTokenFilterValidator.java | 159 +
.../indexpolicy/PinyinTokenizerValidator.java | 157 +
.../insert/streaming/StreamingInsertJob.java | 10 +
.../streaming/StreamingJobSchedulerTask.java | 1 +
.../org/apache/doris/job/manager/JobManager.java | 7 +-
.../org/apache/doris/load/loadv2/LoadManager.java | 2 +-
.../java/org/apache/doris/mysql/MysqlChannel.java | 6 +-
.../org/apache/doris/mysql/MysqlSslContext.java | 7 +-
.../org/apache/doris/mysql/SslEngineHelper.java | 75 +
.../org/apache/doris/nereids/StatementContext.java | 9 +
.../doris/nereids/jobs/executor/Rewriter.java | 2 +
.../nereids/load/NereidsLoadPlanInfoCollector.java | 105 +-
.../nereids/load/NereidsLoadScanProvider.java | 16 +-
.../doris/nereids/load/NereidsLoadUtils.java | 48 +
.../doris/nereids/parser/LogicalPlanBuilder.java | 10 +-
.../org/apache/doris/nereids/rules/RuleSet.java | 2 +-
.../org/apache/doris/nereids/rules/RuleType.java | 3 +
.../doris/nereids/rules/analysis/BindSink.java | 36 +-
.../nereids/rules/exploration/mv/StructInfo.java | 15 +-
.../rules/expression/ExpressionRuleType.java | 1 +
.../rules/expression/rules/PartitionPruner.java | 131 +-
.../rewrite/EliminateGroupByKeyByUniform.java | 6 +
.../nereids/rules/rewrite/ExprIdRewriter.java | 59 +-
.../rules/rewrite/PruneFileScanPartition.java | 8 +-
.../rules/rewrite/PruneOlapScanPartition.java | 41 +-
.../rules/rewrite/PushDownJoinOnAssertNumRows.java | 229 +
.../trees/expressions/VirtualSlotReference.java | 7 +
.../functions/ComputeSignatureHelper.java | 111 +
.../GroupArrayUnion.java} | 55 +-
.../{scalar/SecToTime.java => agg/Sem.java} | 50 +-
.../expressions/functions/agg/SequenceCount.java | 2 +-
.../expressions/functions/agg/SequenceMatch.java | 2 +-
.../expressions/functions/agg/TopNWeighted.java | 25 +-
.../expressions/functions/agg/WindowFunnel.java | 2 +-
.../functions/executable/DateTimeArithmetic.java | 13 +-
.../executable/DateTimeExtractAndTransform.java | 261 +-
.../expressions/functions/scalar/ArrayRange.java | 8 +-
.../functions/scalar/ArrayRangeDayUnit.java | 4 +-
.../functions/scalar/ArrayRangeHourUnit.java | 4 +-
.../functions/scalar/ArrayRangeMinuteUnit.java | 4 +-
.../functions/scalar/ArrayRangeMonthUnit.java | 4 +-
.../functions/scalar/ArrayRangeQuarterUnit.java | 4 +-
.../functions/scalar/ArrayRangeSecondUnit.java | 4 +-
.../functions/scalar/ArrayRangeWeekUnit.java | 4 +-
.../functions/scalar/ArrayRangeYearUnit.java | 4 +-
.../expressions/functions/scalar/ConvertTz.java | 4 +-
.../functions/scalar/Crc32Internal.java | 26 +-
.../expressions/functions/scalar/CurrentTime.java | 4 +-
.../trees/expressions/functions/scalar/Date.java | 5 +-
.../expressions/functions/scalar/DateDiff.java | 7 +-
.../expressions/functions/scalar/DateFormat.java | 8 +-
.../expressions/functions/scalar/DateTrunc.java | 20 +-
.../expressions/functions/scalar/DayCeil.java | 14 +-
.../expressions/functions/scalar/DayFloor.java | 14 +-
.../expressions/functions/scalar/DayName.java | 5 +-
.../expressions/functions/scalar/DayOfMonth.java | 5 +-
.../expressions/functions/scalar/DayOfWeek.java | 5 +-
.../expressions/functions/scalar/DayOfYear.java | 5 +-
.../expressions/functions/scalar/DaySecondAdd.java | 2 +-
.../expressions/functions/scalar/DaysAdd.java | 2 +-
.../expressions/functions/scalar/DaysDiff.java | 8 +-
.../expressions/functions/scalar/DaysSub.java | 3 +-
.../trees/expressions/functions/scalar/Field.java | 3 +-
.../functions/scalar/FromIso8601Date.java | 4 +-
.../trees/expressions/functions/scalar/Hour.java | 6 +-
.../expressions/functions/scalar/HourCeil.java | 14 +-
.../expressions/functions/scalar/HourFloor.java | 14 +-
.../expressions/functions/scalar/HoursAdd.java | 2 +-
.../expressions/functions/scalar/HoursDiff.java | 7 +-
.../expressions/functions/scalar/HoursSub.java | 2 +-
.../expressions/functions/scalar/LastDay.java | 2 +-
.../expressions/functions/scalar/MakeTime.java | 2 +-
.../functions/scalar/MicroSecondTimestamp.java | 2 +-
.../functions/scalar/MicroSecondsAdd.java | 2 +-
.../functions/scalar/MicroSecondsDiff.java | 2 +-
.../functions/scalar/MicroSecondsSub.java | 2 +-
.../expressions/functions/scalar/Microsecond.java | 2 +-
.../functions/scalar/MilliSecondTimestamp.java | 2 +-
.../functions/scalar/MilliSecondsAdd.java | 2 +-
.../functions/scalar/MilliSecondsDiff.java | 2 +-
.../functions/scalar/MilliSecondsSub.java | 2 +-
.../trees/expressions/functions/scalar/Minute.java | 6 +-
.../expressions/functions/scalar/MinuteCeil.java | 14 +-
.../expressions/functions/scalar/MinuteFloor.java | 14 +-
.../expressions/functions/scalar/MinutesAdd.java | 2 +-
.../expressions/functions/scalar/MinutesDiff.java | 7 +-
.../expressions/functions/scalar/MinutesSub.java | 2 +-
.../trees/expressions/functions/scalar/Month.java | 4 +-
.../expressions/functions/scalar/MonthCeil.java | 14 +-
.../expressions/functions/scalar/MonthFloor.java | 14 +-
.../expressions/functions/scalar/MonthName.java | 5 +-
.../expressions/functions/scalar/MonthsAdd.java | 2 +-
.../expressions/functions/scalar/MonthsDiff.java | 5 +-
.../expressions/functions/scalar/MonthsSub.java | 2 +-
.../trees/expressions/functions/scalar/Now.java | 2 +-
.../expressions/functions/scalar/Quarter.java | 7 +-
.../expressions/functions/scalar/QuarterCeil.java | 14 +-
.../expressions/functions/scalar/QuarterFloor.java | 14 +-
.../expressions/functions/scalar/QuartersAdd.java | 2 +-
.../expressions/functions/scalar/QuartersDiff.java | 2 +-
.../expressions/functions/scalar/QuartersSub.java | 2 +-
.../expressions/functions/scalar/SecToTime.java | 2 +-
.../trees/expressions/functions/scalar/Second.java | 6 +-
.../expressions/functions/scalar/SecondCeil.java | 14 +-
.../expressions/functions/scalar/SecondFloor.java | 14 +-
.../functions/scalar/SecondTimestamp.java | 2 +-
.../expressions/functions/scalar/SecondsAdd.java | 2 +-
.../expressions/functions/scalar/SecondsDiff.java | 7 +-
.../expressions/functions/scalar/SecondsSub.java | 2 +-
.../expressions/functions/scalar/StrToDate.java | 4 +-
.../scalar/{TimeToSec.java => StripNullValue.java} | 30 +-
.../trees/expressions/functions/scalar/Time.java | 2 +-
.../expressions/functions/scalar/TimeDiff.java | 6 +-
.../expressions/functions/scalar/TimeToSec.java | 2 +-
.../expressions/functions/scalar/Timestamp.java | 16 +-
.../trees/expressions/functions/scalar/ToDate.java | 6 +-
.../expressions/functions/scalar/ToDateV2.java | 2 +-
.../trees/expressions/functions/scalar/ToDays.java | 4 +-
.../expressions/functions/scalar/ToIso8601.java | 9 +-
.../trees/expressions/functions/scalar/ToJson.java | 4 +-
.../expressions/functions/scalar/ToMonday.java | 2 +-
.../functions/scalar/UnixTimestamp.java | 8 +-
.../expressions/functions/scalar/UtcTime.java | 13 +-
.../expressions/functions/scalar/UtcTimestamp.java | 9 +-
.../trees/expressions/functions/scalar/Week.java | 8 +-
.../expressions/functions/scalar/WeekCeil.java | 14 +-
.../expressions/functions/scalar/WeekFloor.java | 14 +-
.../expressions/functions/scalar/WeekOfYear.java | 5 +-
.../expressions/functions/scalar/Weekday.java | 5 +-
.../expressions/functions/scalar/WeeksAdd.java | 2 +-
.../expressions/functions/scalar/WeeksDiff.java | 5 +-
.../expressions/functions/scalar/WeeksSub.java | 2 +-
.../trees/expressions/functions/scalar/Year.java | 5 +-
.../expressions/functions/scalar/YearCeil.java | 14 +-
.../expressions/functions/scalar/YearFloor.java | 14 +-
.../expressions/functions/scalar/YearWeek.java | 8 +-
.../expressions/functions/scalar/YearsAdd.java | 2 +-
.../expressions/functions/scalar/YearsDiff.java | 5 +-
.../expressions/functions/scalar/YearsSub.java | 2 +-
.../functions/window/RequireTrivialTypes.java | 4 +-
.../visitor/AggregateFunctionVisitor.java | 10 +
.../expressions/visitor/ScalarFunctionVisitor.java | 5 +
.../trees/plans/commands/DeleteFromCommand.java | 7 +-
.../trees/plans/commands/PauseJobCommand.java | 5 +-
.../trees/plans/commands/ResumeJobCommand.java | 4 +-
.../trees/plans/commands/UpdateCommand.java | 3 +-
.../trees/plans/commands/insert/InsertUtils.java | 44 +-
.../plans/commands/merge/MergeIntoCommand.java | 19 +-
.../BackendDistributedPlanWorkerManager.java | 5 +-
.../trees/plans/logical/LogicalAggregate.java | 6 +
...LogicalProject.java => LogicalPostProject.java} | 148 +-
.../trees/plans/logical/LogicalProject.java | 19 +
.../nereids/trees/plans/visitor/PlanVisitor.java | 5 +
.../org/apache/doris/nereids/types/DataType.java | 5 +-
.../apache/doris/nereids/types/DateTimeV2Type.java | 4 +-
.../apache/doris/nereids/types/DecimalV2Type.java | 2 +-
.../org/apache/doris/nereids/types/TimeV2Type.java | 7 +-
.../apache/doris/nereids/types/VarcharType.java | 4 +-
.../apache/doris/nereids/types/VariantType.java | 23 +-
.../doris/nereids/util/TypeCoercionUtils.java | 13 +-
.../org/apache/doris/planner/OlapScanNode.java | 23 +-
.../java/org/apache/doris/qe/ConnectContext.java | 43 +-
.../java/org/apache/doris/qe/SessionVariable.java | 238 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 11 +-
.../resource/computegroup/ComputeGroupMgr.java | 22 +-
.../java/org/apache/doris/rewrite/FEFunctions.java | 50 -
.../ExternalFileTableValuedFunction.java | 9 +-
.../doris/tablefunction/MetadataGenerator.java | 83 +-
.../tablefunction/NumbersTableValuedFunction.java | 9 +-
.../common/profile/ProfileArchiveManagerTest.java | 1107 +
.../doris/common/profile/ProfileManagerTest.java | 230 +
.../AWSGlueMetaStoreBasePropertiesTest.java | 2 +-
.../external/elasticsearch/QueryBuildersTest.java | 38 +-
.../nereids/mv/OptimizeGetAvailableMvsTest.java | 4 +-
.../nereids/rules/expression/FoldConstantTest.java | 95 +-
.../rules/expression/check/CheckCastTest.java | 112 +-
.../nereids/rules/rewrite/PartitionPrunerTest.java | 570 +
.../rewrite/PushDownJoinOnAssertNumRowsTest.java | 454 +
.../doris/nereids/trees/expressions/CastTest.java | 26 +-
.../nereids/trees/expressions/TryCastTest.java | 2 +-
.../functions/ComputeSignatureHelperTest.java | 58 +-
.../plans/commands/CreateResourceCommandTest.java | 2 +-
.../GrantResourcePrivilegeCommandTest.java | 2 +-
.../RevokeResourcePrivilegeCommandTest.java | 2 +-
.../plans/commands/merge/MergeIntoCommandTest.java | 2 +-
.../apache/doris/nereids/types/DataTypeTest.java | 10 +-
.../doris/nereids/util/TypeCoercionUtilsTest.java | 11 +-
.../org/apache/doris/rewrite/FEFunctionsTest.java | 840 -
.../doris/rewrite/RewriteDateLiteralRuleTest.java | 255 -
fe/pom.xml | 28 +-
gensrc/proto/file_cache.proto | 14 +
gensrc/proto/olap_file.proto | 2 +
gensrc/thrift/Descriptors.thrift | 1 +
.../data/ann_index_p0/ann_index_only_scan.out | 19 +
.../data/correctness/test_str_to_date.out | 16 +
.../test_function_signature_all_types.out | 553 +
.../sql-functions/doc_date_functions_test.out | 36 +
.../paimon/paimon_base_filesystem.out | 3 +
.../test_builtin_analyzer_in_custom_analyzer.out | 49 +
.../analyzer/test_custom_analyzer.out | 174 +
.../data/nereids_function_p0/scalar_function/S.out | 58 +
.../datetime_functions/test_date_function.out | 1 +
.../infer_predicate/infer_unequal_predicates.out | 19 +-
.../mv/grouping_sets/grouping_sets.out | 10 +
.../partition_prune/list_prune_predicate.out | 4 +
.../query_p0/aggregate/group_array_intersect.out | 95 +
.../test_aggregate_all_functions2.out | 54 +
.../test_strip_null_value.out | 28 +
.../datetime_functions/test_date_function.out | 6 +
.../datetime_functions/test_from_iso8601_date.out | 114 +
.../data/query_p0/system/test_table_options.out | 40 +-
.../test_non_overlap_seg_heavy_sc.out | 7 +
.../tpcds_sf100/noStatsRfPrune/query54.out | 76 +-
.../tpcds_sf100/no_stats_shape/query54.out | 76 +-
.../shape_check/tpcds_sf100/rf_prune/query54.out | 82 +-
.../data/shape_check/tpcds_sf100/shape/query54.out | 82 +-
.../tpcds_sf1000/bs_downgrade_shape/query54.out | 82 +-
.../data/shape_check/tpcds_sf1000/hint/query54.out | 82 +-
.../shape_check/tpcds_sf1000/shape/query54.out | 82 +-
.../shape_check/tpcds_sf10t_orc/shape/query54.out | 76 +-
.../predefine/test_all_prdefine_type_to_sparse.out | 144 +-
.../pipeline/cloud_p0/conf/be_custom.conf | 2 +
regression-test/pipeline/cloud_p0/run.sh | 2 +
regression-test/pipeline/external/conf/be.conf | 2 +
.../pipeline/external/conf/regression-conf.groovy | 2 -
.../pipeline/nonConcurrent/conf/be.conf | 1 +
.../nonConcurrent/conf/regression-conf.groovy | 2 -
regression-test/pipeline/p0/conf/be.conf | 2 +
.../pipeline/p0/conf/regression-conf.groovy | 2 -
regression-test/pipeline/p1/conf/be.conf | 2 +
.../suites/ann_index_p0/ann_index_only_scan.groovy | 450 +
.../ann_index_only_scan_distance_expr.groovy | 206 +
.../ann_index_only_scan_metric_direction.groovy | 228 +
.../cloud_p0/balance/test_balance_metrics.groovy | 2 +-
.../balance/test_peer_read_async_warmup.groovy | 1 +
.../test_drop_cluster_clean_metrics.groovy | 2 +-
.../test_fe_tablet_same_backend.groovy | 2 +-
.../multi_cluster/test_no_cluster_hits.groovy | 34 +-
.../cloud_p0/multi_cluster/test_rebalance.groovy | 6 +-
.../suites/correctness/test_str_to_date.groovy | 40 +-
.../test_function_signature_all_types.groovy | 1044 +
regression-test/suites/ddl_p0/test_ctas.groovy | 7 -
.../sql-manual/sql-functions/doc_date_error.groovy | 12 -
.../sql-functions/doc_date_functions_test.groovy | 92 +-
.../test_hive_metadata_refresh_interval.groovy | 101 +
.../paimon/paimon_base_filesystem.groovy | 3 +-
...test_builtin_analyzer_in_custom_analyzer.groovy | 140 +
.../analyzer/test_custom_analyzer.groovy | 347 +-
.../load_p0/insert/test_insert_statistic.groovy | 10 +-
.../nereids_function_p0/scalar_function/S.groovy | 20 +-
.../eliminate_group_by_key_by_uniform.groovy | 95 +
.../mv/grouping_sets/grouping_sets.groovy | 37 +
.../partition_prune/hive_partition_prune.groovy | 2 +-
.../partition_prune/list_prune_predicate.groovy | 328 +
.../aggregate/group_array_intersect.groovy | 32 +
.../test_aggregate_all_functions2.groovy | 22 +
.../test_strip_null_value.groovy | 88 +
.../datetime_functions/test_date_function.groovy | 19 +-
.../test_from_iso8601_date.groovy | 167 +-
.../query_p0/system/test_table_options.groovy | 10 +-
.../test_non_overlap_seg_heavy_sc.groovy | 74 +
regression-test/suites/variant_p0/desc.groovy | 1 +
.../test_all_prdefine_type_to_sparse.groovy | 3 +-
.../suites/variant_sparse_benchmark_p2/load.groovy | 208 +
run-be-ut.sh | 21 +-
run-cloud-ut.sh | 19 +-
thirdparty/CHANGELOG.md | 4 +
thirdparty/download-thirdparty.sh | 14 +-
thirdparty/patches/cctz-civil-cache.patch | 119 +
thirdparty/patches/librdkafka-1.9.2.patch | 189 -
thirdparty/patches/librdkafka-2.11.0.patch | 76 +
thirdparty/vars.sh | 10 +-
547 files changed, 509351 insertions(+), 8767 deletions(-)
create mode 100644 be/dict/pinyin/pinyin.txt
create mode 100644 be/dict/pinyin/pinyin_alphabet.dict
create mode 100644 be/dict/pinyin/polyphone.txt
create mode 100644 be/src/io/cache/cache_block_meta_store.cpp
create mode 100644 be/src/io/cache/cache_block_meta_store.h
create mode 100644 be/src/olap/rowset/segment_v2/binary_dict_page_pre_decoder.h
create mode 100644
be/src/olap/rowset/segment_v2/binary_plain_page_v2_pre_decoder.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/token_filter/pinyin_filter.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/token_filter/pinyin_filter.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/token_filter/pinyin_filter_factory.cpp
copy be/src/{vec/exec/scan/scan_node.h =>
olap/rowset/segment_v2/inverted_index/token_filter/pinyin_filter_factory.h}
(52%)
copy gensrc/proto/file_cache.proto =>
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/chinese_util.cpp
(52%)
copy be/src/{io/fs/hdfs.h =>
olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/chinese_util.h} (66%)
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/pinyin_alphabet_tokenizer.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/pinyin_alphabet_tokenizer.h
copy be/src/{vec/exec/scan/scan_node.h =>
olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/pinyin_config.h} (51%)
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/pinyin_format.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/pinyin_format.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/pinyin_formatter.cpp
copy be/src/{io/fs/hdfs.h =>
olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/pinyin_formatter.h} (62%)
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/pinyin_tokenizer.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/pinyin_tokenizer.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/pinyin_tokenizer_factory.cpp
copy be/src/{io/fs/hdfs.h =>
olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/pinyin_tokenizer_factory.h}
(55%)
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/pinyin_util.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/pinyin_util.h
copy be/src/{io/fs/hdfs.h =>
olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/rune.h} (55%)
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/smart_forest.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/smart_forest.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/smart_get_word.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/smart_get_word.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin/term_item.h
delete mode 100644
be/src/vec/aggregate_functions/aggregate_function_group_array_intersect.cpp
delete mode 100644
be/src/vec/aggregate_functions/aggregate_function_group_array_intersect.h
create mode 100644
be/src/vec/aggregate_functions/aggregate_function_group_array_set_op.cpp
create mode 100644
be/src/vec/aggregate_functions/aggregate_function_group_array_set_op.h
create mode 100644 be/src/vec/aggregate_functions/aggregate_function_sem.cpp
create mode 100644 be/src/vec/aggregate_functions/aggregate_function_sem.h
rename be/src/vec/common/{string_container.cpp => string_view.cpp} (91%)
rename be/src/vec/common/{string_container.h => string_view.h} (80%)
delete mode 100644
be/src/vec/functions/function_date_or_datetime_computation_v2.cpp
create mode 100644 be/test/io/cache/block_file_cache_test_meta_store.cpp
create mode 100644 be/test/io/cache/cache_block_meta_store_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/ananlyzer/analyzer_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/token_filter/pinyin_filter_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin_alphabet_tokenizer_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin_analysis_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/tokenizer/pinyin_util_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/tokenizer/smart_forest_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/tokenizer/smart_get_word_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index_query_type_test.cpp
create mode 100644 be/test/olap/segment_writer_full_encode_keys_test.cpp
rename be/test/vec/common/{string_container_test.cpp => string_view_test.cpp}
(78%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/common/profile/ProfileArchiveManager.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/indexpolicy/PinyinTokenFilterValidator.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/indexpolicy/PinyinTokenizerValidator.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/mysql/SslEngineHelper.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/PushDownJoinOnAssertNumRows.java
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/{scalar/FromIso8601Date.java
=> agg/GroupArrayUnion.java} (59%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/{scalar/SecToTime.java
=> agg/Sem.java} (62%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{TimeToSec.java
=> StripNullValue.java} (67%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/logical/{LogicalProject.java
=> LogicalPostProject.java} (53%)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/common/profile/ProfileArchiveManagerTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/PartitionPrunerTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/PushDownJoinOnAssertNumRowsTest.java
delete mode 100644
fe/fe-core/src/test/java/org/apache/doris/rewrite/FEFunctionsTest.java
delete mode 100644
fe/fe-core/src/test/java/org/apache/doris/rewrite/RewriteDateLiteralRuleTest.java
create mode 100644 regression-test/data/ann_index_p0/ann_index_only_scan.out
create mode 100644
regression-test/data/correctness_p0/test_function_signature_all_types.out
create mode 100644
regression-test/data/inverted_index_p0/analyzer/test_builtin_analyzer_in_custom_analyzer.out
create mode 100644
regression-test/data/nereids_rules_p0/partition_prune/list_prune_predicate.out
create mode 100644
regression-test/data/query_p0/sql_functions/conditional_functions/test_strip_null_value.out
create mode 100644
regression-test/data/schema_change_p0/test_non_overlap_seg_heavy_sc.out
create mode 100644
regression-test/suites/ann_index_p0/ann_index_only_scan.groovy
create mode 100644
regression-test/suites/ann_index_p0/ann_index_only_scan_distance_expr.groovy
create mode 100644
regression-test/suites/ann_index_p0/ann_index_only_scan_metric_direction.groovy
create mode 100644
regression-test/suites/correctness_p0/test_function_signature_all_types.groovy
create mode 100644
regression-test/suites/external_table_p0/hive/test_hive_metadata_refresh_interval.groovy
create mode 100644
regression-test/suites/inverted_index_p0/analyzer/test_builtin_analyzer_in_custom_analyzer.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/partition_prune/list_prune_predicate.groovy
create mode 100644
regression-test/suites/query_p0/sql_functions/conditional_functions/test_strip_null_value.groovy
create mode 100644
regression-test/suites/schema_change_p0/test_non_overlap_seg_heavy_sc.groovy
create mode 100644
regression-test/suites/variant_sparse_benchmark_p2/load.groovy
create mode 100644 thirdparty/patches/cctz-civil-cache.patch
delete mode 100644 thirdparty/patches/librdkafka-1.9.2.patch
create mode 100644 thirdparty/patches/librdkafka-2.11.0.patch
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
