This is an automated email from the ASF dual-hosted git repository.
kirs pushed a change to branch auto-pick-59667-branch-4.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from 8ec916c2edf [chore](dep)Upgrade dependencies (#59667)
add 61242ee8ab0 branch-4.0: [fix](date time comparison) fix date time
compare with low scale literal #59630 (#59659)
add 11f4276b917 branch-4.0: [feat](job) support show routine load job
compute group #59540 (#59650)
add f47e1626238 branch-4.0: [opt](scanner) set number of file scanner to
max_scanners_concurrency(#59622) (#59696)
add e776dd4117b Cherry-pick cloud snapshot related PRs to branch-4.0
(#59470)
add 144478931cc branch-4.0: [fix](case) exclude some unstable or fail case
#59674 (#59675)
add 0221a73b135 branch-4.0:[enhancement](parquet)support column predicate
tree min-max filter for parquet page index. (#57771) (#59680)
add 1744ff17bcd branch-4.0: [fix](case) fix regression test
add_project_for_unique_function #58835 (#59636)
add 7c8df011c1a branch-4.0: Fix: Ensure HUDI tables are processed
correctly by throwing an error for incorrect PhysicalFileScan usage (#59709)
add b21ef786e53 branch-4.0: [fix](float) Fix float field `to_string`
(#59737)
add f82b12b2c46 branch-4.0: [Fix](streamingjob) modify select backend
policy for streaming job #59705 (#59731)
add a175e041d29 branch-4.0: [fix](catalog) update the table's last update
time after related operations. (#59387) (#59695)
add 348c63c2cdf branch-4.0: [Enhancement](parquet)update runtime filter
when read next parquet row group. (#59053) (#59725)
add 08d3052ddda branch-4.0: [cherry-pick](branch40) cherry-pick from
master 59564 and 59473 (#59729)
add 05bae644d8e branch-4.0: [fix](case) fix regression test
add_project_for_unique_function (#59682)
add 5ca01b6f479 branch-4.0: [feat](cloud) Cherry pick packed file prs
(#59693)
add 1c27a65b091 branch-4.0: [fix](restore) Preserve cross-database
references when restoring views #59580 (#59662)
add 5630dc98f24 branch-4.0: [Feature](function) Support function
TIME_FORMAT (#58592) (#59704)
add a1d3386fa7f [fix](test) fix regression test limit_push_down (#59686)
add fbaf2bd63ae branch-4.0: [enhancement](recycle bin) optimize the
recycle bin to reduce the potential of FE hang #55753 (#59699)
add 09ed1fe893a branch-4.0: [Fix](rules) fix result wrong of
PushDownAggThroughJoinOnPkFk #59498 (#59703)
add aae5957dfa2 [Chore](query) add _query_ctx_map_delay_delete (#59262)
(#56911) (#59638)
add c992307c331 branch-4.0: [fix](pipeline)Fix set_operation not correctly
setting shuffled_operator #59293 (#59702)
add 0cf97f451bd branch-4.0: [fix](agg) fix rule merge_aggregate #59629
(#59663)
add 658c14e4d26 branch-4.0: [cloud](fdb) Fix missing backup agent in
fdb.conf of fdb_ctl.sh #59641 (#59753)
add 681d0b890fc branch-4.0: [Opt](cloud) cache table version for cloud
mode #59339 (#59442)
add cb4d81366a8 branch-4.0: [fix](parquet)fix hudi parquet read
hoodie.datasource.write.drop.partition.columns prop table cause be core. #58532
(#59749)
add f6ebcb83600 [chore](be) remove all LRU Cache default value (#59556)
(#59751)
add 00503bc74ea branch-4.0: [optimize](parquet-reader) Optimize
performance by parquet bloom filter. (#59727)
add 2ded0048952 [fix](fe) add compatible code for LocalTablet and
LocalReplica (#59771)
add 05c063d7324 branch-4.0: [feature](inverted index) Implement es-like
boolean query #58545 (#59766)
add b4d26a34add branch-4.0: [Fix](Hdfs)Fix Kerberos auth config detection
and auto-enable hive.metastore.sasl #59748 (#59763)
add e3943ef952f [Bug](runtime-filter) use rf_lock to lock
local_state.conjuncts read operator #59688 (#59770)
add a33cc788609 branch-4.0: [Fix](Streamingjob) Fix the issue of
synchronization failure under empty tables #59735 (#59790)
add 3940c799ce5 branch-4.0: [fix](profile) sort out parquet reader profile
(#58895) (#59789)
add 16b404a48fc branch-4.0: [bug](parquet) fix parquet type not handle
float16 type #58528 (#58630)
add 396c09362fb branch-4.0: [Feature](func) Support function
QUANTILE_STATE_TO/FROM_BASE64 #59664 (#59746)
add 93aa5f4a549 branch-4.0: [Exec](profile) add max row count one backend
in materialization profile #59728 (#59758)
add ba970b560b1 branch-4.0: [opt](memory) lazily create column writer when
flush memtable for partial update (#59772)
add e773e767127 branch-4.0: [Fix](function) fix skip null value for some
date functions #59616 (#59694)
add d285daf9b66 branch-4.0: [fix](cloud) Txn lazy committer update the txn
commit op log min_versionstamp #59448 (#59711)
add a1ceaf027d3 branch-4.0: [fix](recycler) Add recycle state for rs meta
to avoid data loss #58459 (#59765)
add 0e0bbae04e0 branch-4.0: [fix](cloud) Fix brpc::Server::ClearServices()
SEGV #59717 (#59803)
add 98adabe98f7 branch-4.0: [Fix](Streamingjob) fix show task error info
when task timeout #59784 (#59807)
add 2eac5174c94 branch-4.0: [refact](inverted index) use inverted index
context for query #58981 (#59595)
add 8f2348bc7eb branch-4.0: [chore](tools) Update TPC-DS DDLs #59756
(#59802)
add 3cd69346d3a [fix](set) Fix correctness caused by set operation
(#59589) (#59801)
add 2852d845490 branch-4.0: [fix](inverted index) fix BM25 LENGTH_TABLE
using byte4_to_int for correct norm decoding #59713 (#59812)
add e8975b441cc branch-4.0: [Chore](Notice)Update Notice year to 2026
#59822 (#59824)
add da6a88722d9 branch-4.0: [behaviorchange](segmentcache) disable segment
cache prune default #59670 (#59825)
add 3347892cadf branch-4.0: [refine](type) Ensure that the internal
encoding types in Doris are trivially copyable. #59736 (#59805)
add 31f0d7b86f3 branch-4.0: [add](test)Add a test case for parquet reader
lazy read struct column. #59777 (#59811)
add d41fe6b2b39 branch-4.0: [Fix](Streaming) fix get remote meta failed to
pause streaming job #59760 (#59808)
add 9efe793ad3e branch-4.0: [opt](varbinary) add conf control mapping
iceberg uuid (#59726) (#59764)
add f988f65f45c branch-4.0: [chore](cloud) Change enable_packed_file
default to false and add fuzzy config #59773 (#59817)
add 0174967dfb9 [branch-4.0]Pick predicates-related PR (#59804)
add a42b16a6a1a branch-4.0: [fix](auth)fix some ldap bug #58541 (#59826)
add d53be9fef84 branch-4.0: [fix](parquet) Fix struct column reading error
when all queried fields are missing after schema evolution #59586 (#59839)
add d2023938ae1 branch-4.0: [fix](cloud) Fix memory leak in
CloudTxnDeleteBitmapCache for empty rowsets #59710 (#59819)
add f8aed3b5547 branch-4.0: [Fix](StreamingJob) fix postgres consumer data
in multi backend #59798 (#59841)
add fef71d4cb05 branch-4.0: [feature](search) introduce lucene bool mode
for search function #59394 (#59745)
add 7a50c7dc0aa branch-4.0: [fix](regression-case) Fix case
test_s3_load_with_where #59744 (#59829)
add 170baba9e4f branch-4.0: [enhancement](cloud) improve FE RPC retry and
MetaService connection handling #59698 (#59849)
add 194de6a6791 branch-4.0: [feat](hms)Enabling Kerberos authentication
for HMS automatically enables the SASL transport #59783 (#59842)
add ff175d9eeab branch-4.0: [fix](variant) variant type rely on light
schema change #59712 (#59855)
add d556b6e2ee4 branch-4.0: [Fix](StreamingJob) fix create table issues
when create streaming job #59828 (#59853)
add 43e309e9fc5 branch-4.0: [feature](posexplode) support multi args
#58990 (#59875)
add 555e561574c branch-4.0: [fix](hudi) Disable nested column pruning for
HUDI tables to avoid potential issues (#59860) (#59869)
add 443e00ad155 [fix](fe) add compatible code for CloudTablet (#59815)
add 5a76dbf2332 [fix](profile) Fix the issues of too many writer profile
results (#59863)
add 19414edeff7 branch-4.0: [fix](inverted index) fix incorrect supported
types output in tokenizer error message #59666 (#59865)
add 53749edd244 branch-4.0: [Fix](Streamingjob) fix streaming job auto
resume clear error #59868 (#59894)
add 076c08b67f4 [refine](expr) Use the new execute interface of expr in
some places. … (#59879)
add 16e4ec61991 branch-4.0: [fix](local shuffle) fix set operation compute
wrong data because not set AggregationNode.isColocate #59840 (#59882)
add 12e0e1ec046 branch-4.0: [Fix](StreamingJob) fix the first split task
scheduled and fe restart remainsplit relay problem #59883 (#59902)
add e5786112c48 branch-4.0: [fix](project push down) union and its
children's output are mis order #58765 (#59886)
add 6b91e7021ef Merge branch 'branch-4.0' into auto-pick-59667-branch-4.0
No new revisions were added by this update.
Summary of changes:
NOTICE.txt | 2 +-
.../cloud/cloud_engine_calc_delete_bitmap_task.cpp | 19 +-
be/src/cloud/cloud_meta_mgr.cpp | 26 +-
be/src/cloud/cloud_meta_mgr.h | 3 +
be/src/cloud/cloud_rowset_builder.cpp | 9 +
be/src/cloud/cloud_rowset_writer.cpp | 76 +-
be/src/cloud/cloud_rowset_writer.h | 12 +-
be/src/cloud/cloud_schema_change_job.cpp | 1 +
be/src/cloud/cloud_tablet.cpp | 2 +
be/src/cloud/cloud_tablet_mgr.cpp | 4 +-
be/src/cloud/cloud_txn_delete_bitmap_cache.cpp | 43 +-
be/src/cloud/cloud_txn_delete_bitmap_cache.h | 13 +
be/src/cloud/config.cpp | 13 +-
be/src/cloud/config.h | 10 +
be/src/cloud/injection_point_action.cpp | 36 +-
be/src/cloud/pb_convert.cpp | 36 +
be/src/common/config.cpp | 4 +-
be/src/exec/olap_common.h | 262 +-
be/src/exec/olap_utils.h | 53 +-
.../schema_cluster_snapshot_properties_scanner.cpp | 28 +-
.../schema_cluster_snapshots_scanner.cpp | 19 +-
.../schema_routine_load_job_scanner.cpp | 4 +
.../exec/schema_scanner/schema_scanner_helper.cpp | 2 +-
be/src/exec/schema_scanner/schema_scanner_helper.h | 5 +-
be/src/exprs/bitmapfilter_predicate.h | 4 +-
be/src/exprs/create_predicate_function.h | 45 +-
be/src/index-tools/index_tool.cpp | 7 +-
be/src/io/fs/buffered_reader.cpp | 3 -
be/src/io/fs/buffered_reader.h | 18 -
be/src/io/fs/packed_file_manager.cpp | 915 +
be/src/io/fs/packed_file_manager.h | 207 +
be/src/io/fs/packed_file_reader.cpp | 87 +
be/src/io/fs/packed_file_reader.h | 63 +
be/src/io/fs/packed_file_system.cpp | 114 +
be/src/io/fs/packed_file_system.h | 97 +
be/src/io/fs/packed_file_trailer.cpp | 152 +
.../fs/packed_file_trailer.h} | 23 +-
be/src/io/fs/packed_file_writer.cpp | 233 +
be/src/io/fs/packed_file_writer.h | 91 +
be/src/io/fs/s3_file_writer.cpp | 64 +-
be/src/io/fs/s3_file_writer.h | 4 +
be/src/io/fs/tracing_file_reader.h | 1 +
be/src/olap/accept_null_predicate.h | 30 +-
be/src/olap/bitmap_filter_predicate.h | 25 +-
be/src/olap/block_column_predicate.cpp | 32 +
be/src/olap/block_column_predicate.h | 38 +-
be/src/olap/bloom_filter_predicate.h | 23 +-
be/src/olap/calc_delete_bitmap_executor.h | 21 +
be/src/olap/collection_statistics.cpp | 59 +-
be/src/olap/column_predicate.h | 90 +-
be/src/olap/compaction.cpp | 3 +
be/src/olap/comparison_predicate.h | 137 +-
be/src/olap/delete_handler.cpp | 488 +-
be/src/olap/delete_handler.h | 21 +-
be/src/olap/delta_writer_v2.cpp | 8 +-
be/src/olap/in_list_predicate.h | 293 +-
be/src/olap/inverted_index_parser.h | 28 +-
be/src/olap/iterators.h | 5 +-
be/src/olap/like_column_predicate.cpp | 4 +-
be/src/olap/like_column_predicate.h | 31 +-
be/src/olap/null_predicate.cpp | 5 +-
be/src/olap/null_predicate.h | 38 +-
be/src/olap/page_cache.h | 11 +-
be/src/olap/predicate_creator.cpp | 135 +
be/src/olap/predicate_creator.h | 471 +-
be/src/olap/push_handler.cpp | 6 +-
be/src/olap/push_handler.h | 2 +-
be/src/olap/rowset/beta_rowset_writer.cpp | 124 +-
be/src/olap/rowset/beta_rowset_writer.h | 11 +-
be/src/olap/rowset/rowset_factory.cpp | 4 +-
be/src/olap/rowset/rowset_meta.cpp | 30 +-
be/src/olap/rowset/rowset_meta.h | 15 +
be/src/olap/rowset/rowset_reader_context.h | 4 +-
be/src/olap/rowset/rowset_writer_context.h | 76 +-
be/src/olap/rowset/segment_creator.cpp | 4 +-
be/src/olap/rowset/segment_v2/bloom_filter.h | 9 +-
be/src/olap/rowset/segment_v2/column_reader.cpp | 14 +-
be/src/olap/rowset/segment_v2/column_reader.h | 28 +-
.../olap/rowset/segment_v2/index_file_writer.cpp | 32 +-
be/src/olap/rowset/segment_v2/index_file_writer.h | 11 +-
.../inverted_index/analyzer/analyzer.cpp | 57 +-
.../segment_v2/inverted_index/analyzer/analyzer.h | 4 +-
.../inverted_index/query_v2/all_query/all_query.h | 112 +
.../query_v2/boolean_query/boolean_query_builder.h | 84 +
.../query_v2/{operator.h => boolean_query/occur.h} | 2 +-
.../query_v2/boolean_query/occur_boolean_query.h | 75 +
.../boolean_query/occur_boolean_weight.cpp | 287 +
.../query_v2/boolean_query/occur_boolean_weight.h | 88 +
.../query_v2/{ => boolean_query}/operator.h | 0
.../{boolean_query.h => operator_boolean_query.h} | 41 +-
...{boolean_weight.h => operator_boolean_weight.h} | 12 +-
.../inverted_index/query_v2/disjunction_scorer.cpp | 129 +
.../inverted_index/query_v2/disjunction_scorer.h | 66 +
.../segment_v2/inverted_index/query_v2/doc_set.h | 4 +
.../inverted_index/query_v2/exclude_scorer.cpp | 86 +
.../{union/simple_union.h => exclude_scorer.h} | 42 +-
.../inverted_index/query_v2/intersection.cpp | 206 +-
.../inverted_index/query_v2/intersection.h | 20 +-
.../query_v2/phrase_query/multi_phrase_weight.h | 3 +-
.../query_v2/phrase_query/phrase_scorer.cpp | 16 +-
.../query_v2/phrase_query/phrase_scorer.h | 7 +-
.../query_v2/phrase_query/phrase_weight.h | 6 +-
.../query_v2/postings/loaded_postings.cpp | 3 +-
.../query_v2/regexp_query/regexp_weight.cpp | 2 +-
.../inverted_index/query_v2/reqopt_scorer.h | 80 +
.../inverted_index/query_v2/segment_postings.h | 195 +-
.../segment_v2/inverted_index/query_v2/size_hint.h | 48 +
.../query_v2/term_query/term_scorer.h | 5 +-
.../query_v2/term_query/term_weight.h | 23 +-
.../query_v2/union/buffered_union.cpp | 259 +
.../inverted_index/query_v2/union/buffered_union.h | 65 +
.../inverted_index/query_v2/union/simple_union.cpp | 2 +-
.../inverted_index/query_v2/union/simple_union.h | 5 +
.../segment_v2/inverted_index/query_v2/weight.h | 20 +-
.../inverted_index/similarity/bm25_similarity.cpp | 2 +-
.../segment_v2/inverted_index/util/tiny_set.h | 34 +-
.../olap/rowset/segment_v2/inverted_index_cache.h | 17 +-
.../segment_v2/inverted_index_fs_directory.cpp | 42 +-
.../rowset/segment_v2/inverted_index_iterator.cpp | 3 +-
.../rowset/segment_v2/inverted_index_iterator.h | 6 +
.../rowset/segment_v2/inverted_index_reader.cpp | 21 +-
.../olap/rowset/segment_v2/inverted_index_reader.h | 12 +-
.../rowset/segment_v2/inverted_index_writer.cpp | 30 +-
.../olap/rowset/segment_v2/inverted_index_writer.h | 4 +-
be/src/olap/rowset/segment_v2/segment.cpp | 35 +-
be/src/olap/rowset/segment_v2/segment.h | 1 +
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 73 +-
be/src/olap/rowset/segment_v2/segment_iterator.h | 22 +-
be/src/olap/rowset/segment_v2/segment_writer.h | 2 +-
.../rowset/segment_v2/vertical_segment_writer.cpp | 34 +-
.../rowset/segment_v2/vertical_segment_writer.h | 2 +-
be/src/olap/schema_cache.h | 4 +-
be/src/olap/schema_change.cpp | 3 +
be/src/olap/segment_loader.h | 9 +-
be/src/olap/shared_predicate.h | 70 +-
be/src/olap/storage_engine.h | 4 +-
be/src/olap/tablet_column_object_pool.h | 5 +-
be/src/olap/tablet_meta.cpp | 4 +-
be/src/olap/tablet_reader.cpp | 118 +-
be/src/olap/tablet_reader.h | 26 +-
be/src/olap/tablet_schema_cache.h | 5 +-
be/src/olap/task/index_builder.cpp | 18 +-
be/src/olap/txn_manager.h | 6 +-
be/src/pipeline/exec/analytic_sink_operator.cpp | 7 +-
be/src/pipeline/exec/dict_sink_operator.cpp | 18 +-
be/src/pipeline/exec/file_scan_operator.cpp | 35 +-
be/src/pipeline/exec/file_scan_operator.h | 24 +-
be/src/pipeline/exec/materialization_opertor.cpp | 13 +
be/src/pipeline/exec/materialization_opertor.h | 8 +
be/src/pipeline/exec/mock_scan_operator.h | 44 +-
be/src/pipeline/exec/olap_scan_operator.cpp | 125 +-
be/src/pipeline/exec/olap_scan_operator.h | 38 +-
be/src/pipeline/exec/operator.cpp | 12 +-
.../pipeline/exec/partition_sort_sink_operator.cpp | 13 +-
.../pipeline/exec/partition_sort_sink_operator.h | 1 -
be/src/pipeline/exec/repeat_operator.cpp | 12 +-
be/src/pipeline/exec/scan_operator.cpp | 1082 +-
be/src/pipeline/exec/scan_operator.h | 149 +-
be/src/pipeline/exec/set_probe_sink_operator.h | 2 +
be/src/pipeline/exec/set_sink_operator.h | 2 +
be/src/pipeline/exec/union_sink_operator.h | 7 +-
be/src/pipeline/pipeline_fragment_context.cpp | 14 +-
be/src/pipeline/pipeline_fragment_context.h | 3 +-
be/src/pipeline/query_cache/query_cache.h | 4 +-
be/src/runtime/exec_env.h | 3 +
be/src/runtime/exec_env_init.cpp | 13 +
be/src/runtime/fragment_mgr.cpp | 11 +
be/src/runtime/fragment_mgr.h | 4 +-
be/src/runtime/load_channel_mgr.h | 5 +-
be/src/runtime/memory/lru_cache_policy.h | 8 +-
be/src/runtime/query_context.cpp | 9 +-
be/src/runtime/runtime_predicate.cpp | 194 +-
be/src/runtime/runtime_predicate.h | 18 +-
.../runtime/stream_load/stream_load_executor.cpp | 23 +-
.../runtime_filter_consumer_helper.cpp | 11 +
.../runtime_filter_consumer_helper.h | 6 +
be/src/runtime_filter/runtime_filter_mgr.cpp | 24 -
be/src/runtime_filter/runtime_filter_mgr.h | 5 +-
be/src/service/http_service.cpp | 1 +
be/src/service/point_query_executor.cpp | 3 +-
be/src/service/point_query_executor.h | 5 +-
be/src/tools/CMakeLists.txt | 29 +
be/src/tools/packed_file_tool.cpp | 56 +
be/src/util/hash_util.hpp | 10 +
be/src/util/obj_lru_cache.cpp | 3 +-
be/src/util/s3_util.cpp | 22 +
be/src/util/s3_util.h | 11 +
be/src/util/thrift_rpc_helper.cpp | 52 +-
be/src/util/thrift_rpc_helper.h | 11 +
.../aggregate_function_sequence_match.h | 5 +-
.../aggregate_function_window_funnel.h | 1 -
be/src/vec/common/pod_array.h | 5 +
be/src/vec/common/sort/sorter.cpp | 12 +-
be/src/vec/core/field.cpp | 83 +-
be/src/vec/core/types.h | 6 +
be/src/vec/exec/format/avro/avro_jni_reader.cpp | 6 +-
be/src/vec/exec/format/avro/avro_jni_reader.h | 4 +-
be/src/vec/exec/format/generic_reader.cpp | 252 -
be/src/vec/exec/format/generic_reader.h | 20 -
be/src/vec/exec/format/jni_reader.cpp | 6 +-
be/src/vec/exec/format/jni_reader.h | 6 +-
be/src/vec/exec/format/json/new_json_reader.cpp | 15 +-
be/src/vec/exec/format/orc/vorc_reader.cpp | 20 +-
be/src/vec/exec/format/orc/vorc_reader.h | 4 -
.../parquet/parquet_block_split_bloom_filter.cpp | 134 +
.../parquet/parquet_block_split_bloom_filter.h | 82 +
.../exec/format/parquet/parquet_column_convert.cpp | 5 +
.../exec/format/parquet/parquet_column_convert.h | 84 +
be/src/vec/exec/format/parquet/parquet_common.h | 18 +-
.../{parquet_pred_cmp.h => parquet_predicate.h} | 105 +-
be/src/vec/exec/format/parquet/schema_desc.cpp | 10 +-
.../parquet/vparquet_column_chunk_reader.cpp | 14 +-
.../format/parquet/vparquet_column_chunk_reader.h | 17 +-
.../exec/format/parquet/vparquet_column_reader.cpp | 83 +-
.../exec/format/parquet/vparquet_column_reader.h | 120 +-
.../exec/format/parquet/vparquet_group_reader.cpp | 56 +-
.../exec/format/parquet/vparquet_group_reader.h | 16 +-
.../exec/format/parquet/vparquet_page_index.cpp | 20 +-
.../vec/exec/format/parquet/vparquet_page_index.h | 7 +-
.../exec/format/parquet/vparquet_page_reader.cpp | 9 +-
.../vec/exec/format/parquet/vparquet_page_reader.h | 9 +-
be/src/vec/exec/format/parquet/vparquet_reader.cpp | 752 +-
be/src/vec/exec/format/parquet/vparquet_reader.h | 112 +-
be/src/vec/exec/format/table/hive_reader.cpp | 18 +-
be/src/vec/exec/format/table/hive_reader.h | 10 +-
be/src/vec/exec/format/table/hudi_jni_reader.cpp | 6 +-
be/src/vec/exec/format/table/hudi_jni_reader.h | 4 +-
be/src/vec/exec/format/table/hudi_reader.cpp | 15 +-
be/src/vec/exec/format/table/hudi_reader.h | 18 +-
be/src/vec/exec/format/table/iceberg_reader.cpp | 31 +-
be/src/vec/exec/format/table/iceberg_reader.h | 8 +-
.../format/table/iceberg_sys_table_jni_reader.cpp | 5 +-
.../format/table/iceberg_sys_table_jni_reader.h | 3 +-
.../vec/exec/format/table/lakesoul_jni_reader.cpp | 5 +-
be/src/vec/exec/format/table/lakesoul_jni_reader.h | 3 +-
.../exec/format/table/max_compute_jni_reader.cpp | 6 +-
.../vec/exec/format/table/max_compute_jni_reader.h | 4 +-
be/src/vec/exec/format/table/paimon_jni_reader.cpp | 6 +-
be/src/vec/exec/format/table/paimon_jni_reader.h | 4 +-
be/src/vec/exec/format/table/paimon_reader.h | 26 +-
.../format/table/paimon_sys_table_jni_reader.cpp | 6 +-
.../format/table/paimon_sys_table_jni_reader.h | 4 +-
.../format/table/transactional_hive_reader.cpp | 8 +-
.../exec/format/table/transactional_hive_reader.h | 1 -
.../format/table/trino_connector_jni_reader.cpp | 5 +-
.../exec/format/table/trino_connector_jni_reader.h | 3 +-
be/src/vec/exec/jni_connector.cpp | 25 +-
be/src/vec/exec/jni_connector.h | 6 +-
be/src/vec/exec/scan/file_scanner.cpp | 158 +-
be/src/vec/exec/scan/file_scanner.h | 9 +-
be/src/vec/exec/scan/meta_scanner.cpp | 4 +-
be/src/vec/exec/scan/olap_scanner.cpp | 46 +-
be/src/vec/exec/scan/olap_scanner.h | 10 +-
be/src/vec/exec/scan/scanner.cpp | 4 +-
.../vec/exprs/table_function/vexplode_bitmap.cpp | 6 +-
.../exprs/table_function/vexplode_json_object.cpp | 6 +-
be/src/vec/exprs/vexpr.cpp | 9 +-
be/src/vec/exprs/vexpr.h | 3 +-
be/src/vec/exprs/vexpr_context.cpp | 12 +
be/src/vec/exprs/vexpr_context.h | 23 +-
be/src/vec/exprs/vmatch_predicate.cpp | 36 +-
be/src/vec/exprs/vmatch_predicate.h | 6 +-
be/src/vec/exprs/vruntimefilter_wrapper.h | 1 +
be/src/vec/exprs/vtopn_pred.h | 3 +
be/src/vec/functions/array/function_array_index.h | 4 +-
.../vec/functions/array/function_arrays_overlap.h | 5 +-
be/src/vec/functions/cast/cast_to_string.h | 4 +-
be/src/vec/functions/date_time_transforms.h | 71 +
be/src/vec/functions/function.h | 8 +-
.../function_date_or_datetime_computation.cpp | 8 +-
.../function_date_or_datetime_computation.h | 148 +-
.../function_date_or_datetime_to_string.cpp | 49 +-
.../function_datetime_string_to_string.cpp | 6 +
be/src/vec/functions/function_ip.h | 1 +
be/src/vec/functions/function_multi_match.cpp | 4 +-
be/src/vec/functions/function_multi_match.h | 1 +
.../vec/functions/function_needs_to_handle_null.h | 6 +
be/src/vec/functions/function_quantile_state.cpp | 127 +
be/src/vec/functions/function_search.cpp | 80 +-
be/src/vec/functions/function_search.h | 3 +-
be/src/vec/functions/function_tokenize.cpp | 48 +-
be/src/vec/functions/function_tokenize.h | 4 +-
be/src/vec/functions/functions_comparison.h | 4 +-
be/src/vec/functions/in.h | 6 +-
be/src/vec/functions/is_not_null.h | 1 +
be/src/vec/functions/is_null.h | 1 +
be/src/vec/functions/match.cpp | 128 +-
be/src/vec/functions/match.h | 25 +-
be/src/vec/olap/olap_data_convertor.cpp | 8 +-
be/src/vec/olap/olap_data_convertor.h | 2 +
be/src/vec/runtime/time_value.h | 16 +
be/src/vec/runtime/timestamptz_value.cpp | 2 -
be/src/vec/runtime/vdatetime_value.cpp | 505 +-
be/src/vec/runtime/vdatetime_value.h | 34 +
be/test/io/fs/packed_file_concurrency_test.cpp | 753 +
be/test/io/fs/packed_file_manager_test.cpp | 1129 +
be/test/io/fs/packed_file_reader_test.cpp | 271 +
be/test/io/fs/packed_file_system_test.cpp | 439 +
be/test/io/fs/packed_file_writer_test.cpp | 259 +
be/test/io/fs/s3_file_writer_test.cpp | 3 +-
be/test/io/packed_file_trailer_test.cpp | 116 +
be/test/olap/block_column_predicate_test.cpp | 515 +-
be/test/olap/date_bloom_filter_test.cpp | 124 +-
be/test/olap/delete_handler_test.cpp | 46 +-
be/test/olap/inverted_index_parser_test.cpp | 34 +-
be/test/olap/lru_cache_test.cpp | 4 +-
.../rowset/segment_v2/index_reader_helper_test.cpp | 3 +-
.../inverted_index/ananlyzer/analyzer_test.cpp | 126 +-
.../inverted_index/empty_index_file_test.cpp | 3 +-
.../query/phrase_edge_query_test.cpp | 4 +-
.../query/phrase_prefix_query_test.cpp | 4 +-
.../inverted_index/query/phrase_query_test.cpp | 4 +-
.../boolean_query/boolean_query_builder_test.cpp | 387 +
.../inverted_index/query_v2/boolean_query_test.cpp | 31 +-
.../query_v2/buffered_union_test.cpp | 684 +
.../query_v2/disjunction_scorer_test.cpp | 389 +
.../query_v2/exclude_scorer_test.cpp | 569 +
.../inverted_index/query_v2/intersection_test.cpp | 94 +-
.../query_v2/occur_boolean_query_test.cpp | 707 +
.../inverted_index/query_v2/reqopt_scorer_test.cpp | 540 +
.../query_v2/segment_postings_test.cpp | 226 +-
.../similarity/bm25_similarity_test.cpp | 28 +-
.../segment_v2/inverted_index/util/reader_test.cpp | 20 +-
.../segment_v2/inverted_index_array_test.cpp | 21 +-
.../inverted_index_compound_reader_test.cpp | 8 +-
.../segment_v2/inverted_index_file_reader_test.cpp | 6 +-
.../segment_v2/inverted_index_file_writer_test.cpp | 92 +-
.../segment_v2/inverted_index_reader_test.cpp | 24 +-
.../segment_v2/inverted_index_writer_test.cpp | 48 +-
.../rowset/segment_v2/segment_corruption_test.cpp | 4 +-
be/test/olap/test_data/rowset_meta.json | 3 +-
be/test/olap/wal/wal_manager_test.cpp | 4 +-
.../operator/scan_normalize_predicate_test.cpp | 416 +-
be/test/testutil/mock/mock_in_expr.h | 2 +-
be/test/vec/columns/pod_array_type_test.cpp | 66 +
.../vec/exec/format/parquet/parquet_expr_test.cpp | 817 +-
.../vec/exec/format/parquet/parquet_read_lines.cpp | 8 +-
.../exec/format/parquet/parquet_reader_test.cpp | 94 +-
.../format/parquet/parquet_statistics_test.cpp | 2 +-
.../exec/format/table/hive/hive_reader_test.cpp | 5 +-
.../format/table/iceberg/iceberg_reader_test.cpp | 5 +-
be/test/vec/exec/orc/orc_read_lines.cpp | 4 +-
be/test/vec/exec/orc_reader_test.cpp | 2 +-
be/test/vec/exec/vfile_scanner_exception_test.cpp | 4 +-
be/test/vec/function/function_ip_test.cpp | 7 +-
be/test/vec/function/function_is_null_test.cpp | 16 +-
be/test/vec/function/function_match_test.cpp | 19 +-
be/test/vec/function/function_multi_match_test.cpp | 2 +-
.../vec/function/function_quantile_state_test.cpp | 216 +
be/test/vec/function/function_search_test.cpp | 445 +-
be/test/vec/function/function_test_util.cpp | 11 +
cloud/CMakeLists.txt | 75 +-
cloud/cmake/install_fdb.cmake | 280 +
cloud/src/common/bvars.cpp | 39 +-
cloud/src/common/bvars.h | 26 +
cloud/src/common/config.h | 59 +
cloud/src/common/stopwatch.h | 4 +
cloud/src/{recycler => common}/sync_executor.h | 0
cloud/src/common/util.cpp | 10 +-
cloud/src/meta-service/http_encode_key.cpp | 287 +-
cloud/src/meta-service/meta_server.cpp | 188 +
cloud/src/meta-service/meta_server.h | 51 +
cloud/src/meta-service/meta_service.cpp | 758 +-
cloud/src/meta-service/meta_service.h | 57 +-
cloud/src/meta-service/meta_service_helper.h | 6 +-
cloud/src/meta-service/meta_service_http.cpp | 109 +-
cloud/src/meta-service/meta_service_job.cpp | 372 +-
cloud/src/meta-service/meta_service_partition.cpp | 196 +-
cloud/src/meta-service/meta_service_resource.cpp | 725 +-
cloud/src/meta-service/meta_service_snapshot.cpp | 44 +-
.../src/meta-service/meta_service_tablet_stats.cpp | 287 +-
cloud/src/meta-service/meta_service_tablet_stats.h | 46 +-
cloud/src/meta-service/meta_service_txn.cpp | 276 +-
cloud/src/meta-service/txn_lazy_committer.cpp | 695 +-
cloud/src/meta-service/txn_lazy_committer.h | 23 +-
cloud/src/meta-store/CMakeLists.txt | 1 +
cloud/src/meta-store/blob_message.cpp | 178 +
cloud/src/meta-store/blob_message.h | 111 +
cloud/src/meta-store/clone_chain_reader.cpp | 1338 +
.../{meta_reader.h => clone_chain_reader.h} | 140 +-
cloud/src/meta-store/keys.cpp | 613 +-
cloud/src/meta-store/keys.h | 224 +-
cloud/src/meta-store/mem_txn_kv.cpp | 98 +
cloud/src/meta-store/mem_txn_kv.h | 15 +
cloud/src/meta-store/meta_reader.cpp | 300 +-
cloud/src/meta-store/meta_reader.h | 76 +-
cloud/src/meta-store/txn_kv.cpp | 81 +-
cloud/src/meta-store/txn_kv.h | 18 +-
cloud/src/meta-store/txn_kv_error.h | 2 +
cloud/src/recycler/azure_obj_client.cpp | 7 +
cloud/src/recycler/azure_obj_client.h | 3 +
cloud/src/recycler/checker.cpp | 428 +-
cloud/src/recycler/checker.h | 32 +-
cloud/src/recycler/checker_snapshot.cpp | 29 +
cloud/src/recycler/hdfs_accessor.cpp | 7 +
cloud/src/recycler/hdfs_accessor.h | 2 +
cloud/src/recycler/meta_checker.cpp | 575 +-
cloud/src/recycler/meta_checker.h | 81 +-
cloud/src/recycler/obj_storage_client.h | 3 +
cloud/src/recycler/recycler.cpp | 2211 +-
cloud/src/recycler/recycler.h | 193 +-
cloud/src/recycler/recycler_operation_log.cpp | 211 +-
cloud/src/recycler/recycler_service.cpp | 5 +-
cloud/src/recycler/recycler_snapshot.cpp | 21 +
cloud/src/recycler/s3_accessor.cpp | 17 +
cloud/src/recycler/s3_accessor.h | 2 +
cloud/src/recycler/s3_obj_client.cpp | 24 +
cloud/src/recycler/s3_obj_client.h | 3 +
cloud/src/recycler/snapshot_chain_compactor.cpp | 461 +
cloud/src/recycler/snapshot_chain_compactor.h | 111 +
cloud/src/recycler/snapshot_data_migrator.cpp | 369 +
cloud/src/recycler/snapshot_data_migrator.h | 110 +
.../src/recycler/snapshot_data_size_calculator.cpp | 453 +
cloud/src/recycler/storage_vault_accessor.h | 2 +
cloud/src/recycler/sync_executor.h | 131 +-
cloud/src/resource-manager/resource_manager.cpp | 64 +-
cloud/src/resource-manager/resource_manager.h | 8 +
cloud/src/snapshot/snapshot_manager.cpp | 79 +-
cloud/src/snapshot/snapshot_manager.h | 29 +-
cloud/test/CMakeLists.txt | 8 +
cloud/test/blob_message_test.cpp | 274 +
cloud/test/clone_chain_reader_test.cpp | 2280 +
cloud/test/document_message_test.cpp | 23 +-
cloud/test/fdb_injection_test.cpp | 7 +-
cloud/test/http_encode_key_test.cpp | 426 +
cloud/test/keys_test.cpp | 389 +-
cloud/test/mem_txn_kv_test.cpp | 288 +
cloud/test/meta_reader_test.cpp | 500 +
cloud/test/meta_server_test.cpp | 234 +-
cloud/test/meta_service_http_test.cpp | 43 +-
cloud/test/meta_service_job_test.cpp | 1378 +-
cloud/test/meta_service_operation_log_test.cpp | 1496 +-
cloud/test/meta_service_test.cpp | 1003 +-
cloud/test/meta_service_versioned_read_test.cpp | 31 +-
cloud/test/mock_accessor.h | 7 +
cloud/test/rate_limiter_test.cpp | 4 +
cloud/test/recycle_versioned_keys_test.cpp | 510 +-
cloud/test/recycler_operation_log_test.cpp | 561 +-
cloud/test/recycler_test.cpp | 1114 +-
cloud/test/resource_test.cpp | 450 +
cloud/test/rpc_kv_bvar_test.cpp | 33 +-
cloud/test/schema_kv_test.cpp | 100 +-
cloud/test/snapshot_data_size_calculator_test.cpp | 162 +
cloud/test/txn_kv_test.cpp | 168 +-
cloud/test/txn_lazy_commit_test.cpp | 437 +-
contrib/clucene | 2 +-
dist/NOTICE-dist.txt | 2 +-
.../scripts/create_preinstalled_scripts/run82.hql | 14 +
.../scripts/create_preinstalled_scripts/run84.hql | 20 +
.../scripts/create_preinstalled_scripts/run85.hql | 15 +
.../parquet_bloom_filter/create_table.hql | 39 +
.../multi_catalog/parquet_bloom_filter/data.tar.gz | Bin 0 -> 2735 bytes
.../parquet_bloom_filter/generate_data.script | 44 +
.../run.sh | 0
.../decimals_1_10/decimals_1_10.parquet | Bin 0 -> 3874 bytes
.../runtime_filter_dim_small/dim_small.parquet | Bin 0 -> 4230 bytes
.../runtime_filter_fact_big/fact_big.parquet | Bin 0 -> 129338 bytes
.../test_parquet_lazy_read_struct/example.parquet | Bin 0 -> 729024 bytes
.../create_preinstalled_scripts/iceberg/run22.sql | 13 +-
.../create_preinstalled_scripts/iceberg/run24.sql | 151 +
.../main/java/org/apache/doris/common/Config.java | 24 +-
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 2 +-
.../main/java/org/apache/doris/alter/Alter.java | 7 +-
.../org/apache/doris/alter/CloudRollupJobV2.java | 2 +-
.../apache/doris/alter/CloudSchemaChangeJobV2.java | 2 +-
.../apache/doris/alter/SchemaChangeHandler.java | 11 +
.../org/apache/doris/analysis/SearchPredicate.java | 24 +
.../doris/catalog/BuiltinScalarFunctions.java | 6 +
.../catalog/BuiltinTableGeneratingFunctions.java | 3 +-
.../apache/doris/catalog/CatalogRecycleBin.java | 341 +-
.../main/java/org/apache/doris/catalog/Env.java | 4 +-
.../java/org/apache/doris/catalog/OlapTable.java | 39 +
.../org/apache/doris/catalog/RefreshManager.java | 19 +-
.../java/org/apache/doris/catalog/SchemaTable.java | 5 +-
.../main/java/org/apache/doris/catalog/View.java | 7 +-
.../doris/clone/DynamicPartitionScheduler.java | 2 +-
.../apache/doris/cloud/catalog/CloudPartition.java | 21 +-
.../apache/doris/cloud/catalog/CloudTablet.java | 26 +-
.../cloud/datasource/CloudInternalCatalog.java | 37 +-
.../apache/doris/cloud/rpc/MetaServiceClient.java | 5 +
.../apache/doris/cloud/rpc/MetaServiceProxy.java | 39 +-
.../apache/doris/cloud/storage/AzureRemote.java | 57 +
.../apache/doris/cloud/storage/DefaultRemote.java | 156 +-
.../org/apache/doris/cloud/storage/MockRemote.java | 8 +
.../org/apache/doris/cloud/storage/RemoteBase.java | 11 +
.../transaction/CloudGlobalTransactionMgr.java | 32 +-
.../org/apache/doris/datasource/CatalogMgr.java | 4 +-
.../apache/doris/datasource/ExternalCatalog.java | 41 +-
.../apache/doris/datasource/ExternalObjectLog.java | 7 +-
.../org/apache/doris/datasource/ExternalTable.java | 21 +-
.../apache/doris/datasource/InternalCatalog.java | 26 +-
.../doris/datasource/hive/HMSExternalDatabase.java | 2 +-
.../doris/datasource/hive/HMSExternalTable.java | 18 +-
.../doris/datasource/hive/HiveMetadataOps.java | 4 +-
.../datasource/iceberg/IcebergExternalCatalog.java | 20 +-
.../datasource/iceberg/IcebergMetadataOps.java | 43 +-
.../doris/datasource/iceberg/IcebergUtils.java | 13 +-
.../datasource/operations/ExternalMetadataOps.java | 18 +-
.../apache/doris/datasource/paimon/PaimonUtil.java | 9 +-
.../property/metastore/HMSBaseProperties.java | 2 +
.../property/storage/HdfsProperties.java | 1 +
.../doris/datasource/test/TestExternalTable.java | 1 +
.../doris/httpv2/rest/StreamingJobAction.java | 3 +
.../apache/doris/indexpolicy/IndexPolicyMgr.java | 2 +-
.../org/apache/doris/job/common/FailureReason.java | 7 +-
.../insert/streaming/StreamingInsertJob.java | 26 +-
.../streaming/StreamingJobSchedulerTask.java | 1 -
.../insert/streaming/StreamingMultiTblTask.java | 51 +-
.../job/offset/jdbc/JdbcSourceOffsetProvider.java | 105 +-
.../apache/doris/job/util/StreamingJobUtils.java | 68 +-
.../doris/load/routineload/RoutineLoadJob.java | 5 +
.../doris/mysql/authenticate/ldap/LdapClient.java | 16 +-
.../mysql/authenticate/ldap/LdapUserInfo.java | 3 +-
.../org/apache/doris/mysql/privilege/Auth.java | 16 +-
.../glue/translator/PhysicalPlanTranslator.java | 19 +-
.../apache/doris/nereids/properties/FuncDeps.java | 51 +-
.../rules/SimplifyComparisonPredicate.java | 48 +-
.../nereids/rules/rewrite/EliminateGroupByKey.java | 43 +-
.../nereids/rules/rewrite/MergeAggregate.java | 1 +
.../rewrite/PushDownAggThroughJoinOnPkFk.java | 44 +-
.../nereids/rules/rewrite/PushDownProject.java | 168 +-
.../nereids/trees/expressions/LessThanEqual.java | 2 +-
.../executable/DateTimeExtractAndTransform.java | 33 +-
.../functions/generator/PosExplode.java | 56 +-
.../functions/generator/PosExplodeOuter.java | 55 +-
.../expressions/functions/scalar/DateFormat.java | 4 +-
.../functions/scalar/QuantileStateFromBase64.java | 71 +
.../functions/scalar/QuantileStateToBase64.java | 69 +
.../trees/expressions/functions/scalar/Search.java | 60 +-
.../functions/scalar/SearchDslParser.java | 761 +-
.../scalar/{DateFormat.java => TimeFormat.java} | 33 +-
.../trees/expressions/literal/TimeV2Literal.java | 4 +
.../expressions/visitor/ScalarFunctionVisitor.java | 15 +
.../AdminSetAutoClusterSnapshotCommand.java | 10 +-
...dminSetClusterSnapshotFeatureSwitchCommand.java | 3 +-
.../trees/plans/commands/ExecuteActionCommand.java | 6 +-
.../plans/commands/ShowRoutineLoadCommand.java | 1 +
.../plans/commands/insert/HiveInsertExecutor.java | 7 +-
.../plans/commands/refresh/RefreshLdapCommand.java | 10 +-
.../trees/plans/logical/LogicalFileScan.java | 6 +
.../trees/plans/logical/LogicalHudiScan.java | 8 +
.../doris/nereids/util/DateTimeFormatterUtils.java | 425 +
.../apache/doris/persist/TruncateTableInfo.java | 9 +-
.../org/apache/doris/persist/gson/GsonUtils.java | 4 +-
.../java/org/apache/doris/qe/SessionVariable.java | 17 +
.../org/apache/doris/qe/cache/CacheAnalyzer.java | 2 +-
.../apache/doris/service/FrontendServiceImpl.java | 1 +
.../apache/doris/statistics/AnalysisManager.java | 26 +-
.../doris/statistics/StatisticsAutoCollector.java | 9 +-
.../doris/statistics/util/StatisticsUtil.java | 40 +-
.../doris/alter/SchemaChangeHandlerTest.java | 41 +
.../doris/catalog/CatalogRecycleBinTest.java | 839 +
.../org/apache/doris/catalog/CreateViewTest.java | 24 +
.../org/apache/doris/catalog/OlapTableTest.java | 122 +
.../org/apache/doris/catalog/RefreshTableTest.java | 16 +-
.../doris/cloud/rpc/MetaServiceProxyTest.java | 127 +
.../property/storage/HdfsPropertiesTest.java | 6 +-
.../apache/doris/external/hms/HmsCatalogTest.java | 15 +-
.../doris/job/util/StreamingJobUtilsTest.java | 240 +
.../mysql/authenticate/ldap/LdapUserInfoTest.java | 14 +-
.../org/apache/doris/mysql/privilege/AuthTest.java | 25 +-
.../nereids/rules/expression/FoldConstantTest.java | 12 +-
.../rules/SimplifyComparisonPredicateTest.java | 36 +-
.../nereids/rules/rewrite/MergeAggregateTest.java | 124 +
.../nereids/rules/rewrite/PushDownProjectTest.java | 192 +
.../functions/generator/PosExplodeOuterTest.java | 73 +
.../functions/generator/PosExplodeTest.java | 73 +
.../functions/scalar/SearchDslParserTest.java | 348 +
.../org/apache/doris/qe/HmsQueryCacheTest.java | 12 +-
.../statistics/StatisticsAutoCollectorTest.java | 2 +-
.../cdcclient/controller/ClientController.java | 21 +
.../cdcclient/service/PipelineCoordinator.java | 72 +-
.../doris/cdcclient/sink/DorisBatchStreamLoad.java | 13 +
.../source/reader/JdbcIncrementalSourceReader.java | 10 +-
.../source/reader/mysql/MySqlSourceReader.java | 7 +-
.../reader/postgres/PostgresSourceReader.java | 8 +-
gensrc/proto/cloud.proto | 131 +-
gensrc/proto/olap_file.proto | 15 +
gensrc/proto/segment_v2.proto | 1 +
gensrc/thrift/Exprs.thrift | 14 +-
gensrc/thrift/FrontendService.thrift | 1 +
gensrc/thrift/PaloInternalService.thrift | 3 +
gensrc/thrift/parquet.thrift | 526 +-
.../packed_file/merge_file_stream_load.csv | 200 +
.../sql-functions/doc_date_functions_test.out | 107 +
.../hive/test_hive_page_index.out | 51888 +++++++++++++++++++
.../hive/test_parquet_bloom_filter.out | 123 +
.../hive/test_parquet_nested_types.out | 42 +
.../test_iceberg_struct_schema_evolution.out | 161 +
.../iceberg/test_iceberg_varbinary.out | 4 +
.../tvf/test_hdfs_parquet_group0.out | 38 +-
.../tvf/test_hdfs_parquet_group6.out | 20 +-
.../tvf/test_hdfs_tvf_float16.out | 19 +
.../paimon/test_paimon_hms_catalog.out | 12 +
.../test_index_lowercase_fault_injection.out | 2 +-
.../streaming_job/cdc/test_streaming_mysql_job.out | 2 +
.../cdc/test_streaming_mysql_job_all_type.out | 2 +-
.../{Map.out => nereids_scalar_fn_map.out} | 8 +
.../data/nereids_p0/join/test_outer_join.out | 5 +
.../sql_functions/table_function/posexplode.out | 159 +-
.../agg_join_pkfk/agg_join_pkfk.out | 36 +
.../limit_push_down/limit_push_down.out | 2 +-
.../add_project_for_unique_function.out | 17 +-
.../test_quantile_state_function.out | 37 +
regression-test/data/search/test_search_escape.out | 46 +
.../data/search/test_search_lucene_mode.out | 86 +
.../tpcds_sf100/noStatsRfPrune/query38.out | 81 +-
.../tpcds_sf100/noStatsRfPrune/query87.out | 81 +-
.../tpcds_sf100/no_stats_shape/query38.out | 81 +-
.../tpcds_sf100/no_stats_shape/query87.out | 81 +-
.../shape_check/tpcds_sf100/rf_prune/query38.out | 81 +-
.../shape_check/tpcds_sf100/rf_prune/query87.out | 81 +-
.../data/shape_check/tpcds_sf100/shape/query38.out | 81 +-
.../data/shape_check/tpcds_sf100/shape/query87.out | 81 +-
.../data/shape_check/tpcds_sf1000/hint/query38.out | 81 +-
.../data/shape_check/tpcds_sf1000/hint/query87.out | 81 +-
.../shape_check/tpcds_sf1000/shape/query38.out | 81 +-
.../shape_check/tpcds_sf1000/shape/query87.out | 81 +-
.../doris/regression/suite/SuiteCluster.groovy | 68 +-
.../nonConcurrent/conf/regression-conf.groovy | 5 +
.../suites/auth_p0/test_refresh_ldap_auth.groovy | 56 +
.../test_backup_restore_with_view.groovy | 153 +
.../test_packed_file_concurrent_load.groovy | 324 +
.../packed_file/test_packed_file_mixed_load.groovy | 558 +
.../test_packed_file_query_with_table_drop.groovy | 181 +
.../test_packed_file_with_group_commit.groovy | 160 +
.../suites/cloud_p0/recycler/check_meta.groovy | 37 +
.../suites/cloud_p0/recycler/test_recycler.groovy | 2 +
.../test_function_signature_all_types.groovy | 2 +-
.../sql-functions/doc_date_functions_test.groovy | 164 +-
.../hive/test_hive_page_index.groovy | 98 +
.../hive/test_parquet_bloom_filter.groovy | 60 +
.../hive/test_parquet_join_runtime_filter.groovy | 175 +
.../hive/test_parquet_nested_types.groovy | 10 +
.../iceberg/iceberg_branch_tag_operate.groovy | 13 +-
.../iceberg/iceberg_schema_change_ddl.groovy | 7 +
.../test_iceberg_struct_schema_evolution.groovy | 194 +
.../iceberg/test_iceberg_varbinary.groovy | 4 +
.../test_information_schema_timezone.groovy | 1 -
.../kerberos/test_single_hive_kerberos.groovy | 1 -
.../kerberos/test_two_hive_kerberos.groovy | 2 -
.../test_external_table_update_time.groovy | 61 +
.../tvf/test_hdfs_parquet_group6.groovy | 15 +
.../tvf/test_hdfs_tvf_float16.groovy | 46 +
.../paimon/test_paimon_hms_catalog.groovy | 11 +-
.../hive_on_hms_and_dlf.groovy | 10 +-
.../iceberg_on_hms_and_filesystem_and_dlf.groovy | 15 +-
...test_index_policy_unsupported_type_error.groovy | 43 +-
.../cdc/test_streaming_mysql_job.groovy | 19 +-
.../cdc/test_streaming_mysql_job_all_type.groovy | 2 +-
.../test_streaming_mysql_job_create_alter.groovy | 2 +-
.../cdc/test_streaming_mysql_job_dup.groovy | 2 +-
...vy => test_streaming_mysql_job_errormsg.groovy} | 56 +-
.../cdc/test_streaming_mysql_job_exclude.groovy | 2 +-
.../cdc/test_streaming_mysql_job_priv.groovy | 46 +-
.../cdc/test_streaming_mysql_job_restart_fe.groovy | 2 +-
.../cdc/test_streaming_postgres_job.groovy | 2 +-
.../test_streaming_postgres_job_all_type.groovy | 2 +-
.../cdc/test_streaming_postgres_job_dup.groovy | 2 +-
.../cdc/test_streaming_postgres_job_priv.groovy | 54 +-
.../broker_load/test_s3_load_with_where.groovy | 2 +-
.../test_routine_load_job_info_system_table.groovy | 5 +
.../routine_load/test_show_routine_load.groovy | 21 +
.../test_packed_file_stream_load_case1.groovy | 79 +
.../test_packed_file_stream_load_case2.groovy | 80 +
.../test_packed_file_stream_load_case3.groovy | 89 +
.../test_packed_file_stream_load_case4.groovy | 91 +
.../test_packed_file_stream_load_case5.groovy | 147 +
.../test_packed_file_stream_load_case6.groovy | 148 +
.../test_packed_file_stream_load_case7.groovy | 157 +
.../test_packed_file_stream_load_case8.groovy | 159 +
.../{Map.groovy => nereids_scalar_fn_map.groovy} | 21 +
.../suites/nereids_p0/join/test_outer_join.groovy | 29 +-
.../test_date_function_v2.groovy | 4 +-
.../sql_functions/table_function/posexplode.groovy | 49 +
.../agg_join_pkfk/agg_join_pkfk.groovy | 63 +
.../test_quantile_state_function.groovy | 82 +
.../query_profile/test_writer_profile.groovy | 194 +
.../test_search_default_field_operator.groovy | 48 +-
.../suites/search/test_search_escape.groovy | 189 +
.../test_search_inverted_is_null_pushdown.groovy | 74 +
.../suites/search/test_search_lucene_mode.groovy | 250 +
tools/fdb/fdb_ctl.sh | 3 +-
tools/tpcds-tools/ddl/create-tpcds-tables-sf1.sql | 1157 +-
.../tpcds-tools/ddl/create-tpcds-tables-sf100.sql | 1171 +-
.../tpcds-tools/ddl/create-tpcds-tables-sf1000.sql | 1682 +-
.../ddl/create-tpcds-tables-sf10000.sql | 1688 +-
687 files changed, 106157 insertions(+), 14420 deletions(-)
create mode 100644 be/src/io/fs/packed_file_manager.cpp
create mode 100644 be/src/io/fs/packed_file_manager.h
create mode 100644 be/src/io/fs/packed_file_reader.cpp
create mode 100644 be/src/io/fs/packed_file_reader.h
create mode 100644 be/src/io/fs/packed_file_system.cpp
create mode 100644 be/src/io/fs/packed_file_system.h
create mode 100644 be/src/io/fs/packed_file_trailer.cpp
copy be/src/{cloud/cloud_rowset_writer.h => io/fs/packed_file_trailer.h} (58%)
create mode 100644 be/src/io/fs/packed_file_writer.cpp
create mode 100644 be/src/io/fs/packed_file_writer.h
create mode 100644 be/src/olap/predicate_creator.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/all_query/all_query.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/boolean_query/boolean_query_builder.h
copy be/src/olap/rowset/segment_v2/inverted_index/query_v2/{operator.h =>
boolean_query/occur.h} (87%)
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/boolean_query/occur_boolean_query.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/boolean_query/occur_boolean_weight.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/boolean_query/occur_boolean_weight.h
copy be/src/olap/rowset/segment_v2/inverted_index/query_v2/{ =>
boolean_query}/operator.h (100%)
rename
be/src/olap/rowset/segment_v2/inverted_index/query_v2/boolean_query/{boolean_query.h
=> operator_boolean_query.h} (62%)
rename
be/src/olap/rowset/segment_v2/inverted_index/query_v2/boolean_query/{boolean_weight.h
=> operator_boolean_weight.h} (95%)
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/disjunction_scorer.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/disjunction_scorer.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/exclude_scorer.cpp
copy
be/src/olap/rowset/segment_v2/inverted_index/query_v2/{union/simple_union.h =>
exclude_scorer.h} (53%)
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/reqopt_scorer.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/size_hint.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/union/buffered_union.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/union/buffered_union.h
create mode 100644 be/src/tools/packed_file_tool.cpp
delete mode 100644 be/src/vec/exec/format/generic_reader.cpp
create mode 100644
be/src/vec/exec/format/parquet/parquet_block_split_bloom_filter.cpp
create mode 100644
be/src/vec/exec/format/parquet/parquet_block_split_bloom_filter.h
rename be/src/vec/exec/format/parquet/{parquet_pred_cmp.h =>
parquet_predicate.h} (79%)
create mode 100644 be/test/io/fs/packed_file_concurrency_test.cpp
create mode 100644 be/test/io/fs/packed_file_manager_test.cpp
create mode 100644 be/test/io/fs/packed_file_reader_test.cpp
create mode 100644 be/test/io/fs/packed_file_system_test.cpp
create mode 100644 be/test/io/fs/packed_file_writer_test.cpp
create mode 100644 be/test/io/packed_file_trailer_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/query_v2/boolean_query/boolean_query_builder_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/query_v2/buffered_union_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/query_v2/disjunction_scorer_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/query_v2/exclude_scorer_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/query_v2/occur_boolean_query_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/query_v2/reqopt_scorer_test.cpp
create mode 100644 be/test/vec/columns/pod_array_type_test.cpp
create mode 100644 be/test/vec/function/function_quantile_state_test.cpp
create mode 100644 cloud/cmake/install_fdb.cmake
copy cloud/src/{recycler => common}/sync_executor.h (100%)
create mode 100644 cloud/src/meta-store/clone_chain_reader.cpp
copy cloud/src/meta-store/{meta_reader.h => clone_chain_reader.h} (70%)
create mode 100644 cloud/src/recycler/snapshot_chain_compactor.cpp
create mode 100644 cloud/src/recycler/snapshot_chain_compactor.h
create mode 100644 cloud/src/recycler/snapshot_data_migrator.cpp
create mode 100644 cloud/src/recycler/snapshot_data_migrator.h
create mode 100644 cloud/src/recycler/snapshot_data_size_calculator.cpp
create mode 100644 cloud/test/blob_message_test.cpp
create mode 100644 cloud/test/clone_chain_reader_test.cpp
create mode 100644 cloud/test/snapshot_data_size_calculator_test.cpp
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/run82.hql
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/run84.hql
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/run85.hql
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/parquet_bloom_filter/create_table.hql
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/parquet_bloom_filter/data.tar.gz
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/parquet_bloom_filter/generate_data.script
copy
docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/{hive_text_complex_type
=> parquet_bloom_filter}/run.sh (100%)
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/parquet_table/decimals_1_10/decimals_1_10.parquet
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/parquet_table/runtime_filter_dim_small/dim_small.parquet
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/parquet_table/runtime_filter_fact_big/fact_big.parquet
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/parquet_table/test_parquet_lazy_read_struct/example.parquet
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/create_preinstalled_scripts/iceberg/run24.sql
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/QuantileStateFromBase64.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/QuantileStateToBase64.java
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{DateFormat.java
=> TimeFormat.java} (73%)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/catalog/CatalogRecycleBinTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/cloud/rpc/MetaServiceProxyTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/job/util/StreamingJobUtilsTest.java
rename be/src/olap/rowset/segment_v2/inverted_index/query_v2/operator.h =>
fe/fe-core/src/test/java/org/apache/doris/mysql/authenticate/ldap/LdapUserInfoTest.java
(73%)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/MergeAggregateTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/PushDownProjectTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/trees/expressions/functions/generator/PosExplodeOuterTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/trees/expressions/functions/generator/PosExplodeTest.java
create mode 100644
regression-test/data/cloud_p0/packed_file/merge_file_stream_load.csv
create mode 100644
regression-test/data/external_table_p0/hive/test_hive_page_index.out
create mode 100644
regression-test/data/external_table_p0/hive/test_parquet_bloom_filter.out
create mode 100644
regression-test/data/external_table_p0/iceberg/test_iceberg_struct_schema_evolution.out
create mode 100644
regression-test/data/external_table_p0/tvf/test_hdfs_tvf_float16.out
rename regression-test/data/nereids_function_p0/scalar_function/{Map.out =>
nereids_scalar_fn_map.out} (99%)
create mode 100644
regression-test/data/nereids_rules_p0/agg_join_pkfk/agg_join_pkfk.out
create mode 100644
regression-test/data/query_p0/sql_functions/quantile_state_functions/test_quantile_state_function.out
create mode 100644 regression-test/data/search/test_search_escape.out
create mode 100644 regression-test/data/search/test_search_lucene_mode.out
create mode 100644 regression-test/suites/auth_p0/test_refresh_ldap_auth.groovy
create mode 100644
regression-test/suites/cloud_p0/packed_file/test_packed_file_concurrent_load.groovy
create mode 100644
regression-test/suites/cloud_p0/packed_file/test_packed_file_mixed_load.groovy
create mode 100644
regression-test/suites/cloud_p0/packed_file/test_packed_file_query_with_table_drop.groovy
create mode 100644
regression-test/suites/cloud_p0/packed_file/test_packed_file_with_group_commit.groovy
create mode 100644
regression-test/suites/external_table_p0/hive/test_hive_page_index.groovy
create mode 100644
regression-test/suites/external_table_p0/hive/test_parquet_bloom_filter.groovy
create mode 100644
regression-test/suites/external_table_p0/hive/test_parquet_join_runtime_filter.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_struct_schema_evolution.groovy
create mode 100644
regression-test/suites/external_table_p0/test_external_table_update_time.groovy
create mode 100644
regression-test/suites/external_table_p0/tvf/test_hdfs_tvf_float16.groovy
copy be/src/cloud/cloud_rowset_writer.h =>
regression-test/suites/inverted_index_p0/test_index_policy_unsupported_type_error.groovy
(50%)
copy
regression-test/suites/job_p0/streaming_job/cdc/{test_streaming_mysql_job_dup.groovy
=> test_streaming_mysql_job_errormsg.groovy} (57%)
create mode 100644
regression-test/suites/load_p0/stream_load/test_packed_file_stream_load_case1.groovy
create mode 100644
regression-test/suites/load_p0/stream_load/test_packed_file_stream_load_case2.groovy
create mode 100644
regression-test/suites/load_p0/stream_load/test_packed_file_stream_load_case3.groovy
create mode 100644
regression-test/suites/load_p0/stream_load/test_packed_file_stream_load_case4.groovy
create mode 100644
regression-test/suites/load_p0/stream_load/test_packed_file_stream_load_case5.groovy
create mode 100644
regression-test/suites/load_p0/stream_load/test_packed_file_stream_load_case6.groovy
create mode 100644
regression-test/suites/load_p0/stream_load/test_packed_file_stream_load_case7.groovy
create mode 100644
regression-test/suites/load_p0/stream_load/test_packed_file_stream_load_case8.groovy
rename regression-test/suites/nereids_function_p0/scalar_function/{Map.groovy
=> nereids_scalar_fn_map.groovy} (97%)
create mode 100644
regression-test/suites/nereids_rules_p0/agg_join_pkfk/agg_join_pkfk.groovy
create mode 100644
regression-test/suites/query_p0/sql_functions/quantile_state_functions/test_quantile_state_function.groovy
create mode 100644
regression-test/suites/query_profile/test_writer_profile.groovy
create mode 100644 regression-test/suites/search/test_search_escape.groovy
create mode 100644
regression-test/suites/search/test_search_inverted_is_null_pushdown.groovy
create mode 100644 regression-test/suites/search/test_search_lucene_mode.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
