This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch auto-pick-60895-branch-4.0
in repository https://gitbox.apache.org/repos/asf/doris.git
omit 9aaed26c24e fix format
omit 42fc0ed3579 [opt](maxcompute) Optimize split generation for LIMIT
queries with partition equality predicates (#60895)
add 5c97bb56e1f branch-4.0: [bug](udf) udf should cache classloader in
static load #60709 (#60975)
add 832fec6b59a branch-4.0: [fix](insert-overwrite) skip deleted
partitions before replace to avoid DdlException #60914 (#60949)
add 04f5bad7e83 branch-4.0: [check](column)const is only allowed at the
top level. #60578 (#60959)
add 0875f9bcaf9 branch-4.0: [fix](priv) skip catalog priv check if using
customized access controller #60945 (#60962)
add 02110dc38a5 branch-4.0: [fix](jdbc) Fix PG array null detection and
SQL Server date format pushdown #60954 (#60972)
add add05a81297 branch-4.0: [fix](be) Default to the Default chain when S3
role_arn is set without provider_type #60822 (#60965)
add c6fb1f1ce6a branch-4.0: [Opt](warmup) Limit the download rate of
warmup task (#60180) (#60841)
add b528318a55a [branch-4.0] [fix](cloud) Fix SingleFlight deadlock in
CloudTabletMgr::get_tablet during warmup (#60968)
add 73fb086c878 branch-4.0: [test](nerieds)fix sql cache with mtmv test
case #58236 (#60956)
add 2e32f786476 branch-4.0: [fix](cloud) Fix auto-start functionality when
encountering TVF and external queries #59963 (#60802)
add 029ee014baf branch-4.0: [fix](parquet)fix parquet reader lazy
materialization cannot filter. #60474 (#60685)
add 6b1dc8d9c49 [fix](filecache) avoid string_view::data() in
file_cache_action (#60101) (#60549)
add e0690d046ef [refactor](cloud) improve FDB transaction approximate size
calculation accuracy (#60390)
add a205a3620de [fix](filecache) reset_range dose not update shadow queue
causing lar… (#60554)
add c2ef7a54be4 branch-4.0:[feature](maxcompute)support maxcompute
ram_role_arn and ecs_ram_role.(#60649) (#60905)
add 912ebd1ac92 branch-4.0: [fix](stream-load) Fix LZ4 compressed stream
load decompress made no progress error #60852 (#60980)
add 1d68ca85cb2 branch-4.0: [Bug](join) fix left_semi_direct_return_opt
get wrong result with local shuffle #60952 (#60984)
add acc85ec6eff branch-4.0: [fix](point-query) Fix point query ignoring
session timezone for functions like from_unixtime #60913 (#60991)
add 581c3c12900 branch-4.0:[fix](case)fix some external regression test.
(#60744) (#60992)
add 8f31cee1adb branch-4.0: [Feature](iceberg) Support schema change for
complex types in Iceberg external tables #60169 (#60993)
add 0461cae28d7 branch-4.0: [improve](cloud) reduce fe call get_version to
meta_service #60467 (#60948)
add 5196ac2bd1d branch-4.0: [refactor](search) Refactor SearchDslParser to
single-phase ANTLR parsing #60635 (#60998)
add 240b8fa67c5 branch-4.0: [fix](search) Make AND/OR/NOT operators
case-sensitive in search DSL #59747 (#61012)
add 962222e8426 branch-4.0: [Fix](Cloud)decouple min pipeline executor
size from ConnectContext #60958 (#61005)
add b358eafb4f3 branch-4.0: [fix](Azure)Fix Azure endpoint detection for
sovereign clouds with force-global config support #60903 (#61006)
add 5bb85e7830d [feature](bm25) support score range filter pushdown
(min_score semantics) (#60997)
add 03a6aa432c3 branch-4.0: [fix](test) add more log to debug #61009
(#61010)
add 966028cb37a branch-4.0: [Fix](TabletHotspot) Fix race in
`TabletHotspot::get_top_n_hot_partition` #60607 (#60625)
add 4db07d301dd branch-4.0: [fix](search) Backport search() function
improvements and bug fixes (#61028)
add 62f4fd95fef branch-4.0: [fix](test) fix unstable sql cache testing
because meta default is eventual consistency #60114 (#61032)
add 106314740cf branch-4.0: [refactor](scan) extract scanner profile
update logic and update on eos #60615 (#61039)
add 62ea8dc4801 branch-4.0: [fix](encrypt)encrypt key is not case
sensitive #60288 (#61033)
add d96662c0e85 branch-4.0: [fix](test) make hive compress split assertion
BE-aware #60947 (#61008)
add 399960b0ea3 branch-4.0: [fix](ut) fix MVStatisticsTest #61035 (#61052)
add 89ba95d6b48 branch-4.0: [fix](cache) invalidate sorted partition cache
after replacing temp partition in cloud mode #60888 (#61093)
add 1a8590e0b22 branch-4.0: [fix](protocol) Support CLIENT_DEPRECATE_EOF
to fix empty result with MySQL driver 9.5.0 #61050 (#61062)
add 8ba9514600b branch-4.0 [fix](lazy materialize) set uniqueId for lazy
materialized slots #61029 (#61068)
add 7b1338085a3 branch-4.0: [fix](inverted index) fix data race in
AnalysisFactoryMgr causing std::bad_function_call crash #61077 (#61098)
add fe7651db245 [fix](variant) fix variant column data_serdes not synced
(#60908) (#61096)
add d74dc1fb936 add 4.0.4-rc01 (#61051)
add e25019f461c branch-4.0: [fix](function)Fix array_apply being unable to
handle LARGEINT. #61081 (#61105)
add 7d51456d138 branch-4.0: [fix](fe) add column_data_sizes to
BackendPartitionedSchemaScanNode #61086 (#61106)
add 83fa87afc4d branch-4.0: [Improvement](scanner) Include open() time in
PerScannerRunningTime #61042 (#61101)
add 87965e9b9ad branch-4.0: [refactor](paimon) Per-catalog Paimon metadata
cache with two-level table+snapshot structure #60478 (#60741)
add fc486abcc26 branch-4.0: [feat](storage) introduce backpressure
algorithm to control version number (part II) (#60866)
add b5abc5f5e2b branch-4.0: [fix](job) fix routine load job incorrectly
cancelled on FE restart after swap table #61046 (#61128)
add 1610e6dac1f branch-4.0: [fix](cloud) add metrics for FE to MS rpc
(#60574) (#61136)
add 6690ded9e0e [branch-4.0][improvement](search) change default mode of
search function from standard to lucene (#61140)
add 9f7c8c2edf3 branch-4.0: [chore](config) Add `request_timeout` config
for aws client configuration #60906 (#61159)
add c6c7014daa9 [Cherry-Pick][branch-4.0] add recovery_journal_id to
truncate bdbje logs (#61132)
add d5aabe3530a branch-4.0: [fix](iceberg)fix iceberg rewrite_data_file
fail when table had been updated. #61112 (#61137)
add b38e48bc19f [fix](local shuffle) Fix local shuffle strategy (#61144)
add bb2f70b855d [branch-4.0][fix](inverted index) fix StringRef to
std::string reinterpret_cast overflow (#61150)
add ab21bc7e73f branch-4.0: [fix](paimon) Compat HMS kerberos props in
getHadoopProperties and cover Paimon HMS+OSS case (#61155)
add 014d96e9cf7 [opt](maxcompute) Optimize split generation for LIMIT
queries with partition equality predicates (#60895)
add 8cce526fd3a fix format
add 49d13de3dbf fix
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (9aaed26c24e)
\
N -- N -- N refs/heads/auto-pick-60895-branch-4.0 (49d13de3dbf)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/src/cloud/cloud_tablet.cpp | 4 +
be/src/cloud/cloud_tablet_hotspot.cpp | 1 +
be/src/cloud/cloud_tablet_hotspot.h | 2 +
be/src/cloud/config.cpp | 4 +
be/src/cloud/config.h | 4 +
be/src/common/config.cpp | 12 +-
be/src/common/config.h | 42 +-
be/src/http/action/file_cache_action.cpp | 27 +-
be/src/io/cache/block_file_cache.cpp | 25 +-
be/src/io/cache/cached_remote_file_reader.cpp | 11 +
be/src/io/cache/file_cache_common.h | 2 +
be/src/io/cache/fs_file_cache_storage.cpp | 23 +-
be/src/io/cache/fs_file_cache_storage.h | 4 +
be/src/io/cache/lru_queue_recorder.cpp | 13 +-
be/src/io/cache/lru_queue_recorder.h | 3 +-
be/src/io/fs/azure_obj_storage_client.cpp | 3 -
be/src/olap/collection_similarity.cpp | 96 +-
be/src/olap/collection_similarity.h | 22 +-
be/src/olap/delta_writer.cpp | 10 +-
be/src/olap/delta_writer.h | 4 +
be/src/olap/in_list_predicate.h | 84 +-
be/src/olap/rowset/rowset_meta.h | 7 +
be/src/olap/rowset/segment_v2/index_file_reader.h | 1 +
.../inverted_index/analysis_factory_mgr.cpp | 4 +-
.../inverted_index/query_v2/all_query/all_query.h | 49 +-
.../boolean_query/occur_boolean_weight.cpp | 7 +-
.../query_v2/regexp_query/regexp_weight.h | 4 +-
.../rowset/segment_v2/inverted_index_iterator.cpp | 2 +-
.../rowset/segment_v2/inverted_index_query_type.h | 4 +
.../olap/rowset/segment_v2/inverted_index_reader.h | 62 +-
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 31 +-
be/src/olap/tablet_schema.cpp | 14 +-
be/src/pipeline/exec/materialization_opertor.cpp | 9 +-
be/src/pipeline/exec/olap_scan_operator.cpp | 11 +
be/src/pipeline/pipeline_fragment_context.cpp | 20 +-
be/src/runtime/descriptors.cpp | 9 +
be/src/runtime/descriptors.h | 10 +-
be/src/runtime/exec_env.h | 3 +
be/src/runtime/exec_env_init.cpp | 48 +-
be/src/runtime/load_stream.cpp | 58 +-
be/src/runtime/load_stream.h | 6 +
be/src/runtime/runtime_state.h | 5 +
be/src/runtime_filter/runtime_filter_producer.cpp | 13 +-
be/src/runtime_filter/runtime_filter_producer.h | 18 +-
.../runtime_filter_producer_helper.cpp | 2 +-
be/src/runtime_filter/runtime_filter_wrapper.cpp | 3 +-
be/src/service/internal_service.cpp | 10 +
be/src/service/point_query_executor.cpp | 4 +
be/src/util/s3_util.cpp | 14 +-
be/src/util/s3_util.h | 1 +
be/src/vec/columns/column.cpp | 11 +
be/src/vec/columns/column.h | 5 +
be/src/vec/columns/column_array.cpp | 4 +-
be/src/vec/columns/column_map.cpp | 1 +
be/src/vec/columns/column_nullable.cpp | 4 +-
be/src/vec/columns/column_struct.cpp | 1 +
be/src/vec/columns/column_variant.cpp | 2 +
.../file_reader/new_plain_text_line_reader.cpp | 9 +-
.../exec/format/table/max_compute_jni_reader.cpp | 34 +-
be/src/vec/exec/scan/es_scanner.cpp | 4 +-
be/src/vec/exec/scan/es_scanner.h | 2 +-
be/src/vec/exec/scan/file_scanner.cpp | 18 +-
be/src/vec/exec/scan/file_scanner.h | 5 +-
be/src/vec/exec/scan/jdbc_scanner.cpp | 4 +-
be/src/vec/exec/scan/jdbc_scanner.h | 2 +-
be/src/vec/exec/scan/meta_scanner.cpp | 4 +-
be/src/vec/exec/scan/meta_scanner.h | 2 +-
be/src/vec/exec/scan/olap_scanner.cpp | 6 +-
be/src/vec/exec/scan/olap_scanner.h | 2 +-
be/src/vec/exec/scan/scanner.h | 12 +-
be/src/vec/exec/scan/scanner_scheduler.cpp | 34 +-
be/src/vec/exprs/score_runtime.h | 22 +
be/src/vec/exprs/vsearch.cpp | 14 +-
be/src/vec/exprs/vsearch.h | 5 +
.../vec/functions/array/function_array_apply.cpp | 99 +-
be/src/vec/functions/function_multi_match.cpp | 5 +-
be/src/vec/functions/function_search.cpp | 359 +++-
be/src/vec/functions/function_search.h | 22 +-
be/src/vec/sink/load_stream_stub.cpp | 45 +
be/src/vec/sink/load_stream_stub.h | 10 +
be/src/vec/sink/writer/vtablet_writer_v2.cpp | 22 +
be/src/vec/sink/writer/vtablet_writer_v2.h | 3 +
be/test/common/config_on_update_test.cpp | 147 ++
be/test/io/s3_client_factory_test.cpp | 243 ++-
be/test/olap/collection_similarity_test.cpp | 541 ++++++
.../inverted_index/analysis_factory_mgr_test.cpp | 44 +
.../occur_boolean_query_real_index_test.cpp | 9 +-
.../query_v2/occur_boolean_query_test.cpp | 18 +-
.../query_v2/regexp_wildcard_lowercase_test.cpp | 228 +++
.../search_function_query_cache_test.cpp | 207 +++
be/test/vec/columns/column_array_test.cpp | 73 +-
.../column_check_const_only_in_top_level_test.cpp | 311 ++++
be/test/vec/exprs/score_runtime_test.cpp | 259 +++
be/test/vec/function/function_search_test.cpp | 119 +-
bin/start_fe.sh | 12 +-
cloud/src/common/config.h | 2 -
cloud/src/meta-service/meta_service.h | 3 +-
cloud/src/meta-service/meta_service_partition.cpp | 141 +-
cloud/src/meta-service/meta_service_txn.cpp | 184 +-
cloud/src/meta-store/txn_kv.cpp | 72 +-
cloud/src/recycler/s3_accessor.cpp | 10 +-
cloud/test/meta_service_test.cpp | 37 +-
cloud/test/meta_service_versioned_read_test.cpp | 39 +
cloud/test/txn_lazy_commit_test.cpp | 38 +
docker/thirdparties/custom_settings.env | 1 +
.../create_preinstalled_scripts/iceberg/run27.sql | 40 +
.../kerberos/entrypoint-hive-master.sh | 4 +-
.../docker-compose/kerberos/hadoop-hive.env.tpl | 3 +-
.../docker-compose/kerberos/kerberos1_settings.env | 3 +-
.../docker-compose/kerberos/kerberos2_settings.env | 3 +-
.../kerberos/sql/create_paimon_hive_table.hql | 10 +-
.../postgresql/init/02-create-table.sql | 7 +-
.../docker-compose/postgresql/init/04-insert.sql | 5 +
.../sqlserver/init/03-create-table.sql | 7 +
.../docker-compose/sqlserver/init/04-insert.sql | 9 +
.../apache/doris/common/jni/utils/ExpiringMap.java | 19 +-
.../doris/common/jni/utils/UdfClassCache.java | 24 +-
.../java/org/apache/doris/udf/BaseExecutor.java | 27 +-
.../java/org/apache/doris/udf/UdafExecutor.java | 7 +-
.../java/org/apache/doris/udf/UdfExecutor.java | 10 +-
.../doris/maxcompute/MaxComputeJniScanner.java | 10 +-
fe/fe-common/pom.xml | 14 +
.../main/java/org/apache/doris/common/Config.java | 48 +-
.../doris/common/maxcompute}/MCProperties.java | 19 +-
.../apache/doris/common/maxcompute/MCUtils.java | 78 +
.../org/apache/doris/nereids/search/SearchLexer.g4 | 6 +-
.../apache/doris/nereids/search/SearchParser.g4 | 15 +-
.../src/main/java/org/apache/doris/DorisFE.java | 12 +
.../org/apache/doris/analysis/EncryptKeyName.java | 13 -
.../org/apache/doris/analysis/SearchPredicate.java | 31 +
.../java/org/apache/doris/catalog/ColumnType.java | 65 +-
.../main/java/org/apache/doris/catalog/Env.java | 14 +
.../java/org/apache/doris/catalog/OlapTable.java | 76 +-
.../doris/clone/DynamicPartitionScheduler.java | 2 +-
.../org/apache/doris/cloud/catalog/CloudEnv.java | 11 +-
.../cloud/catalog/CloudFEVersionSynchronizer.java | 220 +++
.../apache/doris/cloud/catalog/CloudPartition.java | 52 +-
.../cloud/catalog/CloudSyncVersionDaemon.java | 203 +++
.../cloud/datasource/CloudInternalCatalog.java | 52 +-
.../apache/doris/cloud/rpc/MetaServiceProxy.java | 203 ++-
.../doris/cloud/system/CloudSystemInfoService.java | 224 ++-
.../transaction/CloudGlobalTransactionMgr.java | 122 +-
.../java/org/apache/doris/common/ClientPool.java | 3 +
.../java/org/apache/doris/common/FeConstants.java | 1 +
.../cache/NereidsSortedPartitionsCacheManager.java | 5 +
.../doris/common/proc/PartitionsProcDir.java | 74 +-
.../doris/common/profile/SummaryProfile.java | 9 +
.../org/apache/doris/common/util/PrintableMap.java | 2 +-
.../apache/doris/datasource/CatalogProperty.java | 23 +
.../CatalogScopedCacheMgr.java} | 34 +-
.../apache/doris/datasource/ExternalCatalog.java | 1 -
.../doris/datasource/ExternalMetaCacheMgr.java | 133 +-
.../apache/doris/datasource/ExternalScanNode.java | 12 +-
.../doris/datasource/ExternalSchemaCache.java | 13 +-
.../apache/doris/datasource/FileQueryScanNode.java | 13 +-
.../org/apache/doris/datasource/FileScanNode.java | 12 +-
.../apache/doris/datasource/InternalCatalog.java | 13 +-
.../doris/source/RemoteDorisScanNode.java | 6 +-
.../doris/datasource/es/source/EsScanNode.java | 5 +-
.../doris/datasource/hive/source/HiveScanNode.java | 13 +-
.../doris/datasource/hudi/source/HudiScanNode.java | 6 +-
.../datasource/iceberg/IcebergExternalCatalog.java | 70 +-
.../datasource/iceberg/IcebergMetadataCache.java | 135 +-
.../datasource/iceberg/IcebergMetadataOps.java | 216 ++-
.../datasource/iceberg/IcebergTransaction.java | 6 +
.../doris/datasource/iceberg/IcebergUtils.java | 14 +-
.../iceberg/cache/ContentFileEstimator.java | 194 ---
.../iceberg/cache/IcebergManifestCache.java | 27 +-
.../iceberg/cache/ManifestCacheValue.java | 20 +-
.../iceberg/rewrite/RewriteGroupTask.java | 3 +-
.../datasource/iceberg/source/IcebergScanNode.java | 13 +-
.../jdbc/client/JdbcPostgreSQLClient.java | 6 +-
.../doris/datasource/jdbc/source/JdbcScanNode.java | 35 +-
.../lakesoul/source/LakeSoulScanNode.java | 7 +-
.../maxcompute/MaxComputeExternalCatalog.java | 33 +-
.../maxcompute/MaxComputeExternalTable.java | 8 +-
.../maxcompute/source/MaxComputeScanNode.java | 15 +-
.../doris/datasource/metacache/CacheSpec.java | 152 ++
.../doris/datasource/odbc/source/OdbcScanNode.java | 11 +-
.../datasource/paimon/PaimonExternalCatalog.java | 23 +
.../datasource/paimon/PaimonExternalTable.java | 52 +-
.../datasource/paimon/PaimonMetadataCache.java | 152 +-
.../datasource/paimon/PaimonMetadataCacheMgr.java | 51 -
.../datasource/paimon/PaimonSnapshotCacheKey.java | 60 -
.../datasource/paimon/PaimonTableCacheValue.java | 61 +
.../doris/datasource/paimon/PaimonUtils.java | 64 +
.../datasource/paimon/source/PaimonScanNode.java | 15 +-
.../metastore/AbstractIcebergProperties.java | 20 +
.../property/storage/AzureProperties.java | 39 +-
.../property/storage/AzurePropertyUtils.java | 63 +-
.../source/TrinoConnectorScanNode.java | 7 +-
.../datasource/tvf/source/MetadataScanNode.java | 6 +-
.../doris/datasource/tvf/source/TVFScanNode.java | 8 +-
.../doris/insertoverwrite/InsertOverwriteUtil.java | 13 +-
.../apache/doris/journal/bdbje/BDBEnvironment.java | 92 +
.../apache/doris/journal/bdbje/BDBJEJournal.java | 75 +
.../doris/load/routineload/RoutineLoadJob.java | 13 +
.../java/org/apache/doris/metric/CloudMetrics.java | 49 +
.../org/apache/doris/metric/MetricCalculator.java | 35 +
.../java/org/apache/doris/metric/MetricRepo.java | 10 +
.../org/apache/doris/mysql/MysqlCapability.java | 7 +-
.../java/org/apache/doris/mysql/MysqlOkPacket.java | 9 +-
.../doris/mysql/MysqlResultSetEndPacket.java | 61 +
.../mysql/privilege/AccessControllerManager.java | 28 +-
.../org/apache/doris/nereids/cost/CostModel.java | 3 +-
.../doris/nereids/errors/QueryPlanningErrors.java | 8 +-
.../glue/translator/ExpressionTranslator.java | 22 +-
.../glue/translator/PhysicalPlanTranslator.java | 48 +-
.../glue/translator/PlanTranslatorContext.java | 21 +
.../doris/nereids/jobs/rewrite/RewriteJob.java | 14 +-
.../nereids/jobs/scheduler/SimpleJobScheduler.java | 14 +-
.../nereids/load/NereidsLoadingTaskPlanner.java | 6 +-
.../nereids/load/NereidsStreamLoadPlanner.java | 6 +-
.../properties/ChildrenPropertiesRegulator.java | 7 +-
.../LogicalOlapScanToPhysicalOlapScan.java | 1 +
.../rewrite/PushDownScoreTopNIntoOlapScan.java | 176 +-
.../rewrite/PushDownVectorTopNIntoOlapScan.java | 2 +-
.../doris/nereids/rules/rewrite/SaltJoin.java | 4 +-
.../trees/expressions/ComparisonPredicate.java | 18 +
.../functions/scalar/EncryptKeyRef.java | 2 +-
.../trees/expressions/functions/scalar/Search.java | 2 +-
.../functions/scalar/SearchDslParser.java | 1757 ++++++++++++--------
.../doris/nereids/trees/plans/ScoreRangeInfo.java | 79 +
.../plans/commands/info/CreateRoutineLoadInfo.java | 4 +
.../trees/plans/logical/LogicalOlapScan.java | 75 +-
.../plans/physical/PhysicalLazyMaterialize.java | 57 +-
.../physical/PhysicalLazyMaterializeOlapScan.java | 1 +
.../trees/plans/physical/PhysicalOlapScan.java | 34 +-
.../planner/BackendPartitionedSchemaScanNode.java | 7 +-
.../java/org/apache/doris/planner/CTEScanNode.java | 4 +-
.../org/apache/doris/planner/DataGenScanNode.java | 10 +-
.../org/apache/doris/planner/FileLoadScanNode.java | 4 +-
.../apache/doris/planner/GroupCommitScanNode.java | 5 +-
.../apache/doris/planner/MaterializationNode.java | 54 +-
.../org/apache/doris/planner/OlapScanNode.java | 18 +-
.../org/apache/doris/planner/PlanFragment.java | 6 +-
.../java/org/apache/doris/planner/ScanContext.java | 58 +
.../java/org/apache/doris/planner/ScanNode.java | 27 +-
.../org/apache/doris/planner/SchemaScanNode.java | 5 +-
.../java/org/apache/doris/qe/ConnectProcessor.java | 19 +-
.../java/org/apache/doris/qe/FEOpExecutor.java | 4 +
.../org/apache/doris/qe/PointQueryExecutor.java | 6 +
.../java/org/apache/doris/qe/SessionVariable.java | 44 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 53 +-
.../apache/doris/service/FrontendServiceImpl.java | 12 +
.../org/apache/doris/system/SystemInfoService.java | 4 +-
.../tablefunction/DataGenTableValuedFunction.java | 4 +-
.../ExternalFileTableValuedFunction.java | 5 +-
.../GroupCommitTableValuedFunction.java | 4 +-
.../tablefunction/JdbcQueryTableValueFunction.java | 4 +-
.../tablefunction/MetadataTableValuedFunction.java | 4 +-
.../apache/doris/analysis/SearchPredicateTest.java | 136 ++
.../java/org/apache/doris/catalog/ColumnTest.java | 9 +-
.../org/apache/doris/catalog/OlapTableTest.java | 132 ++
.../doris/cloud/rpc/MetaServiceProxyTest.java | 4 +-
.../cloud/system/CloudSystemInfoServiceTest.java | 30 +-
.../doris/datasource/FileQueryScanNodeTest.java | 5 +-
.../datasource/hive/source/HiveScanNodeTest.java | 5 +-
.../iceberg/IcebergMetadataOpsValidationTest.java | 180 ++
.../iceberg/source/IcebergScanNodeTest.java | 3 +-
.../datasource/jdbc/source/JdbcScanNodeTest.java | 133 ++
.../maxcompute/source/MaxComputeScanNodeTest.java | 3 +-
.../paimon/source/PaimonScanNodeTest.java | 6 +-
.../property/storage/AzurePropertiesTest.java | 78 +
.../property/storage/AzurePropertyUtilsTest.java | 46 +-
.../tvf/source/MetadataScanNodeTest.java | 7 +-
.../datasource/tvf/source/TVFScanNodeTest.java | 3 +-
.../doris/journal/bdbje/BDBEnvironmentTest.java | 88 +-
.../doris/journal/bdbje/BDBJEJournalTest.java | 87 +
.../apache/doris/mysql/MysqlCapabilityTest.java | 3 +-
.../org/apache/doris/mysql/MysqlOkPacketTest.java | 23 +-
.../doris/mysql/MysqlResultSetEndPacketTest.java | 120 ++
.../privilege/AccessControllerManagerTest.java | 174 ++
.../translator/PhysicalPlanTranslatorTest.java | 2 +-
.../postprocess/MergeProjectPostProcessTest.java | 2 +-
.../PushDownFilterThroughProjectTest.java | 4 +-
.../functions/scalar/SearchDslParserTest.java | 1474 ++++++++++++++--
.../expressions/functions/scalar/SearchTest.java | 6 +-
.../doris/nereids/trees/plans/PlanEqualsTest.java | 6 +-
.../org/apache/doris/qe/HmsQueryCacheTest.java | 3 +-
.../org/apache/doris/qe/OlapQueryCacheTest.java | 5 +-
.../apache/doris/statistics/MVStatisticsTest.java | 2 +
.../apache/doris/system/SystemInfoServiceTest.java | 12 +-
gensrc/proto/cloud.proto | 5 +-
gensrc/proto/internal_service.proto | 4 +
gensrc/script/gen_build_version.sh | 4 +-
gensrc/thrift/Descriptors.thrift | 5 +-
gensrc/thrift/Exprs.thrift | 3 +
gensrc/thrift/FrontendService.thrift | 17 +
gensrc/thrift/PlanNodes.thrift | 7 +
.../data/doc/sql-manual/ArrayNullsafe.out | 175 ++
.../action/test_iceberg_rewrite_data_files.out | 18 +
.../iceberg/iceberg_schema_change_ddl.out | 28 +-
.../jdbc/test_pg_jdbc_catalog.out | 33 +-
.../jdbc/test_sqlserver_jdbc_catalog.out | 26 +-
.../paimon/test_paimon_hms_catalog.out | 14 +
.../test_bm25_score_range_filter.out | 33 +
.../point_query_p0/test_point_query_timezone.out | 15 +
.../join/test_cte_exists/test_cte_exists.out | 44 +
.../encryption_digest/key_case_sensitive.out | 7 +
.../data/search/test_search_dsl_operators.out | 45 +
regression-test/data/search/test_search_escape.out | 9 -
.../data/search/test_search_lucene_mode.out | 4 +
.../search/test_search_multi_analyzer_lucene.out | 55 +
.../data/search/test_search_multi_field.out | 16 +-
.../data/search/test_search_regexp_lowercase.out | 39 +
.../test_search_variant_dual_index_reader.out | 23 +
.../test_search_variant_subcolumn_analyzer.out | 30 +
.../data/search/test_search_variant_wildcard.out | 42 +
...est_search_variant_wildcard_custom_analyzer.out | 45 +
.../variant_p0/mv/variant_mv_rowstore_crash.out | 11 +
.../org/apache/doris/regression/suite/Suite.groovy | 35 +-
.../cloud_p0/multi_cluster/test_auto_start.groovy | 53 +
.../suites/doc/sql-manual/ArrayNullsafe.groovy | 38 +-
.../hive/test_hive_compress_type.groovy | 33 +-
.../hive/test_hive_topn_lazy_mat.groovy | 6 +-
.../hive/test_orc_lazy_mat_profile.groovy | 310 ++++
.../hive/test_parquet_lazy_mat_profile.groovy | 604 +++++++
.../hive/write/test_hive_ctas_to_doris.groovy | 2 +
.../action/test_iceberg_rewrite_data_files.groovy | 63 +
.../iceberg/iceberg_schema_change_ddl.groovy | 3 +-
.../iceberg/test_iceberg_manifest_cache.groovy | 5 +-
...test_iceberg_schema_change_complex_types.groovy | 232 +++
.../iceberg/test_iceberg_table_cache.groovy | 2 +-
.../iceberg/test_iceberg_table_meta_cache.groovy | 18 +-
.../jdbc/test_pg_jdbc_catalog.groovy | 10 +-
.../jdbc/test_sqlserver_jdbc_catalog.groovy | 24 +
.../paimon/test_paimon_table_meta_cache.groovy | 128 ++
.../tvf/test_tvf_topn_lazy_mat.groovy | 4 +-
.../hive/test_hive_translation_insert_only.groovy | 7 +-
.../hive/test_orc_merge_io_input_streams.groovy | 17 +-
.../hive/test_parquet_complex_cross_page.groovy | 9 +-
.../paimon/test_paimon_hms_catalog.groovy | 1 +
.../test_load_back_pressure_version.groovy | 23 +-
.../inverted_index_p0/test_bm25_score.groovy | 6 +-
.../test_bm25_score_range_filter.groovy | 159 ++
.../test_complex_or_null_semantics.groovy | 31 +-
.../test_cross_field_or_with_null.groovy | 25 +-
.../test_search_or_null_semantics.groovy | 25 +-
.../test_routine_load_swap_table_restart.groovy | 104 ++
.../test_json_lz4_decompress_progress.groovy | 84 +
.../nereids_p0/cache/mtmv_with_sql_cache.groovy | 41 +-
.../nereids_p0/cache/mv_with_sql_cache.groovy | 10 +
.../cache/parse_sql_from_sql_cache.groovy | 41 +
.../cache/prepare_stmt_with_sql_cache.groovy | 3 +
.../union_all_compensate.groovy | 9 +
.../union_rewrite_grace_big.groovy | 14 +
.../test_point_query_timezone.groovy | 71 +
.../cache/clear_sorted_partition_cache.groovy | 55 +
.../suites/query_p0/cache/sql_cache.groovy | 2 +
.../join/test_cte_exists/test_cte_exists.groovy | 78 +
.../encryption_digest/key_case_sensitive.groovy | 26 +-
.../search/test_search_boundary_cases.groovy | 49 +-
.../suites/search/test_search_cache.groovy | 138 ++
.../test_search_default_field_operator.groovy | 5 +-
.../suites/search/test_search_dsl_operators.groovy | 235 +++
.../suites/search/test_search_dsl_syntax.groovy | 2 +-
.../suites/search/test_search_escape.groovy | 45 +-
.../suites/search/test_search_exact_basic.groovy | 5 +-
.../search/test_search_exact_lowercase.groovy | 5 +-
.../suites/search/test_search_exact_match.groovy | 5 +-
.../search/test_search_exact_multi_index.groovy | 19 +-
.../search/test_search_field_group_query.groovy | 205 +++
.../suites/search/test_search_function.groovy | 2 +-
...n.groovy => test_search_function.groovy.backup} | 162 +-
.../search/test_search_inverted_index.groovy | 2 +-
.../suites/search/test_search_lucene_mode.groovy | 14 +-
.../suites/search/test_search_mow_support.groovy | 2 +-
.../test_search_multi_analyzer_lucene.groovy | 218 +++
.../suites/search/test_search_multi_field.groovy | 75 +-
.../search/test_search_null_regression.groovy | 43 +-
.../search/test_search_null_semantics.groovy | 63 +-
.../search/test_search_regexp_lowercase.groovy | 156 ++
.../search/test_search_usage_restrictions.groovy | 2 +-
.../test_search_variant_dual_index_reader.groovy | 133 ++
.../test_search_variant_subcolumn_analyzer.groovy | 175 ++
.../search/test_search_variant_wildcard.groovy | 165 ++
..._search_variant_wildcard_custom_analyzer.groovy | 190 +++
.../search/test_search_vs_match_consistency.groovy | 67 +-
.../variant_p0/mv/variant_mv_rowstore_crash.groovy | 93 ++
380 files changed, 16224 insertions(+), 3091 deletions(-)
create mode 100644 be/test/common/config_on_update_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/query_v2/regexp_wildcard_lowercase_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/search_function_query_cache_test.cpp
create mode 100644
be/test/vec/columns/column_check_const_only_in_top_level_test.cpp
create mode 100644 be/test/vec/exprs/score_runtime_test.cpp
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/create_preinstalled_scripts/iceberg/run27.sql
rename
fe/{fe-core/src/main/java/org/apache/doris/datasource/property/constants =>
fe-common/src/main/java/org/apache/doris/common/maxcompute}/MCProperties.java
(90%)
create mode 100644
fe/fe-common/src/main/java/org/apache/doris/common/maxcompute/MCUtils.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/cloud/catalog/CloudFEVersionSynchronizer.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/cloud/catalog/CloudSyncVersionDaemon.java
copy
fe/fe-core/src/main/java/org/apache/doris/{tablefunction/DataGenTableValuedFunction.java
=> datasource/CatalogScopedCacheMgr.java} (51%)
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/iceberg/cache/ContentFileEstimator.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/metacache/CacheSpec.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonMetadataCacheMgr.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonSnapshotCacheKey.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonTableCacheValue.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonUtils.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/mysql/MysqlResultSetEndPacket.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/ScoreRangeInfo.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/planner/ScanContext.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/iceberg/IcebergMetadataOpsValidationTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/mysql/MysqlResultSetEndPacketTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/mysql/privilege/AccessControllerManagerTest.java
create mode 100644
regression-test/data/inverted_index_p0/test_bm25_score_range_filter.out
create mode 100644
regression-test/data/point_query_p0/test_point_query_timezone.out
create mode 100644
regression-test/data/query_p0/join/test_cte_exists/test_cte_exists.out
create mode 100644
regression-test/data/query_p0/sql_functions/encryption_digest/key_case_sensitive.out
create mode 100644 regression-test/data/search/test_search_dsl_operators.out
create mode 100644
regression-test/data/search/test_search_multi_analyzer_lucene.out
create mode 100644 regression-test/data/search/test_search_regexp_lowercase.out
create mode 100644
regression-test/data/search/test_search_variant_dual_index_reader.out
create mode 100644
regression-test/data/search/test_search_variant_subcolumn_analyzer.out
create mode 100644 regression-test/data/search/test_search_variant_wildcard.out
create mode 100644
regression-test/data/search/test_search_variant_wildcard_custom_analyzer.out
create mode 100644
regression-test/data/variant_p0/mv/variant_mv_rowstore_crash.out
create mode 100644
regression-test/suites/external_table_p0/hive/test_orc_lazy_mat_profile.groovy
create mode 100644
regression-test/suites/external_table_p0/hive/test_parquet_lazy_mat_profile.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_schema_change_complex_types.groovy
create mode 100644
regression-test/suites/external_table_p0/paimon/test_paimon_table_meta_cache.groovy
create mode 100644
regression-test/suites/inverted_index_p0/test_bm25_score_range_filter.groovy
create mode 100644
regression-test/suites/load_p0/routine_load/test_routine_load_swap_table_restart.groovy
create mode 100644
regression-test/suites/load_p0/stream_load/test_json_lz4_decompress_progress.groovy
create mode 100644
regression-test/suites/point_query_p0/test_point_query_timezone.groovy
create mode 100644
regression-test/suites/query_p0/cache/clear_sorted_partition_cache.groovy
create mode 100644
regression-test/suites/query_p0/join/test_cte_exists/test_cte_exists.groovy
copy
fe/fe-core/src/main/java/org/apache/doris/tablefunction/DataGenTableValuedFunction.java
=>
regression-test/suites/query_p0/sql_functions/encryption_digest/key_case_sensitive.groovy
(50%)
create mode 100644 regression-test/suites/search/test_search_cache.groovy
create mode 100644
regression-test/suites/search/test_search_dsl_operators.groovy
create mode 100644
regression-test/suites/search/test_search_field_group_query.groovy
copy regression-test/suites/search/{test_search_function.groovy =>
test_search_function.groovy.backup} (52%)
create mode 100644
regression-test/suites/search/test_search_multi_analyzer_lucene.groovy
create mode 100644
regression-test/suites/search/test_search_regexp_lowercase.groovy
create mode 100644
regression-test/suites/search/test_search_variant_dual_index_reader.groovy
create mode 100644
regression-test/suites/search/test_search_variant_subcolumn_analyzer.groovy
create mode 100644
regression-test/suites/search/test_search_variant_wildcard.groovy
create mode 100644
regression-test/suites/search/test_search_variant_wildcard_custom_analyzer.groovy
create mode 100644
regression-test/suites/variant_p0/mv/variant_mv_rowstore_crash.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
