This is an automated email from the ASF dual-hosted git repository.
freemandealer pushed a change to branch auto-pick-60533-branch-4.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from b2a51b462b4 [fix](filecache) avoid SIGSEGV in background LRU update
when clear cache (#60533)
add 317dee36c05 branch-4.0: [fix](decimalv2) fix wrong result of
abs(decimalv2) #61397 (#61411)
add adb54b94393 [Enhancement](file-cache) Add fine-grained control for
compaction file cache (#61354)
add cf95c944142 branch-4.0: [fix](test) Fix BDB JE resource leak in
BDBEnvironmentTest causing FE UT timeout #61404 (#61412)
add a9a269d02cb branch-4.0: [fix](chore) fix no space issue when building
thirdparties (#61415)
add cc6adeeb05b branch-4.0: [refactor](oss) unify FE OSS filesystem with
Jindo #61269 (#61416)
add ba72fd745c6 branch-4.0: [fix](cloud) fix segment footer CORRUPTION not
triggering file cache retry #61386 (#61425)
add 8ecf32c0a05 branch-4.0: [feat](cloud) Add lock wait and bthread
schedule delay metrics to SyncRowset profile #61036 (#61449)
add b40d4bcf7be branch-4.0: [Fix](p0) Fixed the issue that
testFoldConstant was interfered by enable_sql_cache and could not be tested
correctly. #61328 (#61461)
add dae9a073670 branch-4.0: [Fix](warmup) Fix wrong rowset data size when
calculating timeout of waiting delay compaction #61188 (#61459)
add 8b7ec6efef9 branch-4.0: [fix](streamingjob) fix streaming insert job
not refreshing TVF props after ALTER SQL #61451 (#61488)
add d1a904db227 branch-4.0: [feature](score) support BM25 scoring in
inverted index query_v2 #59847 (#61470)
add eeccca03ee1 [branch-4.0][chore](cloud) Enable txn lazy commit by
default (pick #58732 #61506) (#61507)
add 807e34061f8 branch-4.0: [fix] Preserve CurrentConnected in frontends()
TVF #61087 (#61532)
add 1f94ec5395b [fix](set) fix coredump of set op if total data size
exceeds 4G (#61471) (#61557)
add d40004bc74d branch-4.0: [fix](typeCoercion) remove
checkLegalityBeforeTypeCoercion in sum and avg #59602 (#61560)
add c07fde7341f branch-4.0: [fix](cloud) reject ADMIN SET REPLICA VERSION
in cloud #60875 (#61586)
add 2a5b1a2f33e branch-4.0: [fix](orc)fix coredump because rewriteLeaves
function heap-use-after-free. #61138 (#61589)
add 433fe653e8b branch-4.0: [Bug](function) add ndv decimalv2 support
#61546 (#61577)
add 9e0d2170df8 branch-4.0: [fix](cloud) Fix case
`test_database_management_auth` #61594 (#61597)
add 8d494d1fecd branch-4.0: [fix](test) fix some routine load case
unstable #61432 (#61609)
add 5b94bd1ab7f branch-4.0: [fix](backup) reject upload snapshots on
broken storage path #61251 (#61435)
add 5d14e6fb605 branch-4.0: [fix](search) Fix slash character in search
query_string terms #61599 (#61618)
add d211e012513 branch-4.0: [opt](cloud) Enable compaction on new tablets
during schema change queuing #61089 (#61628)
add 38ae4a971f1 branch-4.0: [fix](fe) Fix bugs in SummaryProfile and
StmtExecutor metric reporting #61601 (#61643)
add 3e5dbd99726 branch-4.0: [fix](mtmv) Fix query err when calc mv
functional dependency which has variant and log more detailed info for
troubleshoot a problem #59933 (#61659)
add 9ec0ca8972d branch-4.0: [fix](ms) Add job check for stale commit
rowset #61427 (#61658)
add 04ff5069bf7 [fix](filecache) fix benchmark varification problem
(#58845) (#61195)
add de3c9203bd5 branch-4.0: [fix](password) password lock failed after
invalid login #61592 (#61655)
add c2a1c7f6f9a branch-4.0: [fix](constraint) avoid throw exception for
upgrade compatibility (#61664)
add 52609b92a75 branch-4.0: [chore](topn) check column type before merging
lazy materialization columns #61633 (#61667)
add 0145cea61c7 branch-4.0: [Enhancement](recyclebin) Optimize lock
granularity in CatalogRecycleBin #61366 (#61674)
add 600e0504807 branch-4.0: [Opt](freshness tolerance) Continue to capture
rowsets when the rowset is not in `_rowset_warm_up_states` (#61238) (#61680)
add 474cdf2452c [Bug](profile) fix wrong count of scan wait worker timer
(#61064) (#61691)
add 4b78331a543 [pick](branch-4.0)[fix](inverted index) Make
select_best_reader deterministic for multi-index columns #61596 (#61692)
add 3fb4a9f7b9c branch-4.0: [fix](load) Use atomic operations for
_try_close flag and remove unused _close_wait #61593 (#61623)
add dd00beedc49 branch-4.0: [fix](test) fix wrong error msg (#61091)
add ad00db35e4a branch-4.0: [opt](nereids) rewrite PreferPushDownProject
to slots before filter-join pushdown #61635 (#61714)
add 8b1298a6054 branch-4.0: [fix](fe) Fix MATCH crash on alias slots and
push down as virtual column #61584 (#61755)
add 02d0298d2ad branch-4.0: [feature](fe) Support ORDER BY and LIMIT
clauses for UPDATE and DELETE commands #61681 (#61751)
add 840ce2d4f59 branch-4.0: [fix](query-cache) include variant subcolumn
path in query cache digest #61709 (#61718)
add 86fe39319c7 branch-4.0: [fix](coordinator) Fix NPE in
updateLoadCounters during reportExecStatus for non-Load queries #61467 (#61734)
add 3fa6c7403b4 branch-4.0: [fix](test) correct warehouse assignment in
iceberg regression case #61720 (#61723)
add bcaa6459ecb branch-4.0: [improve](partition) Increase partition limit
defaults to 20000 and add near-limit metrics #61511 (#61764)
add 96a83c7b53e [fix](filecache) fix out-of-range exception when external
query (#58082) (#61193)
add 74f36dc8617 [improvement](topn) check multiget result rows against
request row id count and add be UT (#61758) (#61781)
add 5e6a7724abc [fix](ldap) Replace custom LDAP filter escaping with
`LdapEncoder.filterEncode` to prevent injection vulnerabilities and add related
documentation. (#61662) (#61777)
add 59de8c4c524 4.0.5-rc01 (#61772)
add cd1ab3a67b8 branch-4.0: [fix](be) keep FlushToken running count
symmetric on cancel #61684 (#61795)
add 91f06c9908f [bugfix](k8s) fix fe.out not generated when start_fe.sh
--console (#61807)
add 31960e4e667 branch-4.0: [fix](view) ALTER VIEW definition not synced
to follower FE when COMMENT is specified #61670 (#61804)
add acb783e38f4 [test](improvment) add some ttl function cases (#61114)
(#61815)
add 7ac3214ef13 branch-4.0: [fix](fe) Fix duplicate RelationId bug caused
by subquery in simple case when #61813 (#61830)
add 6e604a5a2c0 branch-4.0: [fix](olap) Avoid polluting the schema cache
in OlapScanner #61510 (#61853)
add 47e68dea47c branch-4.0: pick #59776, #61318 (#61930)
add e16a6a5d955 branch-4.0: [pick] Cherry-pick #60520 #60239 #59331 #60310
(#61920)
add 62695854116 branch-4.0: [Opt](cloud) Add segment prefetcher #59482
#60870 (#61422)
add 3773f66af16 [chore](ci) Update CODEOWNERS (#62037)
add ad7204a3b61 branch-4.0: [fix](load)fix VNodeChannel close_wait hang
#58024 (#62030)
add 1ce24905a7f branch-4.0: [fix](scan) Fix missing predicate filter when
Native and JNI readers are mixed in FileScanner (#61802)
add ad6e0cc539d branch-4.0: [fix](build) Fix compilation errors with
implicit conversions and unnecessary virtual keywords (#61836) (#61966)
add 3d10da94fad [Bug](scan) Preserve IN_LIST runtime filter predicates
when key range… (#62115)
add bf90c74a5d2 branch-4.0: [fix](csv reader) fix incorrect column parsing
when using enclose for CSV files with UTF-8 BOM (#62092)
add 4da125101a0 branch-4.0: [fix](streamingjob) fix postgres DML silently
dropped on task restart #61481 (#61855)
add b88a2057698 branch-4.0: [opt](memory) lazy-allocate PrefetchBuffer
backing buffer to reduce peak memory (#62004)
add 5ed06fef157 branch-4.0: [enhance](memtable) support dynamic
modification of flush thread pool size #60423 (#60523)
add 1f9328cdc3e branch-4.0: [fix](cloud) Fix cloud not print ms log #61766
(#62019)
add 0222abca906 branch-4.0: [fix](paimon) add jindo oss support and token
propagation #62106 (#62219)
add 7d94c300179 [fix](date) fix allow_zero_date function incorrect result
issue (#61900)
add 09827b8e563 [fix](doris catalog) FragmentMgr should not cancel virtual
doris cluster query (#62135) (#62281)
add 738ca2ff1ad branch-4.0: [fix](fe) Preload paimon jindo for paimon
scanner (#62351)
add 83466bba185 branch-4.0: [fix](jdbc) Preserve query tvf column aliases
across JDBCcatalogs (#61939) (#62250)
add f87add940ef branch-4.0: [enhancement](variable) newSessionVariable
uses read lock instead of write lock to reduce lock contention #60013 (#62368)
add 3d4dfbd1b61 branch-4.0: [fix](fe) Fix PullUpPredicates losing NULL
rows in INTERSECT/EXCEPT #62299 (#62418)
add 4187882098e branch-4.0: [fix](fe) Fix no_use_cbo_rule hint being
silently ignored in EliminateLogicalSelectHint #62358 (#62426)
add 25e25c1a20a branch-4.0: [fix](streaming-job) fix streaming job
properties not parsed after FE restart #62298 (#62431)
add 85c03973126 branch-4.0: [fix](filecache) anchor temporary TTL
expiration to tablet creation time (#62287)
add 17adb80acd9 branch-4.0: [fix](memory) track IO layer read buffers via
MemTrackerLimiter using PODArray (#62288)
add d163717b155 branch-4.0: [fix](snapshot) skip link binlog files if
binlog is not enabled #61949 (#62013)
add 91c1e5b96e3 branch-4.0: [fix](auto-partition) Register auto-partition
tables with retention_count in DynamicPartitionScheduler on restart #61954
(#61971)
add 13a0007025a branch-4.0: pick some group commit prs(#60652)(#61555)
(#61952)
add 1a7fcdbd75d branch-4.0: [minor](Prefetch) Revert some useless check
#59601 (#62000)
add e22445f430d branch-4.0: (fix)[case] fix
test_mow_compaction_and_rowset_not_exist #61947 (#62025)
add 57a8acd8b54 branch-4.0: [fix](https) fix be to_load_error_http_path
return url in https mode #61785 (#61867)
add d6ae1ea92bc branch-4.0: [fix](cloud) Fix warm up cache not supporting
packed file (#60375) (#61887)
add df937b27d55 branch-4.0: [fix](http) Fix
jetty_server_max_http_header_size not applied in Jetty 12 (#61197) (#61903)
add 12ca10bc201 branch-4.0: [improve](cloud) cloud reduce get_tablet_stats
rpc to meta_service (#60543) (#61945)
add 74c2537c105 [fix](metric) Change partition near-limit metrics from
counters to gauges (#61845) (#61942)
add 3e64491a325 branch-4.0: [minor](fuzzy) make enableQueryCache fuzzy
#61583 (#61965)
add 357d05729a5 branch-4.0: [fix](tvf) fix tvf return error since thrift
message too large to reach limit #61788 (#62322)
add 1476cbaf682 branch-4.0：[minor](Prefetch) Revert some useless check
#59601 (#62189)
add 9c9524caeb6 branch-4.0：[improvement](storage) Release unused memory
earlier, rather than leaving it to the memory pool for guaranteed release
(#62185)
add a528fe0249e [branch-4.0](scan) remove SchemaCache to fix concurrent
crash in OlapScanner::prepare (#62327) (#62427)
add 98f394c0978 branch-4.0：[fix](BrokerLoad && RoutineLoad) Fix the load
attributes and table attributes conflict check #58054 (#62187)
add e31ac1b3167 branch-4.0: [fix](backup) Fix
UnsupportedOperationException in RestoreCommand by copying properties before
modification #61890 (#62071)
add 65a3e30f46c branch-4.0: [bugfix] fix show partitions command for
external catalog validations incompatible with partitions tvf #62134 (#62151)
add 29edf65afc4 branch-4.0: [fix](audit) Fix UnboundAlias digest when name
comes from child #62160 (#62174)
add b086e7fc12d branch-4.0:[fix](lineage) Propagate connectAttributes
through FE forward path for scheduleInfo (#62082) (#62194)
add e9bc531b861 branch-4.0:[feature](lineage) Support lineage SPI
framework for data lineage collection (#61004) (#62168)
add 876855e6bcd branch-4.0 [fix](nereids)Fix CTE consumer stats derivation
when producer stats are not precomputed #61074 (#61863)
add 18dc533cc1f branch-4.0: [opt](load) disable
enable_strict_consistency_dml by default in cloud mode (#61891)
add 0c35b080488 branch-4.0：[enhance](auth)Hidden the token info during
StreamLoad in BE info #60656 && [enhance](auth)Hidden the auth info during
StreamLoad in BE info #59743 (#62188)
add d428716e9e0 branch-4.0: [Enhancement](mmhash) Support mmhash3_u64_v2
#61846 (#62146)
add 8a9e3af9f2e branch-4.0: [fix](docker): Fix Hive3 docker OSS
configuration to use Jindo fs #61822 (#61926)
add 91e9a7c6682 branch-4.0: [fix](test) Make S3FileWriter boundary test
multipart mock thread-safe #62149 (#62252)
add 8e34b37a3f3 branch-4.0: [chore](compaction) change time series
threshold from 2000 to 1000 #61979 (#62443)
add bab3544881c [fix](column) Fix incorrect for-loop (#62517) (#62569)
add 57c6c3b2b67 [fix](cloud) Fix balanced_tablets_shards memory leak and
warmup inflight count (#59093) (#60480) (#61985)
add 4d1aef26cae branch-4.0: [fix](fe) Fix isCountStar incorrectly treating
count(null) as count(*) #62548 (#62666)
add bca492df679 branch-4.0: [fix](cloud) Hide KV_TXN_MAYBE_COMMITTED from
clients #62244 (#62642)
add 14556d3f5f9 [opt](cloud) Prioritize scheduling the most recently
active tablets in cloud #59539 #57200 #61562 (#61914)
add 74a99449b87 branch-4.0: [fix](scan) Fix OOB crash in partition column
generation for Iceberg/Paimon tables #62177 (#62653)
add eabe0044b0f branch-4.0: [feature](be) Support hot reload for file
cache microbench config (pick#58922) (#62723)
add 4a58efd7527 branch-4.0:[fix](storage) fix IOContext Use-After-Free
(#59947) (#62240)
add cda37151e3f branch-4.0: [fix](filecache) reclaim expired tablet
hotspot counters and compact sparse shards (#62724)
add 07e71c69df6 branch-4.0: [enhance](memtable) support adaptive write
buffer size (#61810)
add 1bdba3505e8 branch-4.0: pick #61696 #61621 #62272 (#62706)
add 675c3a461b8 branch-4.0: [codex] fix ANN OpenMP build budget and add
concurrency test #61313 (#62838)
add e64b9ac6941 branch-4.0: [fix](errmsg) Fix wrong error message of
insert overwrite #62555 (#62563)
add ee0df3a2d86 [fix](fe) Fix NoSuchElementException when count with
MATCH_ALL expression (#62172) (#62518)
add 2671c085e41 [branch-4.0](variant) Fix compaction failure on no-key
table with variant column uid=0 (#62656)
add d0b5658af8a branch-4.0: [fix](functions)Preserve TIMESTAMPTZ in
LEAD/LAG by adding TimeStampTzType signature matching #62779 (#63021)
add 9e0a8c49022 branch-4.0: [fix](pipeline) update license-maven-plugin to
2.1.0 #58951 (#63024)
add 9b1a764a52f branch-4.0:[fix](fe) Fix null pointer exception in
sessionVariables after upgrade #61959 (#62896)
add 285041b34c6 branch-4.0: [fix](insert) fix InsertLoadJob memory leak
caused by jobs permanently stuck in PENDING state (#62890)
add cae220ea578 branch-4.0: [fix](transaction) fix
IllegalMonitorStateException in routine load afterAborted when coordinate BE
restarts (#62892)
add 236960049b2 branch-4.0: [fix](load) fix broker load silently loaded
only the first file when parsing multiple files path #62969 (#63041)
add 7f0aaff7024 branch-4.0: [fix](be) Fix UB and param order in
assert_num_rows_operator #62800 (#62845)
add 6e3fa164b32 branch-4.0: [fix](nereids) Fix DST spring-forward gap
handling in timestamptz literal #62945 (#62977)
add a1418adf644 [Bug](profile) move watcher.stop() into locked code block
(#62683)
add 49bb2239bd7 branch-4.0: [fix](point query) Keep LogicalOlapScan for
short-circuit point query on empty table #62948 (#63006)
add 62ce1221a51 branch-4.0： [fix](nereids) Backport unique-function filter
push-down guards (#62705) (#62750)
add 69e3104abe2 [fix](profile) fix missing update_scanner_profile on
non-eos scanner yield path (#62647)
add c8c9de2f1de branch-4.0: [opt](nereids) scale num_nulls in col stats
when partition pruned #62265 (#62693)
add 0a42d750f86 branch-4.0: [fix](be) Add missing SCOPED_ATTACH_TASK in
download and move_dir callbacks #62403 (#62541)
add 0691bbc5091 branch-4.0: [fix](cloud) add get_version and
get_tablet_stats case (#61915) (#62576)
add 2aeccc31961 branch-4.0: [fix](fe) Fix view columns losing colUniqueId
in lazy materialization #62533 (#62572)
add 5612a9cff1e branch-4.0: [fix](fe) Mask sensitive headers in stream
load logs #62108 (#62593)
add e353fb16696 branch-4.0: [fix](fe) Fix SHOW BACKENDS field order
mismatch #62207 (#62283)
add 2d1c37e5c8a branch-4.0: [fix](fe) Fix FE startup argument forwarding
#62587 (#62611)
add ce8c4652322 branch-4.0: [fix](variant) preserve subcolumns after
row-store partial update #62067 (#62075)
add 1bceac2fdd2 [branch-4.0](function) add a lambda functor version for
array_sort (#57828) (#62829)
add 03c8cae0dbc branch-4.0: (cloud) Hold table write lock across
first-time dynamic partition setup to prevent CREATE MV race #62755 (#62862)
add a30257d720d branch-4.0: [fix](fe) Fix Ranger column-level privilege
bypass when CTE combined #61741 (#63047)
add 33da8f60e25 branch-4.0: [fix](parse) No longer throws exceptions when
parse datetime failed in from_olap_string #63035 (#63077)
add fb5654c3c93 branch-4.0: [fix](be) Load JNI log4j2 properties config
#63063 (#63074)
add aa4ac4e4e72 branch-4.0: [fix](regression) Fix typo in
different_serialize test data directory introduced by #59489 #62480 (#62542)
add 1eada5729dd branch-4.0: [fix](build) Backport JFS support from
branch-4.1 (#62927)
add 389afa17b70 branch-4.0: [fix](datetime)Require exact match in
DateTimeV2Type.acceptsType #62201 (#62834)
add 2375fb414be branch-4.0: [fix](streaming-job) Fix PG replication slot
leak when streaming task is cancelled during pause/resume #62010 (#62736)
add 9ba5cf0759d branch-4.0: [fix](load): fix invalid String.format pattern
in NereidsStreamLoadTask #62225 (#62894)
add 451356030dd branch-4.0: [fix](cloud) refresh event warmup backends
#62839 (#62887)
add 64f4c7496cd branch-4.0: [fix](streaming-job) fix S3 offset and job
statistics lost after FE checkpoint restart #62449 (#62626)
add 5b14858c37b [branch-4.0](variant) normalize legacy single-part dot-key
subcolumn paths on read (#62409) (#62771)
add 70c1a8a2be1 branch-4.0: [fix](filecache) reject oversized block size
in add_cell #62878 (#63045)
add 97dc5d7be85 [branch-4.0](variant) Skip full footer scan when
constructing VariantStatsCaculator (#62819) (#63113)
add 2d6a9f48282 branch-4.0: [opt](fe)remove classhisto*=trace in
JAVA_OPTS_FOR_JDK_17 to prevent printing class histogram in full gc#62422
(#62998)
add f82af189346 branch-4.0: [fix](audit) Mark internal query failures as
ERR in audit log (#62997)
add c19ad3684ff branch-4.0: [fix](job) fix StreamingInsertJob incorrectly
counting canceled tasks #61894 (#62731)
add 87a54c62d7f branch-4.0: [improvement](be) Limit packed file writes to
rowset first segment #62342 (#62507)
add 89b31ef0ae4 [fix](runtime-filter) Backport runtime filter fixes to
branch-4.0 (#63083)
add 6c562b8755c branch-4.0: [fix](cloud) Avoid deleting nonexistent delete
bitmap files #62967 (#63015)
add 355ddaff4fd branch-4.0: [Fix](warm up) Fix warm up don't retry due to
error message change #62886 (#62958)
add 4760f093948 branch-4.0: [fix](streaming-job) Fix NPE in
StreamingInsertJob.replayOnCommitted during EditLog replay #62416 (#62629)
add 16b253a55d3 branch-4.0: [fix](nereids) Allocate fresh ExprId for
constants when pushing project into Union #62296 (#63025)
add f55914bdcc4 branch-4.0: [fix](timestamptz) Preserve correct DST fold
branch to go cross the transition point #63034 (#63090)
add 18edafb294b branch-4.0: [fix](fe) Return unknown stats for system
tables #62913 (#63009)
add b876defb19c branch-4.0: [fix](load) rebuild broker load storage
properties after Gson replay #63094 (#63176)
add 5ea9876b6c6 branch-4.0: [fix](streaming-job) start counting task max
interval after the first record is received #63141 (#63162)
add f9a04f58161 branch-4.0: [chore](dep) pin esdk-obs-java-bundle to
3.21.11 to fix version range resolution failure #63278 (#63283)
add 8f912890df1 branch-4.0: [fix](be) Support TIMESTAMPTZ in TopN runtime
predicate #63220 (#63236)
add b4cb993fd30 branch-4.0: [fix](fe) Fix deep nested complex type subtype
validation bypass #63208 (#63223)
add 6db95cf9992 branch-4.0: [fix](fe) Fix Type.exceedsMaxNestingDepth
skipping MAP keyType recursion #63201 (#63212)
add 31ddc47e231 branch-4.0: [improvement](recycler) Avoid single-point
read/write during sequentially reading key #62476 (#63122)
add ac5a8c941cd branch-4.0: [fix](insert) fix INSERT job statistics lost
in show load after FE restart #62331 (#62545)
add cf0ac8a9124 branch-4.0: [test](regression) Shorten generated HMS and
DLF identifiers in catalog case #62313 (#62328)
add e60e2087b0e branch-4.0: [fix](fe-dep) upgrade vulnerable dependencies
#62274 (#62317)
add 65123a9484e branch-4.0: [fix](cloud) Delete local rowsets before
add_rowsets in cloud schema change #62256 (#62310)
add f42d09664ab branch-4.0: [enhancement](config) Change
segments_key_bounds_truncation_threshold default to 36 #61984 (#62002)
add aaa0df1b7f5 branch-4.0: [fix](statistics) Skip statistics cache for
system dbs #63089 (#63197)
add 90df17ebdae branch-4.0: [feature](statistics) Skip collecting stats
for long string columns #62686 (#63302)
add ab693458aee branch-4.0: [fix](iceberg) Allow disabling REST catalog
view operations (#63319)
add afe00828e98 branch-4.0: [fix](memory-tracker) Avoid nested task attach
in cloud snapshot manager #63189 (#63446)
add b058659294e branch-selectdb-doris-4.0: [fix](cloud) avoid NPE and
clear stale cache on warmup job cancel/expire (#62805) (#63020)
add 810a3361d3b branch-4.0: [fix](Expr) add SerDe for ColumnRefExpr and
Expr SerDe unit test #62900 (#63126)
add 9610c7e38f2 branch-4.0: [fix](test) fix unstable cases (#63500)
add d95f70d3426 branch-4.0:[fix](analyze) Preserve variant subfields in
view definitions to fix select view result wrong when view select has variant
field (#62907) (#63390)
add 9577291752c branch-4.0:[fix](partition_prune) Move the pruning of
predicates that are alwaystrue after partition pruning into the
PlanPostProcessor #63111 (#63467)
add d2ad5cac2c6 branch-4.0: [fix](fe) Allow show tablet without selected
database #63280 (#63513)
add c8212596dbb branch-4.0: [fix](docker) allow overriding fdb image
#63393 (#63423)
add 905010d8f65 branch-4.0: [fix](view) Prevent invalid alias rewrite in
view definitions #63353 (#63422)
add 487f51d69ec branch-4.0: [fix](fe) Preserve narrowing datetimev2 casts
in simplify in predicate #63343 (#63420)
add 1dd76b2189c branch-4.0: [improvement](cloud) Add enable_recycler
config to skip recycler dynamically #63286 (#63398)
add 3e389b26cbf branch-4.0: [fix](testcase) Fix wrong test case #63354
(#63374)
add cf3db0a1c30 branch-4.0: [fix](fe) Fix alias function with cast
outermost expr and reject illegal expressions #63254 (#63348)
add 64aa475b8d3 branch-4.0: [fix](fe) Reject lone UTF-16 surrogates in
JSONB literals (RFC 8259 §8.2) #63255 (#63346)
add 1fc3857e00f branch-4.0: [fix](thrift) Reserve frontend service field
ids #63239 (#63334)
add d9a878aa7ea branch-4.0: [fix](test) fix unstable test cases (#63548)
add df189220155 branch-4.0:[fix](ldap) Improve LDAP authentication
resiliency and diagnostics (#61673) (#63285)
add 405cbe5f179 Merge branch 'branch-4.0' into auto-pick-60533-branch-4.0
No new revisions were added by this update.
Summary of changes:
.github/CODEOWNERS | 2 +-
.github/workflows/build-thirdparty.yml | 47 +-
.licenserc.yaml | 1 +
be/CMakeLists.txt | 5 +-
be/src/agent/agent_server.cpp | 3 +-
be/src/agent/task_worker_pool.cpp | 54 +-
be/src/agent/task_worker_pool.h | 6 +-
be/src/cloud/cloud_base_compaction.h | 7 +
be/src/cloud/cloud_cluster_info.cpp | 201 +++
be/src/cloud/cloud_cluster_info.h | 78 +-
be/src/cloud/cloud_compaction_action.cpp | 12 +-
be/src/cloud/cloud_cumulative_compaction.cpp | 16 +
be/src/cloud/cloud_cumulative_compaction.h | 7 +
be/src/cloud/cloud_full_compaction.h | 7 +
be/src/cloud/cloud_internal_service.cpp | 13 +-
be/src/cloud/cloud_meta_mgr.cpp | 81 +-
be/src/cloud/cloud_meta_mgr.h | 6 +
be/src/cloud/cloud_rowset_builder.cpp | 2 +
be/src/cloud/cloud_schema_change_job.cpp | 85 +
be/src/cloud/cloud_snapshot_mgr.cpp | 6 +-
be/src/cloud/cloud_storage_engine.cpp | 129 +-
be/src/cloud/cloud_storage_engine.h | 10 +-
be/src/cloud/cloud_tablet.cpp | 154 +-
be/src/cloud/cloud_tablet.h | 35 +
be/src/cloud/cloud_tablet_hotspot.cpp | 342 +++-
be/src/cloud/cloud_tablet_hotspot.h | 36 +-
be/src/cloud/cloud_tablet_mgr.cpp | 9 +-
be/src/cloud/cloud_warm_up_manager.cpp | 43 +-
be/src/cloud/cloud_warm_up_manager.h | 2 +
be/src/cloud/config.cpp | 18 +-
be/src/cloud/config.h | 17 +
be/src/common/config.cpp | 62 +-
be/src/common/config.h | 34 +-
be/src/common/status.h | 1 +
be/src/exec/rowid_fetcher.cpp | 1 +
be/src/exec/schema_scanner.cpp | 3 +
.../schema_compaction_tasks_scanner.cpp | 504 ++++++
.../schema_compaction_tasks_scanner.h} | 41 +-
be/src/http/action/compaction_action.cpp | 51 +-
be/src/http/action/compaction_profile_action.cpp | 270 ++++
.../action/compaction_profile_action.h} | 20 +-
be/src/http/action/file_cache_action.cpp | 37 +
be/src/http/action/stream_load_forward_handler.cpp | 8 +-
be/src/http/http_request.cpp | 20 +-
be/src/io/cache/block_file_cache.cpp | 6 +-
be/src/io/cache/block_file_cache.h | 1 +
be/src/io/cache/block_file_cache_downloader.cpp | 89 +-
be/src/io/cache/block_file_cache_factory.cpp | 36 +
be/src/io/cache/block_file_cache_factory.h | 3 +
be/src/io/cache/cached_remote_file_reader.cpp | 139 +-
be/src/io/cache/cached_remote_file_reader.h | 15 +-
.../cache/file_cache_expiration.h} | 43 +-
be/src/io/cache/fs_file_cache_storage.cpp | 5 +
be/src/io/fs/benchmark/s3_benchmark.hpp | 4 +-
be/src/io/fs/buffered_reader.cpp | 54 +-
be/src/io/fs/buffered_reader.h | 25 +-
be/src/io/fs/hdfs_file_system.cpp | 8 +-
be/src/io/fs/http_file_reader.cpp | 16 +-
be/src/io/fs/http_file_reader.h | 3 +-
be/src/io/fs/local_file_system.cpp | 14 +
be/src/io/fs/local_file_system.h | 2 +
be/src/io/fs/packed_file_system.cpp | 42 +
be/src/io/fs/s3_file_reader.cpp | 3 +
be/src/io/tools/file_cache_microbench.cpp | 656 +++++---
be/src/io/tools/proto/microbench.proto | 2 +
be/src/olap/base_compaction.h | 6 +
be/src/olap/collection_statistics.cpp | 146 +-
be/src/olap/collection_statistics.h | 19 +-
be/src/olap/column_predicate.h | 3 +-
be/src/olap/compaction.cpp | 123 +-
be/src/olap/compaction.h | 22 +
be/src/olap/compaction_task_tracker.cpp | 271 ++++
be/src/olap/compaction_task_tracker.h | 203 +++
be/src/olap/comparison_predicate.h | 6 -
be/src/olap/cumulative_compaction.h | 6 +
be/src/olap/full_compaction.h | 6 +
be/src/olap/in_list_predicate.h | 7 -
be/src/olap/memtable.cpp | 34 +-
be/src/olap/memtable.h | 6 +
be/src/olap/memtable_flush_executor.cpp | 33 +-
be/src/olap/memtable_flush_executor.h | 3 +
be/src/olap/memtable_writer.cpp | 23 +-
be/src/olap/memtable_writer.h | 2 +
be/src/olap/merger.cpp | 10 +-
be/src/olap/merger.h | 6 +-
be/src/olap/null_predicate.h | 1 -
be/src/olap/olap_common.h | 1 +
be/src/olap/olap_server.cpp | 237 +--
be/src/olap/predicate_collector.cpp | 266 +++
be/src/olap/predicate_collector.h | 90 ++
be/src/olap/rowset/beta_rowset_reader.cpp | 11 +-
be/src/olap/rowset/beta_rowset_writer.cpp | 17 +-
be/src/olap/rowset/beta_rowset_writer.h | 3 +-
be/src/olap/rowset/rowset_reader_context.h | 1 +
be/src/olap/rowset/rowset_writer_context.h | 23 +-
.../segment_v2/ann_index/faiss_ann_index.cpp | 9 +-
be/src/olap/rowset/segment_v2/column_reader.cpp | 124 ++
be/src/olap/rowset/segment_v2/column_reader.h | 41 +
be/src/olap/rowset/segment_v2/index_iterator.h | 1 +
.../olap/rowset/segment_v2/index_query_context.h | 3 +
.../boolean_query/occur_boolean_weight.cpp | 23 +-
.../query_v2/boolean_query/occur_boolean_weight.h | 43 +-
.../query_v2/collect/doc_set_collector.cpp | 71 +
.../query_v2/collect/doc_set_collector.h} | 24 +-
.../query_v2/collect/multi_segment_util.h | 97 ++
.../query_v2/collect/top_k_collector.cpp | 61 +
.../query_v2/collect/top_k_collector.h | 107 ++
.../inverted_index/query_v2/composite_reader.h | 12 +
.../query_v2/match_all_docs_scorer.h | 12 +
.../phrase_prefix_query/phrase_prefix_weight.h | 4 +-
.../query_v2/phrase_query/multi_phrase_weight.h | 7 +-
.../query_v2/phrase_query/phrase_weight.h | 2 +-
.../query_v2/prefix_query/prefix_weight.h | 15 +-
.../query_v2/regexp_query/regexp_weight.cpp | 24 +-
.../query_v2/regexp_query/regexp_weight.h | 2 +-
.../segment_v2/inverted_index/query_v2/scorer.h | 1 +
.../inverted_index/query_v2/segment_postings.h | 88 +-
.../query_v2/term_query/term_scorer.h | 5 +
.../query_v2/term_query/term_weight.h | 43 +-
.../inverted_index/query_v2/wand/block_wand.h | 286 ++++
.../segment_v2/inverted_index/query_v2/weight.h | 68 +-
.../query_v2/wildcard_query/wildcard_weight.h | 2 +-
.../inverted_index/similarity/bm25_similarity.cpp | 9 +
.../inverted_index/similarity/bm25_similarity.h | 1 +
.../inverted_index/similarity/similarity.h | 1 +
.../rowset/segment_v2/inverted_index_iterator.cpp | 78 +-
be/src/olap/rowset/segment_v2/ordinal_page_index.h | 3 +-
be/src/olap/rowset/segment_v2/page_io.cpp | 4 +
be/src/olap/rowset/segment_v2/segment.cpp | 11 +-
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 107 +-
be/src/olap/rowset/segment_v2/segment_iterator.h | 2 +
.../olap/rowset/segment_v2/segment_prefetcher.cpp | 262 +++
be/src/olap/rowset/segment_v2/segment_prefetcher.h | 154 ++
be/src/olap/rowset/segment_v2/segment_writer.cpp | 32 +-
.../variant/hierarchical_data_iterator.cpp | 33 +
.../variant/hierarchical_data_iterator.h | 5 +
.../segment_v2/variant/variant_column_reader.cpp | 17 +
.../segment_v2/variant/variant_column_reader.h | 5 +
.../rowset/segment_v2/variant_stats_calculator.cpp | 14 +-
.../rowset/segment_v2/variant_stats_calculator.h | 8 +-
.../rowset/segment_v2/vertical_segment_writer.cpp | 25 +
be/src/olap/rowset_builder.cpp | 4 +-
be/src/olap/schema_cache.cpp | 60 -
be/src/olap/schema_cache.h | 98 --
be/src/olap/snapshot_manager.cpp | 6 +-
be/src/olap/storage_engine.cpp | 1 -
be/src/olap/storage_engine.h | 8 +-
be/src/olap/storage_policy.cpp | 4 +
be/src/olap/tablet.cpp | 1 +
be/src/olap/tablet_meta.h | 2 +-
be/src/olap/tablet_reader.cpp | 1 +
be/src/olap/tablet_schema.h | 2 +-
be/src/olap/task/engine_batch_load_task.h | 6 +-
be/src/olap/task/engine_clone_task.h | 4 +-
be/src/pipeline/dependency.cpp | 2 +-
be/src/pipeline/exec/assert_num_rows_operator.cpp | 6 +-
be/src/pipeline/exec/materialization_opertor.cpp | 83 +-
be/src/pipeline/exec/olap_scan_operator.cpp | 68 +-
be/src/pipeline/exec/olap_scan_operator.h | 4 +
be/src/pipeline/exec/scan_operator.cpp | 41 +-
be/src/pipeline/exec/set_sink_operator.cpp | 37 +-
be/src/pipeline/exec/set_source_operator.cpp | 4 +-
be/src/pipeline/pipeline_fragment_context.cpp | 15 +-
be/src/pipeline/pipeline_fragment_context.h | 2 +-
be/src/runtime/exec_env.h | 6 +-
be/src/runtime/exec_env_init.cpp | 23 +-
be/src/runtime/fragment_mgr.cpp | 21 +-
be/src/runtime/memory/cache_policy.h | 4 +-
be/src/runtime/memory/memory_profile.cpp | 5 +-
be/src/runtime/query_context.cpp | 2 +
be/src/runtime/query_context.h | 3 +-
be/src/runtime/routine_load/data_consumer.cpp | 10 +-
be/src/runtime/runtime_predicate.cpp | 2 +-
be/src/runtime/snapshot_loader.cpp | 28 +
be/src/runtime/snapshot_loader.h | 2 +
be/src/runtime/workload_group/workload_group.cpp | 29 +
be/src/runtime/workload_group/workload_group.h | 3 +
.../workload_group/workload_group_manager.cpp | 7 +
.../workload_group/workload_group_manager.h | 2 +
be/src/runtime_filter/runtime_filter_consumer.cpp | 19 +-
be/src/service/doris_main.cpp | 4 +
be/src/service/http_service.cpp | 12 +
be/src/service/internal_service.cpp | 20 +-
be/src/util/concurrency_stats.cpp | 130 ++
be/src/util/concurrency_stats.h | 127 ++
be/src/util/thrift_client.h | 3 +
.../aggregate_function_approx_count_distinct.cpp | 5 +-
be/src/vec/columns/predicate_column.h | 2 +-
be/src/vec/common/ipv6_to_binary.h | 25 +-
be/src/vec/common/memcmp_small.h | 12 +-
be/src/vec/common/schema_util.cpp | 2 +-
.../serde/data_type_date_or_datetime_serde.cpp | 10 +-
.../serde/data_type_datetimev2_serde.cpp | 1 +
.../data_types/serde/data_type_datev2_serde.cpp | 1 +
be/src/vec/exec/format/csv/csv_reader.cpp | 44 +-
be/src/vec/exec/format/csv/csv_reader.h | 6 +-
.../file_reader/new_plain_text_line_reader.h | 9 +
be/src/vec/exec/format/json/new_json_reader.cpp | 33 +-
be/src/vec/exec/format/json/new_json_reader.h | 5 +-
be/src/vec/exec/format/orc/vorc_reader.cpp | 60 +-
be/src/vec/exec/format/orc/vorc_reader.h | 10 +
be/src/vec/exec/format/parquet/vparquet_reader.cpp | 48 +
be/src/vec/exec/format/parquet/vparquet_reader.h | 10 +
be/src/vec/exec/scan/file_scanner.cpp | 5 +-
be/src/vec/exec/scan/olap_scanner.cpp | 77 +-
be/src/vec/exec/scan/scanner.cpp | 3 +
be/src/vec/exec/scan/scanner_scheduler.cpp | 35 +-
.../lambda_function/lambda_function_factory.h | 2 +
be/src/vec/exprs/vexpr_context.h | 26 +-
be/src/vec/exprs/vruntimefilter_wrapper.cpp | 6 +-
be/src/vec/exprs/vruntimefilter_wrapper.h | 7 +-
be/src/vec/exprs/vsearch.cpp | 6 +-
.../vec/functions/function_datetime_floor_ceil.cpp | 19 +-
be/src/vec/functions/function_hash.cpp | 9 +-
.../vec/functions/function_other_types_to_date.cpp | 8 +-
be/src/vec/functions/function_search.cpp | 94 +-
be/src/vec/functions/function_search.h | 19 +
be/src/vec/functions/url/find_symbols.h | 2 +-
be/src/vec/io/io_helper.cpp | 4 +-
be/src/vec/olap/vgeneric_iterators.cpp | 1 -
be/src/vec/runtime/ip_address_cidr.h | 2 +-
be/src/vec/runtime/timestamptz_value.cpp | 32 +
be/src/vec/runtime/timestamptz_value.h | 7 +-
be/src/vec/sink/writer/vtablet_writer.cpp | 15 +-
be/src/vec/sink/writer/vtablet_writer.h | 5 +-
be/test/agent/task_worker_pool_test.cpp | 49 +
be/test/cloud/cloud_cluster_info_test.cpp | 280 ++++
be/test/cloud/cloud_schema_change_job_test.cpp | 339 ++++
be/test/cloud/cloud_tablet_hotspot_gc_test.cpp | 198 +++
.../cloud/cloud_tablet_query_prefer_cache_test.cpp | 6 +
.../cloud_tablet_query_with_tolerance_test.cpp | 196 +++
be/test/cloud/cloud_tablet_test.cpp | 305 ++++
.../io/cache/block_file_cache_downloader_test.cpp | 240 +++
be/test/io/cache/block_file_cache_test.cpp | 76 +
be/test/io/cache/file_cache_expiration_test.cpp | 56 +
be/test/io/fs/local_file_system_test.cpp | 9 +
be/test/io/fs/packed_file_system_test.cpp | 51 +
be/test/io/fs/s3_file_writer_test.cpp | 30 +-
be/test/olap/collection_statistics_test.cpp | 30 -
be/test/olap/compaction_file_cache_test.cpp | 403 +++++
be/test/olap/compaction_task_tracker_test.cpp | 769 +++++++++
be/test/olap/memtable_flush_executor_test.cpp | 123 ++
be/test/olap/olap_type_test.cpp | 43 +-
.../inverted_index/query/query_helper_test.cpp | 2 +
.../query_v2/occur_boolean_query_test.cpp | 3 +
.../query_v2/segment_postings_test.cpp | 40 +-
.../query_v2/top_k_collector_test.cpp | 490 ++++++
.../query_v2/union_postings_test.cpp | 8 +-
.../segment_v2/inverted_index_iterator_test.cpp | 47 +-
.../rowset/segment_v2/segment_corruption_test.cpp | 71 +
.../variant_column_writer_reader_test.cpp | 152 ++
.../segment_v2/variant_stats_calculator_test.cpp | 36 +
be/test/olap/storage_resource_test.cpp | 1 +
.../olap/vector_search/faiss_vector_index_test.cpp | 65 +
.../operator/materialization_shared_state_test.cpp | 219 ++-
be/test/pipeline/operator/set_operator_test.cpp | 137 ++
.../fragment_mgr_cross_cluster_cancel_test.cpp | 221 +++
be/test/runtime/snapshot_loader_test.cpp | 68 +-
.../runtime_filter_selectivity_test.cpp | 46 +
.../vruntimefilter_wrapper_sampling_test.cpp | 184 +++
be/test/vec/columns/predicate_column_test.cpp | 1082 +++++++++++++
be/test/vec/common/schema_util_test.cpp | 47 +
be/test/vec/exec/scanner_late_arrival_rf_test.cpp | 123 ++
be/test/vec/exec/vfile_scanner_exception_test.cpp | 41 +
bin/start_fe.sh | 21 +-
build.sh | 31 +-
cloud/script/start.sh | 5 +-
cloud/src/common/bvars.cpp | 40 +
cloud/src/common/bvars.h | 24 +-
cloud/src/common/config.h | 5 +
cloud/src/main.cpp | 14 +-
cloud/src/meta-service/meta_service.cpp | 8 +-
cloud/src/meta-service/meta_service.h | 10 +-
cloud/src/meta-service/meta_service_resource.cpp | 13 +
cloud/src/meta-service/meta_service_txn.cpp | 70 +
cloud/src/recycler/obj_storage_client.cpp | 142 +-
cloud/src/recycler/recycler.cpp | 576 +++++--
cloud/src/recycler/recycler.h | 42 +-
cloud/src/recycler/recycler_operation_log.cpp | 90 +-
cloud/test/CMakeLists.txt | 4 +-
cloud/test/bvars_test.cpp | 4 +-
cloud/test/compaction_rw_separation_test.cpp | 181 +++
cloud/test/meta_service_job_test.cpp | 143 ++
cloud/test/meta_service_operation_log_test.cpp | 6 +-
cloud/test/meta_service_test.cpp | 151 +-
cloud/test/meta_service_versioned_read_test.cpp | 4 +
cloud/test/mock_accessor.h | 2 +-
cloud/test/recycler_batch_delete_test.cpp | 403 +++++
cloud/test/recycler_operation_log_test.cpp | 478 ++++++
cloud/test/recycler_test.cpp | 133 ++
cloud/test/schema_kv_test.cpp | 27 +-
conf/fe.conf | 2 +-
contrib/apache-orc | 2 +-
contrib/clucene | 2 +-
docker/runtime/doris-compose/command.py | 10 +-
.../docker-compose/hive/hadoop-hive-3x.env.tpl | 7 +-
.../docker-compose/hive/hadoop-hive.env.tpl | 3 +-
.../docker-compose/hive/hive-2x_settings.env | 3 +
.../docker-compose/hive/hive-3x.yaml.tpl | 1 +
.../docker-compose/hive/hive-3x_settings.env | 5 +-
.../docker-compose/hive/scripts/hive-metastore.sh | 14 +-
.../hive/scripts/prepare-hive-data.sh | 5 +-
.../kerberos/entrypoint-hive-master.sh | 5 +-
.../docker-compose/kerberos/hadoop-hive.env.tpl | 3 +-
docker/thirdparties/juicefs-helpers.sh | 301 ++++
docker/thirdparties/run-thirdparties-docker.sh | 19 +
.../test/juicefs-helpers-mirror-test.sh | 68 +
fe/be-java-extensions/hadoop-deps/pom.xml | 6 +-
.../doris/common/classloader/ScannerLoader.java | 2 +-
.../java-common/src/main/resources/log4j2.xml | 63 -
.../org/apache/doris/jdbc/BaseJdbcExecutor.java | 7 +-
fe/be-java-extensions/paimon-scanner/pom.xml | 4 -
.../paimon-scanner/src/main/resources/package.xml | 6 +
fe/be-java-extensions/preload-extensions/pom.xml | 5 +-
.../fe-authentication-api/README.md | 127 ++
fe/fe-authentication/fe-authentication-api/pom.xml | 57 +
.../authentication/AuthenticationBinding.java | 142 ++
.../authentication/AuthenticationException.java} | 43 +-
.../authentication/AuthenticationIntegration.java | 262 +++
.../authentication/AuthenticationRequest.java | 242 +++
.../doris/authentication/AuthenticationResult.java | 241 +++
.../doris/authentication/BasicPrincipal.java | 262 +++
.../doris/authentication/CredentialType.java} | 40 +-
.../org/apache/doris/authentication/Principal.java | 99 ++
.../AuthenticationExceptionTest.java | 103 ++
.../AuthenticationIntegrationTest.java | 255 +++
.../authentication/AuthenticationRequestTest.java | 261 +++
.../authentication/AuthenticationResultTest.java | 153 ++
.../doris/authentication/BasicPrincipalTest.java | 266 +++
.../fe-authentication-handler/pom.xml | 81 +
.../handler/AuthenticationOutcome.java | 119 ++
.../handler/AuthenticationPluginManager.java | 283 ++++
.../handler/AuthenticationService.java | 198 +++
.../authentication/handler/BindingRegistry.java | 153 ++
.../authentication/handler/BindingResolver.java | 150 ++
.../handler/IntegrationRegistry.java | 137 ++
.../handler/AuthenticationOutcomeTest.java | 187 +++
.../handler/AuthenticationPluginManagerTest.java | 525 ++++++
.../handler/AuthenticationServiceTest.java | 535 ++++++
.../handler/BindingRegistryTest.java | 266 +++
.../handler/BindingResolverTest.java | 409 +++++
.../handler/IntegrationRegistryTest.java | 166 ++
.../fe-authentication-plugin-ldap/README.md | 163 ++
.../fe-authentication-plugin-ldap/pom.xml | 84 +
.../plugin/ldap/LdapAuthenticationPlugin.java | 242 +++
.../ldap/LdapAuthenticationPluginFactory.java} | 42 +-
.../authentication/plugin/ldap/LdapClient.java | 270 ++++
....authentication.spi.AuthenticationPluginFactory | 3 +-
.../ldap/LdapAuthenticationPluginFactoryTest.java | 76 +
.../LdapAuthenticationPluginIntegrationTest.java | 516 ++++++
.../plugin/ldap/LdapAuthenticationPluginTest.java | 684 ++++++++
.../authentication/plugin/ldap/LdapClientTest.java | 265 +++
.../authentication/plugin/ldap/TestUtils.java | 70 +
.../src/test/resources/test-ldap-data.ldif | 77 +
.../fe-authentication-plugin-password/README.md | 264 +++
.../fe-authentication-plugin-password/pom.xml | 95 ++
.../password/PasswordAuthenticationPlugin.java | 319 ++++
.../PasswordAuthenticationPluginFactory.java} | 40 +-
.../plugin/password/PasswordHasher.java | 202 +++
....authentication.spi.AuthenticationPluginFactory | 3 +-
.../PasswordAuthenticationPluginFactoryTest.java | 70 +
.../password/PasswordAuthenticationPluginTest.java | 614 +++++++
.../plugin/password/PasswordHasherTest.java | 512 ++++++
.../fe-authentication-plugins/pom.xml | 38 +
.../fe-authentication-spi/README.md | 144 ++
fe/fe-authentication/fe-authentication-spi/pom.xml | 44 +
.../authentication/spi/AuthenticationPlugin.java | 146 ++
.../spi/AuthenticationPluginFactory.java | 62 +
.../spi/AuthenticationPluginContractTest.java | 200 +++
.../AuthenticationPluginFactoryContractTest.java | 144 ++
fe/fe-authentication/pom.xml | 38 +
.../main/java/org/apache/doris/catalog/Type.java | 3 +
.../main/java/org/apache/doris/common/Config.java | 91 +-
.../java/org/apache/doris/common/LdapConfig.java | 31 +-
fe/fe-core/pom.xml | 18 +-
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 8 +-
.../org/apache/doris/nereids/search/SearchLexer.g4 | 1 +
.../main/java/org/apache/doris/alter/Alter.java | 3 +-
.../java/org/apache/doris/alter/AlterJobV2.java | 3 +-
.../org/apache/doris/alter/CloudRollupJobV2.java | 11 +
.../apache/doris/alter/CloudSchemaChangeJobV2.java | 10 +
.../apache/doris/alter/SchemaChangeHandler.java | 31 +-
.../java/org/apache/doris/analysis/BrokerDesc.java | 2 +-
.../org/apache/doris/analysis/ColumnRefExpr.java | 5 +
.../org/apache/doris/analysis/JsonLiteral.java | 39 +-
.../org/apache/doris/analysis/OutFileClause.java | 6 +-
.../org/apache/doris/analysis/SchemaTableType.java | 4 +-
.../org/apache/doris/analysis/StorageDesc.java | 24 +-
.../org/apache/doris/catalog/AliasFunction.java | 12 +-
.../doris/catalog/BuiltinScalarFunctions.java | 4 +
.../apache/doris/catalog/CatalogRecycleBin.java | 1700 +++++++++++---------
.../apache/doris/catalog/CloudTabletStatMgr.java | 439 ++++-
.../main/java/org/apache/doris/catalog/Column.java | 4 +
.../main/java/org/apache/doris/catalog/Env.java | 9 +
.../main/java/org/apache/doris/catalog/MTMV.java | 3 +
.../doris/catalog/MaterializedIndexMeta.java | 3 +
.../java/org/apache/doris/catalog/OlapTable.java | 32 +-
.../java/org/apache/doris/catalog/Replica.java | 2 +-
.../java/org/apache/doris/catalog/Resource.java | 3 +
.../java/org/apache/doris/catalog/SchemaTable.java | 41 +
.../main/java/org/apache/doris/catalog/Tablet.java | 8 +-
.../catalog/TabletSlidingWindowAccessStats.java | 555 +++++++
.../org/apache/doris/catalog/TabletStatMgr.java | 55 +-
.../main/java/org/apache/doris/catalog/View.java | 4 +
.../catalog/constraint/PrimaryKeyConstraint.java | 16 +-
.../doris/clone/DynamicPartitionScheduler.java | 4 +-
.../org/apache/doris/cloud/CloudWarmUpJob.java | 17 +
.../apache/doris/cloud/catalog/CloudReplica.java | 16 +
.../apache/doris/cloud/catalog/CloudTablet.java | 7 +-
.../doris/cloud/catalog/CloudTabletRebalancer.java | 665 ++++++--
.../transaction/CloudGlobalTransactionMgr.java | 130 +-
.../java/org/apache/doris/common/ClientPool.java | 3 +
.../java/org/apache/doris/common/Log4jConfig.java | 4 +-
.../apache/doris/common/proc/BackendsProcDir.java | 6 +-
.../doris/common/proc/FrontendsProcNode.java | 9 +-
.../apache/doris/common/proc/ReplicasProcNode.java | 16 +-
.../apache/doris/common/proc/TabletsProcDir.java | 33 +-
.../doris/common/profile/SummaryProfile.java | 2 +-
.../doris/common/util/DynamicPartitionUtil.java | 13 +-
.../apache/doris/common/util/PropertyAnalyzer.java | 2 +-
.../apache/doris/datasource/FileQueryScanNode.java | 6 +-
.../apache/doris/datasource/InternalCatalog.java | 104 +-
.../datasource/iceberg/IcebergMetadataOps.java | 23 +-
.../datasource/jdbc/util/JdbcFieldSchema.java | 5 +-
.../datasource/paimon/source/PaimonScanNode.java | 4 +-
.../property/metastore/IcebergRestProperties.java | 9 +
.../property/storage/HdfsProperties.java | 5 +-
.../property/storage/OSSHdfsProperties.java | 4 +-
.../datasource/property/storage/OSSProperties.java | 10 +-
.../java/org/apache/doris/fs/SchemaTypeMapper.java | 4 +-
.../config/WebServerFactoryCustomizerConfig.java | 15 +
.../org/apache/doris/httpv2/rest/LoadAction.java | 11 +-
.../insert/streaming/StreamingInsertJob.java | 28 +-
.../insert/streaming/StreamingJobProperties.java | 22 +-
.../insert/streaming/StreamingJobStatistic.java | 3 +
.../insert/streaming/StreamingMultiTblTask.java | 9 +-
.../doris/job/offset/SourceOffsetProvider.java | 8 +
.../job/offset/s3/S3SourceOffsetProvider.java | 42 +
.../org/apache/doris/load/GroupCommitManager.java | 30 +-
.../apache/doris/load/loadv2/InsertLoadJob.java | 19 +
.../java/org/apache/doris/load/loadv2/LoadJob.java | 6 +-
.../org/apache/doris/load/loadv2/LoadManager.java | 20 +
.../load/routineload/KafkaRoutineLoadJob.java | 7 +
.../java/org/apache/doris/metric/CloudMetrics.java | 26 +
.../java/org/apache/doris/metric/MetricRepo.java | 113 ++
.../doris/metric/PrometheusMetricVisitor.java | 28 +-
.../org/apache/doris/mysql/MysqlAuthPacket.java | 7 +-
.../java/org/apache/doris/mysql/MysqlProto.java | 1 +
.../mysql/authenticate/AuthenticatorManager.java | 16 +
.../mysql/authenticate/ldap/LdapAuthenticator.java | 38 +-
.../doris/mysql/authenticate/ldap/LdapClient.java | 87 +-
.../doris/mysql/authenticate/ldap/LdapManager.java | 52 +-
.../doris/mysql/privilege/PasswordPolicy.java | 6 +-
.../doris/mysql/privilege/UserPropertyMgr.java | 5 +
.../org/apache/doris/nereids/NereidsPlanner.java | 6 +
.../java/org/apache/doris/nereids/PlannerHook.java | 4 +-
.../org/apache/doris/nereids/StatementContext.java | 23 +-
.../doris/nereids/analyzer/UnboundAlias.java | 2 +-
.../glue/translator/ExpressionTranslator.java | 91 +-
.../doris/nereids/jobs/executor/Rewriter.java | 6 +-
.../doris/nereids/lineage/LineageContext.java | 244 +++
.../nereids/lineage/LineageEventProcessor.java | 349 ++++
.../apache/doris/nereids/lineage/LineageInfo.java | 248 +++
.../nereids/lineage/LineageInfoExtractor.java | 678 ++++++++
.../doris/nereids/lineage/LineagePlugin.java | 59 +
.../nereids/lineage/LineagePluginFactory.java | 54 +
.../apache/doris/nereids/lineage/LineageUtils.java | 322 ++++
.../doris/nereids/load/NereidsBrokerLoadTask.java | 7 +-
.../nereids/load/NereidsLoadingTaskPlanner.java | 2 +-
.../doris/nereids/load/NereidsStreamLoadTask.java | 4 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 51 +-
.../nereids/processor/post/PlanPostProcessors.java | 1 +
.../processor/post/PrunePartitionPredicate.java | 146 ++
.../nereids/properties/RequestPropertyDeriver.java | 6 +-
.../doris/nereids/rules/analysis/AnalyzeCTE.java | 4 +-
.../rules/analysis/EliminateLogicalSelectHint.java | 3 +-
.../nereids/rules/analysis/ExpressionAnalyzer.java | 80 +-
.../nereids/rules/analysis/UserAuthentication.java | 32 +-
.../exploration/mv/SyncMaterializationContext.java | 11 +-
.../rules/expression/rules/PartitionPruner.java | 23 -
.../rules/SimplifyConditionalFunction.java | 18 +-
.../expression/rules/SimplifyInPredicate.java | 11 +-
.../rules/implementation/AggregateStrategies.java | 14 +-
.../LogicalOlapScanToPhysicalOlapScan.java | 3 +-
.../rewrite/AccessPathExpressionCollector.java | 12 +
.../nereids/rules/rewrite/CheckPrivileges.java | 33 +-
.../rules/rewrite/CollectFilterAboveConsumer.java | 3 +
.../doris/nereids/rules/rewrite/OrExpansion.java | 2 +
.../nereids/rules/rewrite/PruneEmptyPartition.java | 6 +
.../rules/rewrite/PruneOlapScanPartition.java | 52 +-
.../nereids/rules/rewrite/PullUpPredicates.java | 15 +-
.../rewrite/PushDownFilterThroughGenerate.java | 3 +-
.../nereids/rules/rewrite/PushDownProject.java | 19 +
.../rewrite/PushDownScoreTopNIntoOlapScan.java | 12 +-
.../rules/rewrite/PushProjectIntoUnion.java | 16 +-
.../rules/rewrite/PushProjectThroughUnion.java | 17 +-
.../nereids/rules/rewrite/RewriteCteChildren.java | 23 +-
.../rules/rewrite/SplitMultiDistinctStrategy.java | 4 +-
.../doris/nereids/rules/rewrite/StatsDerive.java | 23 +-
.../doris/nereids/stats/StatsCalculator.java | 22 +-
.../doris/nereids/trees/expressions/Alias.java | 6 +-
.../doris/nereids/trees/expressions/CaseWhen.java | 114 +-
.../nereids/trees/expressions/SlotReference.java | 2 +-
.../trees/expressions/functions/agg/Avg.java | 10 -
.../trees/expressions/functions/agg/Count.java | 2 +-
.../trees/expressions/functions/agg/Sum.java | 11 -
.../executable/DateTimeExtractAndTransform.java | 28 +-
.../expressions/functions/scalar/ArraySort.java | 35 +-
.../expressions/functions/scalar/CreateMap.java | 38 +-
.../trees/expressions/functions/scalar/Lambda.java | 13 +-
.../{ArraySort.java => MurmurHash3U64V2.java} | 57 +-
.../trees/expressions/functions/udf/AliasUdf.java | 17 +-
.../functions/window/RequireTrivialTypes.java | 2 +
.../trees/expressions/literal/DateLiteral.java | 2 +-
.../trees/expressions/literal/DateTimeLiteral.java | 66 +-
.../trees/expressions/literal/JsonLiteral.java | 39 +-
.../expressions/literal/StringLikeLiteral.java | 12 +-
.../expressions/literal/TimestampTzLiteral.java | 38 +
.../expressions/visitor/ScalarFunctionVisitor.java | 5 +
.../trees/plans/PartitionPrunablePredicate.java | 95 ++
.../AdminCreateClusterSnapshotCommand.java | 18 +-
.../commands/AdminDropClusterSnapshotCommand.java | 18 +-
.../AdminSetAutoClusterSnapshotCommand.java | 18 +-
...dminSetClusterSnapshotFeatureSwitchCommand.java | 18 +-
.../commands/AdminSetReplicaVersionCommand.java | 6 +
.../plans/commands/CreateFunctionCommand.java | 14 +-
.../trees/plans/commands/CreateTableCommand.java | 12 +-
.../trees/plans/commands/DeleteFromCommand.java | 4 +-
.../plans/commands/DeleteFromUsingCommand.java | 12 +-
.../plans/commands/DropConstraintCommand.java | 14 -
.../nereids/trees/plans/commands/LoadCommand.java | 11 +
.../trees/plans/commands/RestoreCommand.java | 12 +-
.../plans/commands/ShowPartitionsCommand.java | 2 +-
.../trees/plans/commands/ShowTabletIdCommand.java | 22 +-
.../commands/insert/AbstractInsertExecutor.java | 13 +-
.../commands/insert/InsertIntoTableCommand.java | 23 +-
.../insert/InsertOverwriteTableCommand.java | 7 +
.../plans/commands/insert/OlapInsertExecutor.java | 62 +-
.../trees/plans/logical/LogicalOlapScan.java | 160 +-
.../trees/plans/logical/LogicalSubQueryAlias.java | 7 +-
.../trees/plans/physical/PhysicalOlapScan.java | 97 +-
.../org/apache/doris/nereids/types/DataType.java | 23 +-
.../apache/doris/nereids/types/DateTimeV2Type.java | 2 +-
.../doris/nereids/util/TypeCoercionUtils.java | 66 +-
.../org/apache/doris/persist/gson/GsonUtils.java | 7 +-
.../planner/BackendPartitionedSchemaScanNode.java | 1 +
.../org/apache/doris/planner/OlapScanNode.java | 13 +-
.../org/apache/doris/planner/OlapTableSink.java | 5 +
.../main/java/org/apache/doris/plugin/Plugin.java | 1 +
.../java/org/apache/doris/plugin/PluginMgr.java | 2 +
.../java/org/apache/doris/qe/AuditLogHelper.java | 159 +-
.../java/org/apache/doris/qe/ConnectContext.java | 15 +
.../java/org/apache/doris/qe/ConnectProcessor.java | 4 +
.../main/java/org/apache/doris/qe/Coordinator.java | 30 +-
.../java/org/apache/doris/qe/FEOpExecutor.java | 5 +
.../org/apache/doris/qe/MysqlConnectProcessor.java | 3 +
.../java/org/apache/doris/qe/SessionVariable.java | 16 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 19 +-
.../main/java/org/apache/doris/qe/VariableMgr.java | 4 +-
.../org/apache/doris/qe/runtime/LoadProcessor.java | 6 +
.../apache/doris/service/FrontendServiceImpl.java | 68 +-
.../org/apache/doris/statistics/AnalysisJob.java | 15 +-
.../apache/doris/statistics/AnalysisManager.java | 27 +-
.../AnalyzeSkipException.java} | 43 +-
.../apache/doris/statistics/BaseAnalysisTask.java | 117 +-
.../doris/statistics/ColumnStatisticBuilder.java | 8 +-
.../doris/statistics/ExternalAnalysisTask.java | 1 +
.../apache/doris/statistics/OlapAnalysisTask.java | 5 +
.../doris/statistics/StatisticConstants.java | 14 +
.../apache/doris/statistics/StatisticsCache.java | 22 +-
.../FrontendsTableValuedFunction.java | 8 +-
.../doris/tablefunction/MetadataGenerator.java | 4 +-
.../doris/transaction/GlobalTransactionMgr.java | 2 +-
.../transaction/GlobalTransactionMgrIface.java | 2 +-
.../apache/doris/alter/AlterJobV2RetryTest.java | 101 ++
.../doris/alter/ReplayModifyViewDefTest.java | 196 +++
.../doris/analysis/StorageDescPersistTest.java | 88 +
.../doris/catalog/CatalogRecycleBinTest.java | 185 +++
.../org/apache/doris/catalog/CreateViewTest.java | 24 +
.../doris/catalog/DynamicPartitionTableTest.java | 31 +
.../doris/catalog/SessionVariablesNullFixTest.java | 129 ++
.../TabletSlidingWindowAccessStatsTest.java | 224 +++
.../java/org/apache/doris/catalog/TypeTest.java | 40 +
.../org/apache/doris/cloud/CloudWarmUpJobTest.java | 73 +
.../cloud/catalog/CloudTabletRebalancerTest.java | 286 ++++
.../transaction/CloudGlobalTransactionMgrTest.java | 34 +-
.../doris/common/proc/BackendsProcDirTest.java | 38 +
.../apache/doris/common/util/LocationPathTest.java | 6 +-
.../datasource/iceberg/IcebergMetadataOpTest.java | 69 +
.../datasource/jdbc/util/JdbcFieldSchemaTest.java | 74 +
.../metastore/IcebergRestPropertiesTest.java | 17 +
.../property/storage/HdfsPropertiesTest.java | 20 +
.../property/storage/HdfsPropertiesUtilsTest.java | 18 +-
.../property/storage/OSSPropertiesTest.java | 16 +-
.../apache/doris/httpv2/rest/LoadActionTest.java | 49 +
.../streaming/StreamingJobPropertiesTest.java | 78 +
.../doris/journal/bdbje/BDBEnvironmentTest.java | 324 ++--
.../doris/mysql/authenticate/TestLogAppender.java | 77 +
.../authenticate/ldap/LdapAuthenticatorTest.java | 28 +
.../mysql/authenticate/ldap/LdapClientTest.java | 95 ++
.../mysql/authenticate/ldap/LdapManagerTest.java | 31 +
.../doris/mysql/privilege/PasswordPolicyTest.java | 123 ++
.../nereids/lineage/LineageEventProcessorTest.java | 453 ++++++
.../nereids/lineage/LineageInfoExtractorTest.java | 960 +++++++++++
.../nereids/lineage/LineageUtilsSkipTest.java | 109 ++
.../nereids/parser/LogicalPlanBuilderTest.java | 251 +++
.../nereids/parser/NereidsParserDigestTest.java | 8 +-
.../doris/nereids/parser/NereidsParserTest.java | 79 +
.../nereids/privileges/TestCheckPrivileges.java | 27 +
.../analysis/CheckExpressionLegalityTest.java | 2 +-
.../analysis/EliminateLogicalSelectHintTest.java | 56 +
.../rules/analysis/UserAuthenticationTest.java | 396 +++++
.../nereids/rules/expression/FoldConstantTest.java | 2 +-
.../rules/expression/SimplifyInPredicateTest.java | 62 +-
.../rules/SimplifyConditionalFunctionTest.java | 17 +-
.../rewrite/CollectFilterAboveConsumerTest.java | 87 +
.../rules/rewrite/CountLiteralRewriteTest.java | 32 +
.../nereids/rules/rewrite/PartitionPrunerTest.java | 258 ---
.../rules/rewrite/PushCountIntoUnionAllTest.java | 30 +
.../rewrite/PushDownCountThroughJoinTest.java | 26 +
.../rewrite/PushDownFilterThroughGenerateTest.java | 92 ++
.../nereids/rules/rewrite/PushDownProjectTest.java | 51 +
.../rules/rewrite/PushProjectIntoUnionTest.java | 133 ++
.../rules/rewrite/PushProjectThroughUnionTest.java | 122 ++
.../rules/rewrite/ShortCircuitPointQueryTest.java | 78 +
.../nereids/trees/expressions/CaseWhenTest.java | 184 +++
.../nereids/trees/expressions/ExpressionTest.java | 17 +
.../nereids/trees/expressions/GetDataTypeTest.java | 8 +-
.../doris/nereids/trees/expressions/UdfTest.java | 31 +
.../functions/FieldDateTimeV2WildcardTest.java | 47 +
.../functions/scalar/SearchDslParserTest.java | 75 +
.../window/TimestampTzLeadLagSignatureTest.java | 55 +
.../trees/expressions/literal/JsonLiteralTest.java | 124 ++
.../AdminCreateClusterSnapshotCommandTest.java | 102 +-
.../AdminDropClusterSnapshotCommandTest.java | 99 +-
.../AdminSetAutoClusterSnapshotCommandTest.java | 103 +-
...SetClusterSnapshotFeatureSwitchCommandTest.java | 99 +-
.../AdminSetReplicaVersionCommandTest.java | 27 +
.../plans/commands/CreateResourceCommandTest.java | 5 +
.../trees/plans/commands/LoadCommandTest.java | 28 +
.../trees/plans/commands/RestoreCommandTest.java | 16 +
.../plans/commands/ShowBackendsCommandTest.java | 34 +-
.../plans/commands/ShowTabletIdCommandTest.java | 4 +-
.../trees/plans/logical/LogicalOlapScanTest.java | 222 +++
.../apache/doris/nereids/types/DataTypeTest.java | 54 +
.../doris/nereids/util/TypeCoercionUtilsTest.java | 45 +
.../doris/planner/QueryCacheNormalizerTest.java | 25 +-
.../org/apache/doris/qe/AuditLogHelperTest.java | 104 ++
.../doris/qe/ConnectAttributesForwardTest.java | 128 ++
.../org/apache/doris/qe/ConnectContextTest.java | 43 +
.../org/apache/doris/qe/SessionVariablesTest.java | 36 +
.../doris/qe/StmtExecutorInternalQueryTest.java | 31 +
.../doris/service/FrontendServiceImplTest.java | 42 +
.../doris/statistics/AnalysisManagerTest.java | 96 ++
.../org/apache/doris/statistics/CacheTest.java | 4 +-
.../doris/statistics/HMSAnalysisTaskTest.java | 2 +-
.../doris/statistics/OlapAnalysisTaskTest.java | 122 ++
.../doris/statistics/StatisticsCacheTest.java | 110 ++
.../FrontendsTableValuedFunctionTest.java | 93 ++
.../doris/utframe/DemoMultiBackendsTest.java | 2 +-
fe/fe-extension-loader/README.md | 403 +++++
fe/fe-extension-loader/pom.xml | 49 +
.../extension/loader/ChildFirstClassLoader.java | 84 +
.../doris/extension/loader/ClassLoadingPolicy.java | 84 +
.../loader/DirectoryPluginRuntimeManager.java | 406 +++++
.../apache/doris/extension/loader/LoadFailure.java | 71 +
.../apache/doris/extension/loader/LoadReport.java | 59 +
.../doris/extension/loader/PluginHandle.java | 84 +
.../doris/extension/loader/PluginLoader.java | 87 +
.../doris/extension/loader/package-info.java | 36 +
fe/fe-extension-spi/README.md | 204 +++
fe/fe-extension-spi/pom.xml | 32 +
.../org/apache/doris/extension/spi/Plugin.java | 31 +-
.../apache/doris/extension/spi/PluginContext.java | 28 +-
.../doris/extension/spi/PluginException.java | 25 +-
.../apache/doris/extension/spi/PluginFactory.java} | 39 +-
.../apache/doris/extension/spi/package-info.java | 29 +-
fe/pom.xml | 55 +-
.../cdcclient/service/PipelineCoordinator.java | 30 +-
.../source/reader/JdbcIncrementalSourceReader.java | 12 +
.../source/reader/mysql/MySqlSourceReader.java | 12 +
.../reader/postgres/PostgresSourceReader.java | 20 +
gensrc/proto/cloud.proto | 27 +
gensrc/proto/olap_file.proto | 4 +-
gensrc/script/gen_build_version.sh | 2 +-
gensrc/thrift/AgentService.thrift | 2 +-
gensrc/thrift/Descriptors.thrift | 1 +
gensrc/thrift/FrontendService.thrift | 32 +
gensrc/thrift/PaloInternalService.thrift | 2 +
gensrc/thrift/PlanNodes.thrift | 1 +
gensrc/thrift/Status.thrift | 1 +
.../cache/ttl/ex02_alter_illegal_combo.out} | 8 +-
.../cache/ttl/ex06_ttl_restart_consistency.out | 12 +
.../ttl/ex08_clear_cache_query_concurrency.out} | 9 +-
.../cache/ttl/st04_alter_ttl_n_to_0_runtime.out} | 0
.../cache/ttl/st06_warmup_ttl_type_assert.out} | 8 +-
.../cache/ttl/st07_qcs_consistency.out} | 8 +-
.../cache/ttl/st10_drop_partition_cleanup.out} | 7 +-
.../cache/ttl/st10_drop_table_cleanup.out} | 7 +-
.../different_serialize.out} | 0
.../test_rf_in_list_not_erased_by_scope_range.out} | 12 +-
.../data/datatype_p0/json/json_cast.out | 14 +-
.../one_level_nestedtypes_with_s3data.out | 582 +++----
.../timestamptz/test_timestamptz_dst_fold.out | 17 +
.../timestamptz/test_timestamptz_dst_gap.out | 11 +
.../timestamptz/test_timestamptz_sort.out | 104 ++
.../test_timestamptz_storage_agg_key.out | 9 +
.../data/delete_p0/test_delete_order_by_limit.out | 61 +
.../sql-functions/doc_date_functions_test.out | 2 +-
.../external_table_p0/jdbc/test_jdbc_query_tvf.out | 6 +
.../test_build_index_multi_analyzer_order.out | 33 +
.../test_count_match_all_pushdown.out | 16 +
.../test_broker_load_multi_filegroup.out | 2 +
.../data/load_p0/stream_load/enclose_with_bom.csv | 2 +
.../test_csv_with_enclose_and_escape.out | 2 +
.../nereids_function_p0/scalar_function/Array2.out | 241 +++
.../data/nereids_p0/datatype/test_decimalv2.out | 59 +-
.../datetime_functions/test_date_function_v2.out | 6 +-
.../subquery/test_subquery_in_simple_case.out | 36 +
.../bind_relation/bind_view_alias_star_agg.out} | 8 +-
.../count_null_not_count_star.out | 38 +
.../partition_prune/prune_predicates_mv_test.out} | 15 +-
.../simplify_conditional_function.out | 6 +
..._filter_above_consumer_with_unique_function.out | 24 +
...ilter_through_generate_with_unique_function.out | 26 +
.../test_simplify_in_predicate.out} | 10 +-
.../data/point_query_p0/test_point_query.out | 2 +
.../set_operations/set_operation_exprid_reuse.out | 44 +
.../set_operations/test_pullup_predicate_null.out | 32 +
.../hash_functions/test_hash_function.out | 71 +
.../data/query_p0/system/test_table_properties.out | 12 +-
.../topn_lazy/lazy_materialize_view.out} | 14 +-
.../query_p2/test_set_operation_large_string.out | 14 +
.../data/search/test_search_slash_in_term.out | 32 +
.../test_show_create_table_and_views_nereids.out | 20 +-
.../test_p_seq_publish_read_from_old.out | 10 +-
.../data/update/test_update_order_by_limit.out | 85 +
.../compaction/test_compaction_nokey_variant.out | 21 +
.../org/apache/doris/regression/suite/Suite.groovy | 36 +-
regression-test/pipeline/p0/conf/fe.conf | 1 +
.../suites/account_p0/test_alter_user.groovy | 27 +
.../auth_call/test_database_management_auth.groovy | 2 +-
.../test_backup_restore_colocate.groovy | 25 +
.../check_hash_bucket_table.groovy | 14 +-
.../test_active_tablet_priority_scheduling.groovy | 263 +++
.../test_alter_compute_group_properties.groovy | 8 +
.../cloud_p0/balance/test_balance_metrics.groovy | 8 +-
...est_balance_use_compute_group_properties.groovy | 18 +-
.../cloud_p0/balance/test_balance_warm_up.groovy | 8 +-
.../test_balance_warm_up_sync_global_config.groovy | 8 +-
.../test_balance_warm_up_task_abnormal.groovy | 8 +-
.../test_balance_warm_up_use_peer_cache.groovy | 8 +-
...e_warm_up_with_compaction_use_peer_cache.groovy | 8 +-
.../balance/test_expanding_node_balance.groovy | 7 +
.../balance/test_peer_read_async_warmup.groovy | 6 +
.../cloud_p0/balance/test_warmup_rebalance.groovy | 8 +
.../cache/ddl/ex02_alter_illegal_combo.sql | 30 +
.../cache/ddl/ex06_ttl_restart_consistency.sql | 30 +
.../ddl/ex08_clear_cache_query_concurrency.sql | 30 +
...est_warm_up_cluster_event_cancel_expired.groovy | 203 +++
.../suites/cloud_p0/cache/test_load_cache.groovy | 5 +
.../cloud_p0/cache/test_topn_broadcast.groovy | 6 +-
.../cache/ttl/ex02_alter_illegal_combo.groovy | 62 +
.../cache/ttl/ex06_ttl_restart_consistency.groovy | 104 ++
.../ttl/ex08_clear_cache_query_concurrency.groovy | 103 ++
.../cache/ttl/st06_warmup_ttl_type_assert.groovy | 126 ++
.../cloud_p0/cache/ttl/st07_qcs_consistency.groovy | 110 ++
.../cache/ttl/st10_drop_partition_cleanup.groovy | 199 +++
.../cache/ttl/test_ttl_creation_time_anchor.groovy | 207 +++
.../test_compaction_cluster_takeover.groovy | 264 +++
.../test_compaction_rw_separation.groovy | 158 ++
.../test_compaction_rw_separation_disabled.groovy | 151 ++
.../test_compaction_rw_separation_force.groovy | 161 ++
.../test_create_table_and_create_mv_race.groovy | 143 ++
.../tablets/test_clean_stale_rs_file_cache.groovy | 8 +-
.../test_clean_stale_rs_index_file_cache.groovy | 8 +-
.../test_clean_tablet_when_drop_force_table.groovy | 8 +-
.../test_clean_tablet_when_rebalance.groovy | 8 +-
.../tablets/test_tablet_stat_syncer.groovy | 150 ++
.../cloud_p0/version/test_version_syncer.groovy | 112 ++
.../test_sc_compaction_cross_v1_race.groovy | 136 ++
.../test_sc_compaction_cross_v1_retry.groovy | 158 ++
.../test_sc_compaction_optimization.groovy | 159 ++
...est_sc_compaction_optimization_with_load.groovy | 174 ++
.../compaction/test_be_compaction_tasks.groovy | 167 ++
.../test_compaction_profile_action.groovy | 193 +++
...test_mow_compaction_and_rowset_not_exist.groovy | 11 +-
.../test_time_series_compaction_policy.groovy | 42 +
...est_rf_in_list_not_erased_by_scope_range.groovy | 91 ++
.../test_complex_disallowed_subtypes.groovy | 77 +
.../suites/datatype_p0/json/json_cast.groovy | 2 +
.../timestamptz/test_timestamptz_dst_fold.groovy | 103 ++
.../timestamptz/test_timestamptz_dst_gap.groovy | 61 +
.../timestamptz/test_timestamptz_sort.groovy | 134 ++
.../test_timestamptz_storage_negative_case.groovy | 4 +-
.../test_create_view_variant_nested_field.groovy | 157 ++
.../delete_p0/test_delete_order_by_limit.groovy | 178 ++
.../outfile/csv/test_outfile_empty_data.groovy | 33 +-
.../broker_load/test_broker_load_func.groovy | 15 +
.../hive/test_hive_analyze_long_string.groovy | 125 ++
.../hive/test_hive_compress_type.groovy | 41 -
.../hive/write/test_hive_ctas_to_doris.groovy | 7 +-
.../iceberg/write/test_iceberg_write_insert.groovy | 5 +
.../jdbc/test_doris_jdbc_catalog.groovy | 4 +
.../jdbc/test_jdbc_query_tvf.groovy | 5 +-
.../jdbc/test_mysql_jdbc_catalog.groovy | 6 +-
.../test_jfs_hms_catalog_read.groovy | 141 ++
.../tvf/test_hdfs_parquet_group0.groovy | 4 +-
.../hive/test_hive_compress_type_large_data.groovy | 85 +
.../hive_on_hms_and_dlf.groovy | 24 +-
.../iceberg_on_hms_and_filesystem_and_dlf.groovy | 2 +-
.../oss_hdfs_catalog_test.groovy | 4 +-
.../memtable/test_memtable_too_many_rows.groovy | 49 +
.../test_audit_log_internal_query_failure.groovy | 98 ++
.../suites/http_p0/test_large_http_header.groovy | 44 +
.../insert_overwrite_error_message_percent.groovy | 59 +
.../insert_p0/test_insert_tablet_sink.groovy | 10 +-
.../test_build_index_multi_analyzer_order.groovy | 210 +++
.../inverted_index_p0/test_bm25_score.groovy | 2 +-
.../test_count_match_all_pushdown.groovy | 81 +
.../test_inverted_index_v3.groovy | 3 +
...treaming_mysql_job_restart_fe_with_props.groovy | 143 ++
.../test_streaming_insert_job_alter_aksk.groovy | 131 ++
...g_job_alter_offset_checkpoint_restart_fe.groovy | 151 ++
...test_streaming_job_checkpoint_restart_fe.groovy | 144 ++
.../test_broker_load_multi_filegroup.groovy | 57 +-
.../test_group_commit_http_stream.groovy | 4 +
.../load_p0/insert/test_insert_statistic.groovy | 42 +-
.../test_insert_statistic_after_fe_restart.groovy | 92 ++
.../load_ddl/test_load_single_tablet.groovy | 152 ++
.../routine_load/ddl/dup_tbl_basic_create.sql | 2 +-
.../load_p0/routine_load/test_black_list.groovy | 4 +-
.../test_routine_load_be_restart.groovy | 21 +-
.../test_csv_with_enclose_and_escape.groovy | 10 +
.../test_stream_load_close_wait_hang.groovy | 140 ++
.../suites/manager/test_manager_interface_1.groovy | 14 +-
.../metrics_p0/test_delete_bitmap_metrics.groovy | 3 +
.../suites/mysql_compatibility_p0/metadata.groovy | 4 +-
.../scalar_function/Array2.groovy | 499 ++++++
.../nereids_p0/datatype/test_decimalv2.groovy | 2 +
.../subquery/test_subquery_in_simple_case.groovy | 82 +
.../bind_relation/bind_view_alias_star_agg.groovy | 46 +
.../count_null_not_count_star.groovy | 137 ++
.../prune_predicates_mv_test.groovy | 182 +++
.../simplify_conditional_function.groovy | 47 +
...lter_above_consumer_with_unique_function.groovy | 49 +
...er_through_generate_with_unique_function.groovy | 49 +
.../test_simplify_in_predicate.groovy | 28 +
.../test_auto_partition_retention_restart.groovy | 94 ++
.../suites/point_query_p0/test_point_query.groovy | 5 +
.../set_operation_exprid_reuse.groovy | 174 ++
.../test_pullup_predicate_null.groovy | 137 ++
.../hash_functions/test_hash_function.groovy | 67 +
.../topn_lazy/lazy_materialize_view.groovy | 84 +
.../test_set_operation_large_string.groovy | 102 ++
.../suites/query_profile/scanner_profile.groovy | 9 +-
.../suites/search/test_search_slash_in_term.groovy | 125 ++
...test_show_create_table_and_views_nereids.groovy | 28 +-
.../suites/show_p0/test_show_tablet.groovy | 8 +-
.../suites/statistics/analyze_stats.groovy | 2 +-
.../statistics/test_analyze_long_string.groovy | 288 ++++
.../suites/statistics/test_scale_num_nulls.groovy | 61 +
.../suites/temp_table_p0/test_temp_table.groovy | 12 +-
.../test_temp_table_with_conn_timeout.groovy | 45 -
.../test_p_seq_publish_read_from_old.groovy | 4 +-
.../update/test_update_order_by_limit.groovy | 175 ++
.../test_compaction_nokey_variant.groovy | 71 +
.../suites/variant_p0/delete_update.groovy | 40 +
regression-test/suites/variant_p0/nested.groovy | 184 ---
.../suites/variant_p0/nested/load.groovy | 200 ---
.../variant_p0/nested/nested_in_top_array.groovy | 131 --
.../suites/variant_p0/nested/sql/q01.sql | 13 -
regression-test/suites/variant_p0/nested2.groovy | 160 --
.../variant_p0/predefine/test_predefine_ddl.groovy | 6 +-
run-regression-test.sh | 14 +-
thirdparty/build-thirdparty.sh | 129 ++
thirdparty/download-thirdparty.sh | 30 +
.../test/download-thirdparty-fallback-test.sh | 99 ++
thirdparty/vars.sh | 7 +
879 files changed, 55584 insertions(+), 5559 deletions(-)
create mode 100644 be/src/cloud/cloud_cluster_info.cpp
create mode 100644
be/src/exec/schema_scanner/schema_compaction_tasks_scanner.cpp
copy be/src/{olap/cumulative_compaction.h =>
exec/schema_scanner/schema_compaction_tasks_scanner.h} (53%)
create mode 100644 be/src/http/action/compaction_profile_action.cpp
copy be/src/{cloud/cloud_cluster_info.h =>
http/action/compaction_profile_action.h} (67%)
copy be/src/{olap/rowset/segment_v2/inverted_index/similarity/similarity.h =>
io/cache/file_cache_expiration.h} (51%)
create mode 100644 be/src/olap/compaction_task_tracker.cpp
create mode 100644 be/src/olap/compaction_task_tracker.h
create mode 100644 be/src/olap/predicate_collector.cpp
create mode 100644 be/src/olap/predicate_collector.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/collect/doc_set_collector.cpp
copy be/src/olap/rowset/segment_v2/{index_query_context.h =>
inverted_index/query_v2/collect/doc_set_collector.h} (59%)
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/collect/multi_segment_util.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/collect/top_k_collector.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/collect/top_k_collector.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/wand/block_wand.h
create mode 100644 be/src/olap/rowset/segment_v2/segment_prefetcher.cpp
create mode 100644 be/src/olap/rowset/segment_v2/segment_prefetcher.h
delete mode 100644 be/src/olap/schema_cache.cpp
delete mode 100644 be/src/olap/schema_cache.h
create mode 100644 be/src/util/concurrency_stats.cpp
create mode 100644 be/src/util/concurrency_stats.h
create mode 100644 be/test/cloud/cloud_cluster_info_test.cpp
create mode 100644 be/test/cloud/cloud_schema_change_job_test.cpp
create mode 100644 be/test/cloud/cloud_tablet_hotspot_gc_test.cpp
create mode 100644 be/test/io/cache/block_file_cache_downloader_test.cpp
create mode 100644 be/test/io/cache/file_cache_expiration_test.cpp
create mode 100644 be/test/olap/compaction_file_cache_test.cpp
create mode 100644 be/test/olap/compaction_task_tracker_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/query_v2/top_k_collector_test.cpp
create mode 100644 be/test/runtime/fragment_mgr_cross_cluster_cancel_test.cpp
create mode 100644
be/test/runtime_filter/vruntimefilter_wrapper_sampling_test.cpp
create mode 100644 be/test/vec/columns/predicate_column_test.cpp
create mode 100644 be/test/vec/exec/scanner_late_arrival_rf_test.cpp
create mode 100644 cloud/test/compaction_rw_separation_test.cpp
create mode 100644 cloud/test/recycler_batch_delete_test.cpp
create mode 100644 docker/thirdparties/juicefs-helpers.sh
create mode 100644 docker/thirdparties/test/juicefs-helpers-mirror-test.sh
delete mode 100644
fe/be-java-extensions/java-common/src/main/resources/log4j2.xml
create mode 100644 fe/fe-authentication/fe-authentication-api/README.md
create mode 100644 fe/fe-authentication/fe-authentication-api/pom.xml
create mode 100644
fe/fe-authentication/fe-authentication-api/src/main/java/org/apache/doris/authentication/AuthenticationBinding.java
copy
fe/{fe-core/src/main/java/org/apache/doris/job/extensions/insert/streaming/StreamingJobStatistic.java
=>
fe-authentication/fe-authentication-api/src/main/java/org/apache/doris/authentication/AuthenticationException.java}
(53%)
create mode 100644
fe/fe-authentication/fe-authentication-api/src/main/java/org/apache/doris/authentication/AuthenticationIntegration.java
create mode 100644
fe/fe-authentication/fe-authentication-api/src/main/java/org/apache/doris/authentication/AuthenticationRequest.java
create mode 100644
fe/fe-authentication/fe-authentication-api/src/main/java/org/apache/doris/authentication/AuthenticationResult.java
create mode 100644
fe/fe-authentication/fe-authentication-api/src/main/java/org/apache/doris/authentication/BasicPrincipal.java
copy
fe/{fe-core/src/main/java/org/apache/doris/job/extensions/insert/streaming/StreamingJobStatistic.java
=>
fe-authentication/fe-authentication-api/src/main/java/org/apache/doris/authentication/CredentialType.java}
(53%)
create mode 100644
fe/fe-authentication/fe-authentication-api/src/main/java/org/apache/doris/authentication/Principal.java
create mode 100644
fe/fe-authentication/fe-authentication-api/src/test/java/org/apache/doris/authentication/AuthenticationExceptionTest.java
create mode 100644
fe/fe-authentication/fe-authentication-api/src/test/java/org/apache/doris/authentication/AuthenticationIntegrationTest.java
create mode 100644
fe/fe-authentication/fe-authentication-api/src/test/java/org/apache/doris/authentication/AuthenticationRequestTest.java
create mode 100644
fe/fe-authentication/fe-authentication-api/src/test/java/org/apache/doris/authentication/AuthenticationResultTest.java
create mode 100644
fe/fe-authentication/fe-authentication-api/src/test/java/org/apache/doris/authentication/BasicPrincipalTest.java
create mode 100644 fe/fe-authentication/fe-authentication-handler/pom.xml
create mode 100644
fe/fe-authentication/fe-authentication-handler/src/main/java/org/apache/doris/authentication/handler/AuthenticationOutcome.java
create mode 100644
fe/fe-authentication/fe-authentication-handler/src/main/java/org/apache/doris/authentication/handler/AuthenticationPluginManager.java
create mode 100644
fe/fe-authentication/fe-authentication-handler/src/main/java/org/apache/doris/authentication/handler/AuthenticationService.java
create mode 100644
fe/fe-authentication/fe-authentication-handler/src/main/java/org/apache/doris/authentication/handler/BindingRegistry.java
create mode 100644
fe/fe-authentication/fe-authentication-handler/src/main/java/org/apache/doris/authentication/handler/BindingResolver.java
create mode 100644
fe/fe-authentication/fe-authentication-handler/src/main/java/org/apache/doris/authentication/handler/IntegrationRegistry.java
create mode 100644
fe/fe-authentication/fe-authentication-handler/src/test/java/org/apache/doris/authentication/handler/AuthenticationOutcomeTest.java
create mode 100644
fe/fe-authentication/fe-authentication-handler/src/test/java/org/apache/doris/authentication/handler/AuthenticationPluginManagerTest.java
create mode 100644
fe/fe-authentication/fe-authentication-handler/src/test/java/org/apache/doris/authentication/handler/AuthenticationServiceTest.java
create mode 100644
fe/fe-authentication/fe-authentication-handler/src/test/java/org/apache/doris/authentication/handler/BindingRegistryTest.java
create mode 100644
fe/fe-authentication/fe-authentication-handler/src/test/java/org/apache/doris/authentication/handler/BindingResolverTest.java
create mode 100644
fe/fe-authentication/fe-authentication-handler/src/test/java/org/apache/doris/authentication/handler/IntegrationRegistryTest.java
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-ldap/README.md
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-ldap/pom.xml
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-ldap/src/main/java/org/apache/doris/authentication/plugin/ldap/LdapAuthenticationPlugin.java
copy fe/{fe-core/src/main/java/org/apache/doris/nereids/PlannerHook.java =>
fe-authentication/fe-authentication-plugins/fe-authentication-plugin-ldap/src/main/java/org/apache/doris/authentication/plugin/ldap/LdapAuthenticationPluginFactory.java}
(51%)
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-ldap/src/main/java/org/apache/doris/authentication/plugin/ldap/LdapClient.java
copy .github/CODEOWNERS =>
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-ldap/src/main/resources/META-INF/services/org.apache.doris.authentication.spi.AuthenticationPluginFactory
(90%)
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-ldap/src/test/java/org/apache/doris/authentication/plugin/ldap/LdapAuthenticationPluginFactoryTest.java
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-ldap/src/test/java/org/apache/doris/authentication/plugin/ldap/LdapAuthenticationPluginIntegrationTest.java
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-ldap/src/test/java/org/apache/doris/authentication/plugin/ldap/LdapAuthenticationPluginTest.java
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-ldap/src/test/java/org/apache/doris/authentication/plugin/ldap/LdapClientTest.java
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-ldap/src/test/java/org/apache/doris/authentication/plugin/ldap/TestUtils.java
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-ldap/src/test/resources/test-ldap-data.ldif
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-password/README.md
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-password/pom.xml
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-password/src/main/java/org/apache/doris/authentication/plugin/password/PasswordAuthenticationPlugin.java
copy fe/{fe-core/src/main/java/org/apache/doris/nereids/PlannerHook.java =>
fe-authentication/fe-authentication-plugins/fe-authentication-plugin-password/src/main/java/org/apache/doris/authentication/plugin/password/PasswordAuthenticationPluginFactory.java}
(50%)
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-password/src/main/java/org/apache/doris/authentication/plugin/password/PasswordHasher.java
copy .github/CODEOWNERS =>
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-password/src/main/resources/META-INF/services/org.apache.doris.authentication.spi.AuthenticationPluginFactory
(90%)
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-password/src/test/java/org/apache/doris/authentication/plugin/password/PasswordAuthenticationPluginFactoryTest.java
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-password/src/test/java/org/apache/doris/authentication/plugin/password/PasswordAuthenticationPluginTest.java
create mode 100644
fe/fe-authentication/fe-authentication-plugins/fe-authentication-plugin-password/src/test/java/org/apache/doris/authentication/plugin/password/PasswordHasherTest.java
create mode 100644 fe/fe-authentication/fe-authentication-plugins/pom.xml
create mode 100644 fe/fe-authentication/fe-authentication-spi/README.md
create mode 100644 fe/fe-authentication/fe-authentication-spi/pom.xml
create mode 100644
fe/fe-authentication/fe-authentication-spi/src/main/java/org/apache/doris/authentication/spi/AuthenticationPlugin.java
create mode 100644
fe/fe-authentication/fe-authentication-spi/src/main/java/org/apache/doris/authentication/spi/AuthenticationPluginFactory.java
create mode 100644
fe/fe-authentication/fe-authentication-spi/src/test/java/org/apache/doris/authentication/spi/AuthenticationPluginContractTest.java
create mode 100644
fe/fe-authentication/fe-authentication-spi/src/test/java/org/apache/doris/authentication/spi/AuthenticationPluginFactoryContractTest.java
create mode 100644 fe/fe-authentication/pom.xml
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/catalog/TabletSlidingWindowAccessStats.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/lineage/LineageContext.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/lineage/LineageEventProcessor.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/lineage/LineageInfo.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/lineage/LineageInfoExtractor.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/lineage/LineagePlugin.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/lineage/LineagePluginFactory.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/lineage/LineageUtils.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/processor/post/PrunePartitionPredicate.java
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{ArraySort.java
=> MurmurHash3U64V2.java} (51%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/PartitionPrunablePredicate.java
copy
fe/fe-core/src/main/java/org/apache/doris/{job/extensions/insert/streaming/StreamingJobStatistic.java
=> statistics/AnalyzeSkipException.java} (52%)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/alter/AlterJobV2RetryTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/alter/ReplayModifyViewDefTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/analysis/StorageDescPersistTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/catalog/SessionVariablesNullFixTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/catalog/TabletSlidingWindowAccessStatsTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/cloud/CloudWarmUpJobTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/cloud/catalog/CloudTabletRebalancerTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/jdbc/util/JdbcFieldSchemaTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/httpv2/rest/LoadActionTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/mysql/authenticate/TestLogAppender.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/mysql/privilege/PasswordPolicyTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/lineage/LineageEventProcessorTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/lineage/LineageInfoExtractorTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/lineage/LineageUtilsSkipTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/parser/LogicalPlanBuilderTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/analysis/EliminateLogicalSelectHintTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/analysis/UserAuthenticationTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/CollectFilterAboveConsumerTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/PushDownFilterThroughGenerateTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/PushProjectIntoUnionTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/PushProjectThroughUnionTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/ShortCircuitPointQueryTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/trees/expressions/CaseWhenTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/trees/expressions/functions/FieldDateTimeV2WildcardTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/trees/expressions/functions/window/TimestampTzLeadLagSignatureTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/trees/expressions/literal/JsonLiteralTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/logical/LogicalOlapScanTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/qe/AuditLogHelperTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/qe/ConnectAttributesForwardTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/tablefunction/FrontendsTableValuedFunctionTest.java
create mode 100644 fe/fe-extension-loader/README.md
create mode 100644 fe/fe-extension-loader/pom.xml
create mode 100644
fe/fe-extension-loader/src/main/java/org/apache/doris/extension/loader/ChildFirstClassLoader.java
create mode 100644
fe/fe-extension-loader/src/main/java/org/apache/doris/extension/loader/ClassLoadingPolicy.java
create mode 100644
fe/fe-extension-loader/src/main/java/org/apache/doris/extension/loader/DirectoryPluginRuntimeManager.java
create mode 100644
fe/fe-extension-loader/src/main/java/org/apache/doris/extension/loader/LoadFailure.java
create mode 100644
fe/fe-extension-loader/src/main/java/org/apache/doris/extension/loader/LoadReport.java
create mode 100644
fe/fe-extension-loader/src/main/java/org/apache/doris/extension/loader/PluginHandle.java
create mode 100644
fe/fe-extension-loader/src/main/java/org/apache/doris/extension/loader/PluginLoader.java
create mode 100644
fe/fe-extension-loader/src/main/java/org/apache/doris/extension/loader/package-info.java
create mode 100644 fe/fe-extension-spi/README.md
create mode 100644 fe/fe-extension-spi/pom.xml
copy be/src/cloud/cloud_cluster_info.h =>
fe/fe-extension-spi/src/main/java/org/apache/doris/extension/spi/Plugin.java
(63%)
copy be/src/cloud/cloud_cluster_info.h =>
fe/fe-extension-spi/src/main/java/org/apache/doris/extension/spi/PluginContext.java
(59%)
copy be/src/cloud/cloud_cluster_info.h =>
fe/fe-extension-spi/src/main/java/org/apache/doris/extension/spi/PluginException.java
(72%)
copy fe/{fe-core/src/main/java/org/apache/doris/nereids/PlannerHook.java =>
fe-extension-spi/src/main/java/org/apache/doris/extension/spi/PluginFactory.java}
(54%)
copy be/src/cloud/cloud_cluster_info.h =>
fe/fe-extension-spi/src/main/java/org/apache/doris/extension/spi/package-info.java
(56%)
copy
regression-test/data/{load_p0/broker_load/test_broker_load_multi_filegroup.out
=> cloud_p0/cache/ttl/ex02_alter_illegal_combo.out} (65%)
create mode 100644
regression-test/data/cloud_p0/cache/ttl/ex06_ttl_restart_consistency.out
copy
regression-test/data/{load_p0/broker_load/test_broker_load_multi_filegroup.out
=> cloud_p0/cache/ttl/ex08_clear_cache_query_concurrency.out} (66%)
copy
regression-test/data/{large_txn_load_p1/test_insert_with_many_partitions_and_buckets.out
=> cloud_p0/cache/ttl/st04_alter_ttl_n_to_0_runtime.out} (100%)
copy
regression-test/data/{load_p0/broker_load/test_broker_load_multi_filegroup.out
=> cloud_p0/cache/ttl/st06_warmup_ttl_type_assert.out} (65%)
copy
regression-test/data/{load_p0/broker_load/test_broker_load_multi_filegroup.out
=> cloud_p0/cache/ttl/st07_qcs_consistency.out} (67%)
copy
regression-test/data/{load_p0/broker_load/test_broker_load_multi_filegroup.out
=> cloud_p0/cache/ttl/st10_drop_partition_cleanup.out} (66%)
copy
regression-test/data/{load_p0/broker_load/test_broker_load_multi_filegroup.out
=> cloud_p0/cache/ttl/st10_drop_table_cleanup.out} (66%)
rename
regression-test/data/cloud_p0/{diffrent_serialize/diffrent_serialize.out =>
different_serialize/different_serialize.out} (100%)
copy
regression-test/data/{load_p0/broker_load/test_broker_load_multi_filegroup.out
=> correctness_p0/test_rf_in_list_not_erased_by_scope_range.out} (66%)
create mode 100644
regression-test/data/datatype_p0/timestamptz/test_timestamptz_dst_fold.out
create mode 100644
regression-test/data/datatype_p0/timestamptz/test_timestamptz_dst_gap.out
create mode 100644
regression-test/data/delete_p0/test_delete_order_by_limit.out
create mode 100644
regression-test/data/inverted_index_p0/index_change/test_build_index_multi_analyzer_order.out
create mode 100644
regression-test/data/inverted_index_p0/test_count_match_all_pushdown.out
create mode 100644
regression-test/data/load_p0/stream_load/enclose_with_bom.csv
create mode 100644
regression-test/data/nereids_function_p0/scalar_function/Array2.out
create mode 100644
regression-test/data/nereids_p0/subquery/test_subquery_in_simple_case.out
copy
regression-test/data/{load_p0/broker_load/test_broker_load_multi_filegroup.out
=> nereids_rules_p0/bind_relation/bind_view_alias_star_agg.out} (65%)
create mode 100644
regression-test/data/nereids_rules_p0/count_null_not_count_star/count_null_not_count_star.out
copy
regression-test/data/{load_p0/broker_load/test_broker_load_multi_filegroup.out
=> nereids_rules_p0/partition_prune/prune_predicates_mv_test.out} (59%)
create mode 100644
regression-test/data/nereids_rules_p0/unique_function/collect_filter_above_consumer_with_unique_function.out
create mode 100644
regression-test/data/nereids_rules_p0/unique_function/push_down_filter_through_generate_with_unique_function.out
copy
regression-test/data/{load_p0/broker_load/test_broker_load_multi_filegroup.out
=> nereids_syntax_p0/test_simplify_in_predicate.out} (66%)
create mode 100644
regression-test/data/query_p0/set_operations/set_operation_exprid_reuse.out
create mode 100644
regression-test/data/query_p0/set_operations/test_pullup_predicate_null.out
copy
regression-test/data/{load_p0/broker_load/test_broker_load_multi_filegroup.out
=> query_p0/topn_lazy/lazy_materialize_view.out} (50%)
create mode 100644
regression-test/data/query_p2/test_set_operation_large_string.out
create mode 100644 regression-test/data/search/test_search_slash_in_term.out
create mode 100644 regression-test/data/update/test_update_order_by_limit.out
create mode 100644
regression-test/data/variant_p0/compaction/test_compaction_nokey_variant.out
create mode 100644
regression-test/suites/cloud_p0/balance/test_active_tablet_priority_scheduling.groovy
create mode 100644
regression-test/suites/cloud_p0/cache/ddl/ex02_alter_illegal_combo.sql
create mode 100644
regression-test/suites/cloud_p0/cache/ddl/ex06_ttl_restart_consistency.sql
create mode 100644
regression-test/suites/cloud_p0/cache/ddl/ex08_clear_cache_query_concurrency.sql
create mode 100644
regression-test/suites/cloud_p0/cache/multi_cluster/warm_up/cluster/test_warm_up_cluster_event_cancel_expired.groovy
create mode 100644
regression-test/suites/cloud_p0/cache/ttl/ex02_alter_illegal_combo.groovy
create mode 100644
regression-test/suites/cloud_p0/cache/ttl/ex06_ttl_restart_consistency.groovy
create mode 100644
regression-test/suites/cloud_p0/cache/ttl/ex08_clear_cache_query_concurrency.groovy
create mode 100644
regression-test/suites/cloud_p0/cache/ttl/st06_warmup_ttl_type_assert.groovy
create mode 100644
regression-test/suites/cloud_p0/cache/ttl/st07_qcs_consistency.groovy
create mode 100644
regression-test/suites/cloud_p0/cache/ttl/st10_drop_partition_cleanup.groovy
create mode 100644
regression-test/suites/cloud_p0/cache/ttl/test_ttl_creation_time_anchor.groovy
create mode 100644
regression-test/suites/cloud_p0/compaction_rw_separation/test_compaction_cluster_takeover.groovy
create mode 100644
regression-test/suites/cloud_p0/compaction_rw_separation/test_compaction_rw_separation.groovy
create mode 100644
regression-test/suites/cloud_p0/compaction_rw_separation/test_compaction_rw_separation_disabled.groovy
create mode 100644
regression-test/suites/cloud_p0/compaction_rw_separation/test_compaction_rw_separation_force.groovy
create mode 100644
regression-test/suites/cloud_p0/partition/test_create_table_and_create_mv_race.groovy
create mode 100644
regression-test/suites/cloud_p0/tablets/test_tablet_stat_syncer.groovy
create mode 100644
regression-test/suites/cloud_p0/version/test_version_syncer.groovy
create mode 100644
regression-test/suites/cloud_p1/schema_change/compaction_optimization/test_sc_compaction_cross_v1_race.groovy
create mode 100644
regression-test/suites/cloud_p1/schema_change/compaction_optimization/test_sc_compaction_cross_v1_retry.groovy
create mode 100644
regression-test/suites/cloud_p1/schema_change/compaction_optimization/test_sc_compaction_optimization.groovy
create mode 100644
regression-test/suites/cloud_p1/schema_change/compaction_optimization/test_sc_compaction_optimization_with_load.groovy
create mode 100644
regression-test/suites/compaction/test_be_compaction_tasks.groovy
create mode 100644
regression-test/suites/compaction/test_compaction_profile_action.groovy
create mode 100644
regression-test/suites/correctness_p0/test_rf_in_list_not_erased_by_scope_range.groovy
create mode 100644
regression-test/suites/datatype_p0/complex_types/test_complex_disallowed_subtypes.groovy
create mode 100644
regression-test/suites/datatype_p0/timestamptz/test_timestamptz_dst_fold.groovy
create mode 100644
regression-test/suites/datatype_p0/timestamptz/test_timestamptz_dst_gap.groovy
create mode 100644
regression-test/suites/ddl_p0/create_view_nereids/test_create_view_variant_nested_field.groovy
create mode 100644
regression-test/suites/delete_p0/test_delete_order_by_limit.groovy
create mode 100644
regression-test/suites/external_table_p0/hive/test_hive_analyze_long_string.groovy
create mode 100644
regression-test/suites/external_table_p0/refactor_storage_param/test_jfs_hms_catalog_read.groovy
create mode 100644
regression-test/suites/external_table_p2/hive/test_hive_compress_type_large_data.groovy
create mode 100644
regression-test/suites/fault_injection_p0/memtable/test_memtable_too_many_rows.groovy
create mode 100644
regression-test/suites/fault_injection_p0/test_audit_log_internal_query_failure.groovy
create mode 100644 regression-test/suites/http_p0/test_large_http_header.groovy
create mode 100644
regression-test/suites/insert_overwrite_p0/insert_overwrite_error_message_percent.groovy
create mode 100644
regression-test/suites/inverted_index_p0/index_change/test_build_index_multi_analyzer_order.groovy
create mode 100644
regression-test/suites/inverted_index_p0/test_count_match_all_pushdown.groovy
create mode 100644
regression-test/suites/job_p0/streaming_job/cdc/test_streaming_mysql_job_restart_fe_with_props.groovy
create mode 100644
regression-test/suites/job_p0/streaming_job/test_streaming_insert_job_alter_aksk.groovy
create mode 100644
regression-test/suites/job_p0/streaming_job/test_streaming_job_alter_offset_checkpoint_restart_fe.groovy
create mode 100644
regression-test/suites/job_p0/streaming_job/test_streaming_job_checkpoint_restart_fe.groovy
create mode 100644
regression-test/suites/load_p0/insert/test_insert_statistic_after_fe_restart.groovy
create mode 100644
regression-test/suites/load_p0/load_ddl/test_load_single_tablet.groovy
create mode 100644
regression-test/suites/load_p0/test_stream_load_close_wait_hang.groovy
create mode 100644
regression-test/suites/nereids_function_p0/scalar_function/Array2.groovy
create mode 100644
regression-test/suites/nereids_p0/subquery/test_subquery_in_simple_case.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/bind_relation/bind_view_alias_star_agg.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/count_null_not_count_star/count_null_not_count_star.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/partition_prune/prune_predicates_mv_test.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/unique_function/collect_filter_above_consumer_with_unique_function.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/unique_function/push_down_filter_through_generate_with_unique_function.groovy
create mode 100644
regression-test/suites/partition_p0/auto_partition/test_auto_partition_retention_restart.groovy
create mode 100644
regression-test/suites/query_p0/set_operations/set_operation_exprid_reuse.groovy
create mode 100644
regression-test/suites/query_p0/set_operations/test_pullup_predicate_null.groovy
create mode 100644
regression-test/suites/query_p0/topn_lazy/lazy_materialize_view.groovy
create mode 100644
regression-test/suites/query_p2/test_set_operation_large_string.groovy
create mode 100644
regression-test/suites/search/test_search_slash_in_term.groovy
create mode 100644
regression-test/suites/statistics/test_analyze_long_string.groovy
create mode 100644
regression-test/suites/statistics/test_scale_num_nulls.groovy
delete mode 100644
regression-test/suites/temp_table_p0/test_temp_table_with_conn_timeout.groovy
create mode 100644
regression-test/suites/update/test_update_order_by_limit.groovy
create mode 100644
regression-test/suites/variant_p0/compaction/test_compaction_nokey_variant.groovy
delete mode 100644 regression-test/suites/variant_p0/nested.groovy
delete mode 100644 regression-test/suites/variant_p0/nested/load.groovy
delete mode 100644
regression-test/suites/variant_p0/nested/nested_in_top_array.groovy
delete mode 100644 regression-test/suites/variant_p0/nested/sql/q01.sql
delete mode 100644 regression-test/suites/variant_p0/nested2.groovy
create mode 100644 thirdparty/test/download-thirdparty-fallback-test.sh
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
