This is an automated email from the ASF dual-hosted git repository.
xuyang pushed a change to branch struct-map-type
in repository https://gitbox.apache.org/repos/asf/doris.git
omit 83a81944ac [fix] fix fe ut
omit 7049decb7a [fix] fix code for comment
omit c33740066c [fix](struct-type) remove-empty-line
omit 98577d6ce1 [bug](regression-test) fix array regression test
omit 0f69c77267 [bug](struct-type) fix array type miss scale
omit a5c30b7942 [bug](struct-type) fix be ut and format
omit aa2154efea [bug](struct-type) fix be ut and format
omit 320eec28d6 [bug](struct-type) fix be ut and format
omit c02a706c9a rebase master and fix compile error
omit eccddd910a [fix](complex_type) fix clone_type_info function return
default scalar type (#16400)
omit 454ff4c69a [fix](map-type) fix compile error (#16413)
omit ebfd14ca2c [Feature](map) add map type to doris (#15966)
omit eb70160b96 [fix](struct-type) fix insert null and explain for struct
type (#16054)
omit e6c298e9c3 [fix](struct-type) select of struct return wrong result
(#16032)
omit 7a573c9404 [hotfix](struct-type) Fix type descriptor make array load
core (#16020)
omit 11c8eca9f0 [fix](struct-type) support struct type insert (#15941)
omit 747cc04cc3 [fix](struct-type) support to remove double or single quote
(#15977)
omit 273bc1b703 save (#15908)
omit 9fa4b05c5d save (#15906)
omit 3818973f96 [feature](struct-type) adjust the vexpr for struct type
(#15669)
omit 5137ca6da0 [fix](struct-type) struct create fix and add more struct
codes (#15879)
omit 3d68b650eb [WIP](struct-type) support struct-type in vectorize engine
(#15665)
omit 80f6a7b0ab [feature](struct-type) add the class ColumnStruct and class
DataTypeStruct implement (#14545)
omit 48a0b4e80a [test] (test) test modify branch (#14375)
omit 5e9a6e40ba save
omit 6628baae93 test
add a17fbe2b4c [fix](MTMV) Use current db to identify the MTMV tasks and
jobs (#16419)
add 7bd6e32f85 [build-support](code-style): Add more config in
IntelliJ-code-format.xml (#16420)
add 719b8ca340 [enhance](Nereids): polish code (#16368)
add 737c73dcf0 [Improvement](topn) order by key topn query optimization
(#15663)
add b21fdace37 [bugfix](RemoteUDF) fix remote udf retrun `rpc env init
error` (#16325)
add c0054ddb2b [chore](type-info) Remove unused method in TypeInfo #16433
add da27039fe4 [Fix](load) Fix memory leak for stream load 2pc #16430
add 118e769dac [fix](regression-test) fix external table p2 case bug
(#16405)
add c1400a34eb [regression](fix) 1. fix broker load test case and add orc
test 2. se… (#16373)
add 2bee26b05a [fix](merge-on-write) fix that the query result has
duplicate keys (#16336)
add 36a5e0a2a9 [bugfix](array) fix element revert on error in
DataTypeArray::from_string (#16434)
add 0744aeb201 [fix](docs) fix the 404 bad link of website doc (#16284)
add 3334e3f393 [fix](restore) do not set default replication_allocation
when restore with property reserve_replica = true (#15562)
add dcbcec0775 [regression](fuzzy)fuzzy enable_fold_constant_by_be (#16448)
add a13beca0de [Fix](load)Use lower case for load column names. #16422
add 91229bb87d [Bug](makr join) Fix mark join with other conjuncts (#16435)
add 0b8c6315fb [fix](broker load) Fix hll_hash(null) in broker load report
incorrect Exception (#16293)
add 27216dc7e0 [improvement](multi-catalog) push down all predicates into
rowgroup/page filtering for ParquetReader (#16388)
add bed1ab7c19 [Feature](Nereids) Add hint to enable pre-aggregation when
scan OLAP table. (#15614)
add 6fdd35a6f2 [enhancement](mpp process) remove unused method and make
report process more clear (#16441)
add d390e63a03 [enhancement](stream receiver) make stream receiver
exception safe (#16412)
add 796d51ae2e [enhance](fuzzy)set rewriteOrToInPredicateThreshold=2/10000
in fuzzy mode (#16456)
add 9114896178 [DecimalV3](opt) opt the function of decimalv3 to_string
logic (#16427)
add 1d0fdff98a [Bug](sort) disable 2phase read for sort by expressions
exclude slotref (#16460)
add f90d844a53 [improvement](compaction) enable compaction in
TABLET_NOTREADY (#16470)
add a4c28e6efa [Fix](Nereids) runtime filter cannot generate when
expression is cast. (#16120)
add 91325e5ca3 [fix](pipeline) incorrect result when disabling sharing
hash table (#16476)
add cf18de14b5 [fix](writer) add _is_closed state to DeltaWriter and avoid
write/close core after close (#16453)
add 289a4b2ea4 [fix](func) fix truncate float type result error (#16468)
add 81dbed70c2 [fix](Nereids) back off on tpch p1 (#16478)
add 254790c564 [fix](nereids) FE nereids use DateV2Literal instead of
'cast datev2' (#16386)
add afdaf2d70e [Doc](Jdbc Catlog) JDBC Catalog support `Insert` operation
(#16454)
add 2350ef1a64 Modify thrift_rpc_timeout_ms default value documentation
(#16464)
add 713c11b42b [typo](docs) Fix some errors in the description (#16452)
add 583001bd92 [Bug](share hash table) Support shared hash table on
Nereids (#16474)
add 2fd7833a12 [fix](doc): fix typo of tpch.md (#16229)
add 98c741d664 [fix](Nereids): `FilterOrSelf` shouldn't `And` all
predicates.. (#16491)
add 41947c73eb [Feature](array-function) Support array functions for
nested type datev2 and datetimev2 (#16382)
add 2883f67042 [fix](iceberg) update iceberg docs and add credential
properties (#16429)
add f6a20f844b [fix](hashjoin) join produce blocks with rows larger than
batch size: handle join with other conjuncts (#16402)
add e11437d1fe [fix](planner) npe in RewriteBinaryPredicatesRule (#16401)
add d956cb13af [Bug](point query) Reusable in PointQueryExecutor should
call init before add to LookupCache (#16489)
add b06e6b25c9 [improvement](fuzzy) print fuzzy session variable in FE
audit log (#16493)
add 666f7096f2 [Fix](multi catalog)(planner) Fix external table statistic
collection bug (#16486)
add f71fc3291f [Bug](fix) right anti join error result when batch size is
low (#16510)
add bb334de00f [enhancement](load) Change transaction limit from global
level to db level (#15830)
add a512469537 [fix](planner) cannot process more than one subquery in
disjunct (#16506)
add f0b0eedbc5 [fix](planner)group_concat lost order by info in second
phase merge agg (#16479)
add d1c6b81140 [Bug](log) add some log to find out bug (#16518)
add 2d7a9c9c11 add the batch interval time of sink in spark connector doc
(#16501)
add e6b0d94459 [enhancement][docs] add docs for newly added two compaction
method (#16529) (#16530)
add e1f1386395 [fix](cooldown) Rewrite update cooldown conf (#16488)
add 9f8753ffd2 [bugfix](vertical_compaction) fix base_compaction
delete_sign handler (#16469)
add 99581f8cc4 test
add 355c7ec28a save
add ccd8adf1c6 [test] (test) test modify branch (#14375)
add 3c831a393c [feature](struct-type) add the class ColumnStruct and class
DataTypeStruct implement (#14545)
add 7012cf8918 [WIP](struct-type) support struct-type in vectorize engine
(#15665)
add bd002d62e9 [fix](struct-type) struct create fix and add more struct
codes (#15879)
add fe34af5317 [feature](struct-type) adjust the vexpr for struct type
(#15669)
add 1516faeb8d save (#15906)
add b4eda8f95d save (#15908)
add 20d377b850 [fix](struct-type) support to remove double or single quote
(#15977)
add 4f0bf4f8b4 [fix](struct-type) support struct type insert (#15941)
add cd8825c2fd [hotfix](struct-type) Fix type descriptor make array load
core (#16020)
add d4b932ebd3 [fix](struct-type) select of struct return wrong result
(#16032)
add b516afae8e [fix](struct-type) fix insert null and explain for struct
type (#16054)
add 5b2becf847 [Feature](map) add map type to doris (#15966)
add 9169340881 [fix](map-type) fix compile error (#16413)
add 147b55b43c [fix](complex_type) fix clone_type_info function return
default scalar type (#16400)
add 30bb6ce581 rebase master and fix compile error
add 07ced590e6 [bug](struct-type) fix be ut and format
add 97d5166178 [bug](struct-type) fix be ut and format
add 5ee0f570c6 [bug](struct-type) fix be ut and format
add d331b47d0b [bug](struct-type) fix array type miss scale
add 150a21c89d [bug](regression-test) fix array regression test
add 585e8f78e3 [fix](struct-type) remove-empty-line
add a09024aab1 [fix] fix code for comment
add 552c49e129 [fix] fix fe ut
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (83a81944ac)
\
N -- N -- N refs/heads/struct-map-type (552c49e129)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/src/agent/task_worker_pool.cpp | 11 +-
be/src/common/status.h | 2 +
be/src/exec/olap_common.h | 13 +-
be/src/exprs/runtime_filter.h | 18 +-
be/src/http/action/stream_load_2pc.cpp | 14 +
be/src/http/action/stream_load_2pc.h | 1 +
be/src/olap/compaction.cpp | 4 +
be/src/olap/cumulative_compaction_policy.cpp | 8 +
be/src/olap/delta_writer.cpp | 13 +
be/src/olap/delta_writer.h | 1 +
be/src/olap/iterators.h | 3 +
be/src/olap/merger.cpp | 4 +
be/src/olap/olap_server.cpp | 2 +-
be/src/olap/reader.cpp | 5 +-
be/src/olap/reader.h | 5 +
be/src/olap/rowset/beta_rowset_reader.cpp | 8 +
be/src/olap/rowset/beta_rowset_reader.h | 2 +
be/src/olap/rowset/beta_rowset_writer.cpp | 5 +-
be/src/olap/rowset/beta_rowset_writer.h | 3 +-
be/src/olap/rowset/rowset_reader_context.h | 5 +
.../rowset/segment_v2/empty_segment_iterator.h | 1 +
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 8 +-
be/src/olap/rowset/vertical_beta_rowset_writer.cpp | 4 +
be/src/olap/tablet.cpp | 23 +-
be/src/olap/tablet.h | 7 +-
be/src/olap/types.h | 1 -
be/src/runtime/buffer_control_block.cpp | 39 -
be/src/runtime/buffer_control_block.h | 3 -
be/src/runtime/fragment_mgr.cpp | 23 -
be/src/runtime/plan_fragment_executor.cpp | 50 +-
be/src/runtime/plan_fragment_executor.h | 5 -
be/src/runtime/result_buffer_mgr.cpp | 11 -
be/src/runtime/result_buffer_mgr.h | 2 -
be/src/runtime/runtime_predicate.cpp | 7 +
be/src/service/backend_service.cpp | 6 -
be/src/service/backend_service.h | 2 -
be/src/service/point_query_executor.cpp | 5 +-
be/src/util/proto_util.h | 19 -
.../aggregate_function_collect.cpp | 4 +
be/src/vec/common/sort/sorter.cpp | 2 +-
be/src/vec/core/block.cpp | 39 +-
be/src/vec/core/block.h | 53 +-
be/src/vec/core/block_spill_reader.cpp | 15 +-
be/src/vec/core/block_spill_reader.h | 3 +-
be/src/vec/core/sort_cursor.h | 39 +-
be/src/vec/core/types.h | 66 ++
be/src/vec/data_types/data_type_array.cpp | 6 +-
be/src/vec/data_types/data_type_decimal.cpp | 11 +-
be/src/vec/data_types/data_type_time_v2.cpp | 23 +
be/src/vec/data_types/data_type_time_v2.h | 2 +
be/src/vec/exec/format/parquet/parquet_common.cpp | 4 -
be/src/vec/exec/format/parquet/parquet_common.h | 8 +-
be/src/vec/exec/format/parquet/parquet_pred_cmp.h | 823 ++++++++-------------
.../exec/format/parquet/vparquet_page_index.cpp | 8 +-
.../vec/exec/format/parquet/vparquet_page_index.h | 2 +-
be/src/vec/exec/format/parquet/vparquet_reader.cpp | 6 +-
be/src/vec/exec/join/process_hash_table_probe.h | 6 +
.../vec/exec/join/process_hash_table_probe_impl.h | 521 ++++++++++---
be/src/vec/exec/join/vhash_join_node.cpp | 6 +-
be/src/vec/exec/join/vhash_join_node.h | 5 +-
be/src/vec/exec/join/vnested_loop_join_node.cpp | 2 +-
be/src/vec/exec/scan/new_olap_scanner.cpp | 8 +-
be/src/vec/exec/vaggregation_node.cpp | 3 +
be/src/vec/exec/vexchange_node.cpp | 2 +-
be/src/vec/exprs/vliteral.cpp | 15 +-
.../vec/functions/array/function_array_distinct.h | 6 +
.../vec/functions/array/function_array_element.h | 9 +
be/src/vec/functions/array/function_array_index.h | 17 +
be/src/vec/functions/array/function_array_join.h | 6 +
be/src/vec/functions/array/function_array_remove.h | 18 +-
be/src/vec/functions/array/function_array_set.h | 2 +
be/src/vec/functions/array/function_array_sort.h | 6 +
.../vec/functions/array/function_arrays_overlap.h | 8 +
be/src/vec/functions/function_cast.h | 1 +
be/src/vec/functions/function_rpc.cpp | 2 +-
be/src/vec/io/io_helper.h | 15 -
be/src/vec/olap/block_reader.cpp | 12 +-
be/src/vec/olap/vcollect_iterator.cpp | 177 +++++
be/src/vec/olap/vcollect_iterator.h | 27 +
be/src/vec/olap/vertical_block_reader.cpp | 4 +-
be/src/vec/olap/vertical_merge_iterator.cpp | 15 +
be/src/vec/olap/vertical_merge_iterator.h | 3 +
be/src/vec/runtime/vdata_stream_recvr.cpp | 68 +-
be/src/vec/runtime/vdata_stream_recvr.h | 23 +-
be/src/vec/sink/vdata_stream_sender.h | 2 +-
be/src/vec/utils/histogram_helpers.hpp | 27 +-
be/test/CMakeLists.txt | 1 -
be/test/olap/rowid_conversion_test.cpp | 27 +-
be/test/runtime/buffer_control_block_test.cpp | 184 -----
be/test/vec/core/block_spill_test.cpp | 105 +--
build-support/IntelliJ-code-format.xml | 4 +
docs/en/docs/admin-manual/config/be-config.md | 2 +-
docs/en/docs/admin-manual/config/fe-config.md | 22 +
.../memory-management/be-oom-analysis.md | 4 +-
.../admin-manual/maint-monitor/monitor-alert.md | 2 +-
docs/en/docs/advanced/best-practice/compaction.md | 71 ++
docs/en/docs/advanced/compute_node.md | 2 +-
docs/en/docs/advanced/resource.md | 2 +-
.../import/import-scenes/load-data-convert.md | 6 +-
docs/en/docs/ecosystem/spark-doris-connector.md | 1 +
docs/en/docs/lakehouse/multi-catalog/iceberg.md | 48 ++
docs/en/docs/lakehouse/multi-catalog/jdbc.md | 32 +
docs/en/docs/releasenotes/release-1.2.0.md | 2 +-
.../Create/CREATE-RESOURCE.md | 4 +-
.../Load/STREAM-LOAD.md | 212 +++---
docs/sidebars.json | 3 +-
docs/zh-CN/docs/admin-manual/config/be-config.md | 2 +-
docs/zh-CN/docs/admin-manual/config/fe-config.md | 22 +
.../memory-management/be-oom-analysis.md | 2 +-
.../admin-manual/maint-monitor/monitor-alert.md | 2 +-
.../docs/advanced/best-practice/compaction.md | 67 ++
docs/zh-CN/docs/advanced/compute_node.md | 4 +-
docs/zh-CN/docs/advanced/resource.md | 2 +-
docs/zh-CN/docs/benchmark/tpch.md | 2 +-
.../import/import-scenes/load-data-convert.md | 6 +-
docs/zh-CN/docs/ecosystem/spark-doris-connector.md | 1 +
docs/zh-CN/docs/lakehouse/multi-catalog/iceberg.md | 11 +-
docs/zh-CN/docs/lakehouse/multi-catalog/jdbc.md | 29 +
docs/zh-CN/docs/releasenotes/release-1.2.0.md | 2 +-
.../Create/CREATE-RESOURCE.md | 4 +-
.../Load/BROKER-LOAD.md | 2 +-
.../Load/STREAM-LOAD.md | 196 ++---
.../main/java/org/apache/doris/common/Config.java | 26 +-
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 15 +-
fe/fe-core/src/main/cup/sql_parser.cup | 4 +
.../doris/alter/MaterializedViewHandler.java | 2 +-
.../java/org/apache/doris/alter/RollupJobV2.java | 2 +-
.../apache/doris/alter/SchemaChangeHandler.java | 2 +-
.../org/apache/doris/alter/SchemaChangeJobV2.java | 2 +-
.../org/apache/doris/analysis/AggregateInfo.java | 7 +-
.../doris/analysis/AlterDatabaseQuotaStmt.java | 7 +-
.../java/org/apache/doris/analysis/Analyzer.java | 38 +-
.../org/apache/doris/analysis/DataDescription.java | 19 +-
.../apache/doris/analysis/FunctionCallExpr.java | 68 +-
.../java/org/apache/doris/analysis/SelectStmt.java | 18 +-
.../org/apache/doris/analysis/ShowDataStmt.java | 6 +
.../org/apache/doris/analysis/ShowMTMVJobStmt.java | 33 +-
.../apache/doris/analysis/ShowMTMVTaskStmt.java | 29 +-
.../org/apache/doris/analysis/StmtRewriter.java | 21 +-
.../java/org/apache/doris/analysis/TableRef.java | 3 +
.../java/org/apache/doris/backup/RestoreJob.java | 12 +-
.../apache/doris/catalog/CatalogRecycleBin.java | 6 +-
.../java/org/apache/doris/catalog/Database.java | 31 +
.../main/java/org/apache/doris/catalog/Env.java | 30 +-
.../java/org/apache/doris/catalog/OlapTable.java | 5 +-
.../java/org/apache/doris/catalog/S3Resource.java | 34 +-
.../org/apache/doris/catalog/TableProperty.java | 6 +-
.../main/java/org/apache/doris/catalog/Tablet.java | 30 +-
.../apache/doris/catalog/TabletInvertedIndex.java | 103 ++-
.../java/org/apache/doris/catalog/TabletMeta.java | 60 +-
.../doris/catalog/external/HMSExternalTable.java | 1 +
.../org/apache/doris/common/proc/DbsProcDir.java | 3 +
.../org/apache/doris/common/util/ParseUtil.java | 13 +
.../org/apache/doris/cooldown/CooldownConf.java | 76 +-
.../apache/doris/cooldown/CooldownConfHandler.java | 138 ++++
.../apache/doris/cooldown/CooldownConfList.java | 53 ++
.../org/apache/doris/cooldown/CooldownHandler.java | 192 -----
.../org/apache/doris/cooldown/CooldownJob.java | 401 ----------
.../apache/doris/datasource/InternalCatalog.java | 16 +-
.../org/apache/doris/journal/JournalEntity.java | 6 +-
.../src/main/java/org/apache/doris/load/Load.java | 2 +-
.../doris/load/sync/canal/CanalSyncChannel.java | 5 +-
.../org/apache/doris/master/ReportHandler.java | 31 +-
.../java/org/apache/doris/mtmv/MTMVJobManager.java | 3 +-
.../org/apache/doris/mtmv/MTMVTaskManager.java | 3 +-
.../doris/nereids/analyzer/UnboundRelation.java | 34 +-
.../glue/translator/ExpressionTranslator.java | 11 -
.../glue/translator/PhysicalPlanTranslator.java | 1 +
.../glue/translator/RuntimeFilterTranslator.java | 17 +-
.../jobs/batch/NereidsRewriteJobExecutor.java | 4 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 34 +-
.../processor/post/RuntimeFilterContext.java | 4 +-
.../processor/post/RuntimeFilterGenerator.java | 61 +-
.../doris/nereids/rules/analysis/BindRelation.java | 4 +-
.../mv/AbstractSelectMaterializedIndexRule.java | 4 +
.../mv/SelectMaterializedIndexWithAggregate.java | 16 +-
.../SelectMaterializedIndexWithoutAggregate.java | 12 +-
.../rules/rewrite/logical/AdjustNullable.java | 4 +-
.../rewrite/logical/PushFilterInsideJoin.java | 2 -
.../PropagateNullableOnDateLikeV2Args.java} | 27 +-
.../expressions/functions/agg/GroupConcat.java | 2 -
.../expressions/functions/scalar/DateDiff.java | 4 +-
.../expressions/functions/scalar/DayName.java | 4 +-
.../expressions/functions/scalar/DayOfWeek.java | 4 +-
.../expressions/functions/scalar/DayOfYear.java | 4 +-
.../expressions/functions/scalar/DaysAdd.java | 5 +-
.../expressions/functions/scalar/DaysDiff.java | 4 +-
.../expressions/functions/scalar/DaysSub.java | 5 +-
.../trees/expressions/functions/scalar/Hour.java | 4 +-
.../expressions/functions/scalar/HourCeil.java | 4 +-
.../expressions/functions/scalar/HourFloor.java | 4 +-
.../expressions/functions/scalar/HoursAdd.java | 5 +-
.../expressions/functions/scalar/HoursDiff.java | 4 +-
.../expressions/functions/scalar/HoursSub.java | 5 +-
.../expressions/functions/scalar/LastDay.java | 4 +-
.../trees/expressions/functions/scalar/Minute.java | 4 +-
.../expressions/functions/scalar/MinuteCeil.java | 4 +-
.../expressions/functions/scalar/MinuteFloor.java | 4 +-
.../expressions/functions/scalar/MinutesAdd.java | 4 +-
.../expressions/functions/scalar/MinutesDiff.java | 4 +-
.../expressions/functions/scalar/MinutesSub.java | 4 +-
.../trees/expressions/functions/scalar/Month.java | 4 +-
.../expressions/functions/scalar/MonthName.java | 4 +-
.../expressions/functions/scalar/MonthsAdd.java | 4 +-
.../expressions/functions/scalar/MonthsDiff.java | 4 +-
.../expressions/functions/scalar/MonthsSub.java | 5 +-
.../expressions/functions/scalar/Quarter.java | 4 +-
.../trees/expressions/functions/scalar/Second.java | 4 +-
.../expressions/functions/scalar/SecondCeil.java | 4 +-
.../expressions/functions/scalar/SecondFloor.java | 4 +-
.../expressions/functions/scalar/SecondsAdd.java | 4 +-
.../expressions/functions/scalar/SecondsDiff.java | 4 +-
.../expressions/functions/scalar/SecondsSub.java | 4 +-
.../expressions/functions/scalar/TimeDiff.java | 4 +-
.../expressions/functions/scalar/Timestamp.java | 4 +-
.../trees/expressions/functions/scalar/ToDays.java | 4 +-
.../expressions/functions/scalar/ToMonday.java | 4 +-
.../functions/scalar/UnixTimestamp.java | 8 +-
.../trees/expressions/functions/scalar/Week.java | 4 +-
.../expressions/functions/scalar/WeekOfYear.java | 4 +-
.../expressions/functions/scalar/Weekday.java | 4 +-
.../expressions/functions/scalar/WeeksAdd.java | 5 +-
.../expressions/functions/scalar/WeeksDiff.java | 4 +-
.../expressions/functions/scalar/WeeksSub.java | 5 +-
.../trees/expressions/functions/scalar/Year.java | 4 +-
.../expressions/functions/scalar/YearWeek.java | 4 +-
.../expressions/functions/scalar/YearsAdd.java | 5 +-
.../expressions/functions/scalar/YearsDiff.java | 4 +-
.../expressions/functions/scalar/YearsSub.java | 5 +-
.../nereids/trees/plans/logical/LogicalFilter.java | 7 +-
.../trees/plans/logical/LogicalOlapScan.java | 44 +-
.../trees/plans/physical/RuntimeFilter.java | 7 +-
.../org/apache/doris/nereids/types/DataType.java | 4 +
.../apache/doris/nereids/util/ExpressionUtils.java | 7 +
.../org/apache/doris/nereids/util/PlanUtils.java | 5 +-
.../java/org/apache/doris/persist/EditLog.java | 15 +-
.../org/apache/doris/persist/OperationType.java | 4 +-
.../doris/persist/meta/MetaPersistMethod.java | 6 -
.../doris/persist/meta/PersistMetaModules.java | 2 +-
.../org/apache/doris/planner/AggregationNode.java | 4 +
.../org/apache/doris/planner/HashJoinNode.java | 2 +-
.../org/apache/doris/planner/JoinNodeBase.java | 29 +-
.../apache/doris/planner/NestedLoopJoinNode.java | 1 +
.../org/apache/doris/planner/OlapScanNode.java | 10 +
.../org/apache/doris/planner/OriginalPlanner.java | 14 +-
.../org/apache/doris/planner/PlanFragment.java | 4 +
.../java/org/apache/doris/planner/PlanNode.java | 9 +
.../java/org/apache/doris/plugin/AuditEvent.java | 7 +
.../java/org/apache/doris/qe/ConnectProcessor.java | 3 +-
.../main/java/org/apache/doris/qe/Coordinator.java | 31 +-
.../java/org/apache/doris/qe/SessionVariable.java | 61 +-
.../main/java/org/apache/doris/qe/VariableMgr.java | 3 +
.../doris/rewrite/RewriteBinaryPredicatesRule.java | 17 +-
.../apache/doris/statistics/HiveAnalysisTask.java | 21 +-
.../doris/transaction/DatabaseTransactionMgr.java | 9 +-
.../doris/analysis/AlterDatabaseQuotaStmtTest.java | 23 +
.../apache/doris/analysis/DataDescriptionTest.java | 12 +
.../org/apache/doris/backup/CatalogMocker.java | 10 +-
.../org/apache/doris/catalog/CatalogTestUtil.java | 4 +-
.../org/apache/doris/catalog/OlapTableTest.java | 4 +-
.../java/org/apache/doris/catalog/TabletTest.java | 2 +-
.../doris/clone/ClusterLoadStatisticsTest.java | 6 +-
.../org/apache/doris/clone/RebalancerTestUtil.java | 2 +-
.../org/apache/doris/common/GenericPoolTest.java | 27 -
.../apache/doris/common/proc/DbsProcDirTest.java | 8 +-
.../org/apache/doris/common/util/UnitTestUtil.java | 2 +-
.../org/apache/doris/cooldown/CooldownJobTest.java | 130 ----
.../org/apache/doris/http/DorisHttpTestCase.java | 2 +-
.../org/apache/doris/load/DeleteHandlerTest.java | 2 +-
.../org/apache/doris/mtmv/ShowMTMVJobStmtTest.java | 30 +-
.../apache/doris/mtmv/ShowMTMVTaskStmtTest.java | 29 +-
.../nereids/postprocess/RuntimeFilterTest.java | 30 +-
.../join/InnerJoinLAsscomProjectTest.java | 28 +-
.../exploration/join/InnerJoinLAsscomTest.java | 16 +-
.../join/InnerJoinLeftAssociateTest.java | 4 +-
.../join/InnerJoinRightAssociateTest.java | 4 +-
.../rules/exploration/join/JoinCommuteTest.java | 2 +-
.../rules/exploration/join/JoinExchangeTest.java | 6 +-
.../join/OuterJoinLAsscomProjectTest.java | 20 +-
.../exploration/join/OuterJoinLAsscomTest.java | 16 +-
.../SemiJoinLogicalJoinTransposeProjectTest.java | 12 +-
.../join/SemiJoinLogicalJoinTransposeTest.java | 12 +-
.../join/SemiJoinSemiJoinTransposeProjectTest.java | 4 +-
.../join/SemiJoinSemiJoinTransposeTest.java | 4 +-
.../nereids/rules/mv/SelectRollupIndexTest.java | 59 ++
...eOuterTest.java => EliminateOuterJoinTest.java} | 8 +-
.../logical/ExtractFilterFromCrossJoinTest.java | 2 +-
.../rewrite/logical/PushFilterInsideJoinTest.java | 4 +-
.../logical/PushdownFilterThroughJoinTest.java | 10 +-
.../rules/rewrite/logical/ReorderJoinTest.java | 54 +-
.../doris/nereids/util/LogicalPlanBuilder.java | 16 +-
.../apache/doris/utframe/MockedBackendFactory.java | 7 -
gensrc/script/doris_builtins_functions.py | 12 +-
gensrc/thrift/BackendService.thrift | 4 -
gensrc/thrift/MasterService.thrift | 4 +-
regression-test/conf/regression-conf.groovy | 2 +-
.../correctness/test_subquery_in_disjunction.out | 31 +
.../test_left_anti_join_batch_size.out | 606 +++++++++++++++
.../load/insert/test_array_insert_into_select.out | 13 +
.../data/load_p0/stream_load/test_orc_case.orc | Bin 0 -> 53487 bytes
.../load_p0/stream_load/test_parquet_case.parquet | Bin 0 -> 83291 bytes
.../load_p0/stream_load/test_parquet_orc_case.out | 409 ++++++++++
.../nereids_p0/group_concat/test_group_concat.out | 3 +
.../tpch/q1.out | 0
.../tpch/q10.out | 0
.../tpch/q11.out | 0
.../tpch/q12.out | 0
.../tpch/q13.out | 0
.../tpch/q14.out | 4 +-
.../tpch/q15.out | 0
.../tpch/q16.out | 0
.../tpch/q17.out | 0
.../tpch/q18.out | 0
.../tpch/q19.out | 0
.../tpch/q2.out | 0
.../tpch/q20.out | 0
.../tpch/q21.out | 0
.../tpch/q22.out | 0
.../tpch/q3.out | 0
.../tpch/q4.out | 0
.../tpch/q5.out | 0
.../tpch/q6.out | 0
.../tpch/q7.out | 0
.../tpch/q8.out | 0
.../tpch/q9.out | 0
.../query_p0/group_concat/test_group_concat.out | 3 +
regression-test/data/query_p0/sort/sort.out | 32 +
.../test_array_aggregation_functions.out | 28 +-
.../array_functions/test_array_functions.out | 259 ++++++-
.../test_array_functions_by_literal.out | 96 +++
.../cast_function/test_cast_string_to_array.out | 6 +
.../sql_functions/math_functions/test_round.out | 5 +
regression-test/data/tpcds_sf1_p1/sql/q10.out | 8 +
regression-test/data/tpcds_sf1_p1/sql/q35.out | 103 +++
regression-test/data/tpcds_sf1_p1/sql/q45.out | 22 +
.../pipeline/p0/conf/regression-conf.groovy | 2 +-
.../cold_heat_separation/policy/alter.groovy | 2 -
.../cold_heat_separation/policy/create.groovy | 2 -
.../suites/cold_heat_separation/policy/drop.groovy | 2 -
.../suites/cold_heat_separation/policy/show.groovy | 2 -
.../use_policy/alter_table_add_policy.groovy | 2 -
.../create_table_use_partition_policy.groovy | 2 -
.../use_policy/create_table_use_policy.groovy | 2 -
.../use_policy/modify_partition_add_policy.groovy | 2 -
.../use_policy/use_default_storage_policy.groovy | 2 -
.../test_subquery_in_disjunction.groovy | 32 +-
.../test_left_anti_join_batch_size.sql | 21 +
.../suites/datatype_p0/date/test_date_exprs.groovy | 2 +-
.../hive/test_external_hive.groovy | 49 --
.../insert/test_array_insert_into_select.groovy | 65 ++
.../broker_load/ddl/orc_s3_case1_create.sql | 111 +++
.../load_p0/broker_load/ddl/orc_s3_case1_drop.sql | 1 +
.../broker_load/ddl/orc_s3_case2_create.sql | 111 +++
.../load_p0/broker_load/ddl/orc_s3_case2_drop.sql | 1 +
.../broker_load/ddl/orc_s3_case3_create.sql | 19 +
.../load_p0/broker_load/ddl/orc_s3_case3_drop.sql | 1 +
.../broker_load/ddl/orc_s3_case4_create.sql | 14 +
.../load_p0/broker_load/ddl/orc_s3_case4_drop.sql | 1 +
.../broker_load/ddl/orc_s3_case5_create.sql | 26 +
.../load_p0/broker_load/ddl/orc_s3_case5_drop.sql | 1 +
.../broker_load/ddl/orc_s3_case6_create.sql | 111 +++
.../load_p0/broker_load/ddl/orc_s3_case6_drop.sql | 1 +
.../broker_load/ddl/orc_s3_case7_create.sql | 14 +
.../load_p0/broker_load/ddl/orc_s3_case7_drop.sql | 1 +
.../broker_load/ddl/orc_s3_case8_create.sql | 15 +
.../load_p0/broker_load/ddl/orc_s3_case8_drop.sql | 1 +
.../broker_load/ddl/orc_s3_case9_create.sql | 36 +
.../load_p0/broker_load/ddl/orc_s3_case9_drop.sql | 1 +
.../load_p0/broker_load/test_broker_load.groovy | 95 ++-
.../stream_load/test_parquet_orc_case.groovy | 210 ++++++
.../group_concat/test_group_concat.groovy | 3 +
.../suites/nereids_syntax_p0/runtime_filter.groovy | 2 +-
.../ddl/customer.sql | 0
.../ddl/lineitem.sql | 0
.../ddl/nation.sql | 0
.../ddl/orders.sql | 0
.../ddl/part.sql | 0
.../ddl/partsupp.sql | 0
.../ddl/region.sql | 0
.../ddl/revenue1.sql | 0
.../ddl/supplier.sql | 0
.../load.groovy | 0
.../tpch/q1.groovy | 0
.../tpch/q10.groovy | 0
.../tpch/q11.groovy | 0
.../tpch/q12.groovy | 0
.../tpch/q13.groovy | 0
.../tpch/q14.groovy | 0
.../tpch/q15.groovy | 0
.../tpch/q16.groovy | 0
.../tpch/q17.groovy | 0
.../tpch/q18.groovy | 0
.../tpch/q19.groovy | 0
.../tpch/q2.groovy | 0
.../tpch/q20.groovy | 0
.../tpch/q21.groovy | 0
.../tpch/q22.groovy | 0
.../tpch/q3.groovy | 0
.../tpch/q4.groovy | 0
.../tpch/q5.groovy | 0
.../tpch/q6.groovy | 0
.../tpch/q7.groovy | 0
.../tpch/q8.groovy | 0
.../tpch/q9.groovy | 0
.../query_p0/group_concat/test_group_concat.groovy | 3 +
.../suites/query_p0/join/test_join.groovy | 3 +-
regression-test/suites/query_p0/sort/sort.groovy | 13 +
.../test_array_aggregation_functions.groovy | 16 +-
.../array_functions/test_array_functions.groovy | 48 +-
.../test_array_functions_by_literal.groovy | 34 +-
.../cast_function/test_cast_string_to_array.groovy | 6 +
.../sql_functions/math_functions/test_round.groovy | 3 +
regression-test/suites/tpcds_sf1_p1/sql/q10.sql | 2 -
regression-test/suites/tpcds_sf1_p1/sql/q35.sql | 2 -
regression-test/suites/tpcds_sf1_p1/sql/q45.sql | 2 -
.../cpp_function_service_demo.cpp | 4 +
416 files changed, 6150 insertions(+), 3103 deletions(-)
delete mode 100644 be/test/runtime/buffer_control_block_test.cpp
create mode 100644 docs/en/docs/advanced/best-practice/compaction.md
create mode 100644 docs/zh-CN/docs/advanced/best-practice/compaction.md
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/cooldown/CooldownConfHandler.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/cooldown/CooldownConfList.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/cooldown/CooldownHandler.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/cooldown/CooldownJob.java
rename
fe/fe-core/src/main/java/org/apache/doris/{cooldown/CooldownException.java =>
nereids/trees/expressions/functions/PropagateNullableOnDateLikeV2Args.java}
(55%)
delete mode 100644
fe/fe-core/src/test/java/org/apache/doris/cooldown/CooldownJobTest.java
rename
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/logical/{EliminateOuterTest.java
=> EliminateOuterJoinTest.java} (90%)
create mode 100644
regression-test/data/correctness_p0/test_left_anti_join_batch_size.out
create mode 100644
regression-test/data/load/insert/test_array_insert_into_select.out
create mode 100644 regression-test/data/load_p0/stream_load/test_orc_case.orc
create mode 100644
regression-test/data/load_p0/stream_load/test_parquet_case.parquet
create mode 100644
regression-test/data/load_p0/stream_load/test_parquet_orc_case.out
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q1.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q10.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q11.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q12.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q13.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q14.out
(82%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q15.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q16.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q17.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q18.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q19.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q2.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q20.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q21.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q22.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q3.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q4.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q5.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q6.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q7.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q8.out
(100%)
rename regression-test/data/{nereids_tpch_p1 => nereids_tpch_p0}/tpch/q9.out
(100%)
create mode 100644 regression-test/data/tpcds_sf1_p1/sql/q10.out
create mode 100644 regression-test/data/tpcds_sf1_p1/sql/q35.out
create mode 100644 regression-test/data/tpcds_sf1_p1/sql/q45.out
create mode 100644
regression-test/suites/correctness_p0/test_left_anti_join_batch_size.sql
delete mode 100644
regression-test/suites/external_table_emr_p2/hive/test_external_hive.groovy
create mode 100644
regression-test/suites/load/insert/test_array_insert_into_select.groovy
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case1_create.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case1_drop.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case2_create.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case2_drop.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case3_create.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case3_drop.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case4_create.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case4_drop.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case5_create.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case5_drop.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case6_create.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case6_drop.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case7_create.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case7_drop.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case8_create.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case8_drop.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case9_create.sql
create mode 100644
regression-test/suites/load_p0/broker_load/ddl/orc_s3_case9_drop.sql
create mode 100644
regression-test/suites/load_p0/stream_load/test_parquet_orc_case.groovy
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/ddl/customer.sql (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/ddl/lineitem.sql (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/ddl/nation.sql (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/ddl/orders.sql (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/ddl/part.sql (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/ddl/partsupp.sql (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/ddl/region.sql (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/ddl/revenue1.sql (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/ddl/supplier.sql (100%)
rename regression-test/suites/{nereids_tpch_p1 => nereids_tpch_p0}/load.groovy
(100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q1.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q10.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q11.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q12.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q13.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q14.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q15.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q16.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q17.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q18.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q19.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q2.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q20.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q21.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q22.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q3.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q4.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q5.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q6.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q7.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q8.groovy (100%)
rename regression-test/suites/{nereids_tpch_p1 =>
nereids_tpch_p0}/tpch/q9.groovy (100%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
