This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch auto-pick-58245-branch-4.0
in repository https://gitbox.apache.org/repos/asf/doris.git
discard d8923d0b62e [fix](mtmv) Fix sync materialized view use wrong check
method when in the same regression test database (#58245)
add 2cae54834e1 branch-4.0: [fix](variable) fix unset global variable in
non-master FE #58285 (#58381)
add 51548db83bf branch-4.0: [fix](iceberg) Add FE refresh logging after
ALTER TABLE … EXECUTE #58355 (#58379)
add 0c9160302a8 branch-4.0: (enhanced) completed the function : century
from duckdb #57893 (#58375)
add b5a746a0f51 branch-4.0: [fix](test connection) Fix the check when only
the bucket root directory is present. #58359 (#58378)
add 919f84c5cc0 branch-4.0: [fix](jni)Adjust the statistical time of JNI
appenddata. #58224 (#58386)
add 5657f73632d branch-4.0: [chore](plan) remove ColumnStats and mem
layout on tuple #57912 (#58414)
add 6bd501c97c5 branch-4.0: [chore](function) remove useless trait
PropagateNullableOnDateV2LikeArgs #57920 (#58415)
add f50d7e75e3e branch-4.0: [fix](sql-cache) make test_query_cache_hit
work #58349 (#58387)
add 6a23383f000 branch-4.0: [fix](filecache) fix regression failure due to
data compression #58246 (#58398)
add 66269b5bcf8 branch-4.0: [fix](test)Validate database is empty before
DROP DATABASE (#58344) (#58423)
add 871f1ff16d6 branch-4.0: [fix](mtmv) Fix materialized view regression
test err #58018 (#58402)
add a1dbbcd76a2 branch-4.0: [fix](partial update) fix partial update
always failed after create rollup/MV #58003 (#58393)
add 8a164fff938 branch-4.0: [fix](inverted index) fix fs set when meet
segment corruption #58317 (#58392)
add 2849d727ceb branch-4.0: [fix](regression) Add auth regression tests
for Iceberg/Paimon system tables #58298 (#58400)
add 692dd73330d branch-4.0: [fix](cloud)Support
`cloud_tablet_rebalancer_interval_second` config dynamic modification #58198
(#58377)
add bb8c52cab86 branch-4.0: [fix](function)Let second and microsecond
functions deal time literal #56659 (#58419)
add 3b4eecb541b branch-4.0: [fix](mtmv)fix MTMV staying in sync after base
table recreate column #58087 (#58380)
add 466fd04e2d4 [fix](mtmv) Fix sync materialized view use wrong check
method when in the same regression test database (#58245)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (d8923d0b62e)
\
N -- N -- N refs/heads/auto-pick-58245-branch-4.0 (466fd04e2d4)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/src/olap/memtable.cpp | 6 +-
.../olap/rowset/segment_v2/index_file_reader.cpp | 5 +-
be/src/olap/rowset/segment_v2/segment.cpp | 3 +
be/src/vec/functions/date_time_transforms.h | 16 +
.../vec/functions/function_time_value_to_field.cpp | 7 +
be/src/vec/functions/to_time_function.cpp | 7 +-
.../rowset/segment_v2/segment_corruption_test.cpp | 360 +++++++++++++++++++++
be/test/vec/function/function_time_test.cpp | 56 ++++
.../java/org/apache/doris/avro/AvroJNIScanner.java | 2 +
.../apache/doris/hudi/HadoopHudiJniScanner.java | 2 +
.../doris/iceberg/IcebergSysTableJniScanner.java | 5 +
.../apache/doris/common/jni/MockJniScanner.java | 2 +
.../doris/maxcompute/MaxComputeJniScanner.java | 3 +
.../org/apache/doris/paimon/PaimonJniScanner.java | 9 +-
.../doris/paimon/PaimonSysTableJniScanner.java | 9 +-
.../trinoconnector/TrinoConnectorJniScanner.java | 3 +
.../org/apache/doris/catalog/PrimitiveType.java | 5 -
.../main/java/org/apache/doris/common/Config.java | 2 +-
.../java/org/apache/doris/alter/RollupJobV2.java | 1 -
.../org/apache/doris/alter/SchemaChangeJobV2.java | 1 -
.../org/apache/doris/analysis/AggregateInfo.java | 4 +-
.../org/apache/doris/analysis/DescriptorTable.java | 150 +--------
.../main/java/org/apache/doris/analysis/Expr.java | 12 -
.../org/apache/doris/analysis/SlotDescriptor.java | 140 +-------
.../java/org/apache/doris/analysis/TableRef.java | 9 -
.../org/apache/doris/analysis/TupleDescriptor.java | 261 +--------------
.../doris/catalog/BuiltinScalarFunctions.java | 2 +
.../java/org/apache/doris/catalog/ColumnStats.java | 176 ----------
.../main/java/org/apache/doris/catalog/MTMV.java | 1 +
.../doris/cloud/catalog/CloudTabletRebalancer.java | 20 +-
.../apache/doris/datasource/FileQueryScanNode.java | 7 -
.../AbstractIcebergConnectivityTester.java | 13 +
.../AbstractS3CompatibleConnectivityTester.java | 17 +-
.../IcebergGlueMetaStoreConnectivityTester.java | 11 +-
.../IcebergRestConnectivityTester.java | 15 -
.../doris/source/RemoteDorisScanNode.java | 3 -
.../doris/datasource/jdbc/source/JdbcScanNode.java | 7 +-
.../doris/datasource/odbc/source/OdbcScanNode.java | 7 +-
.../source/TrinoConnectorScanNode.java | 3 -
.../datasource/tvf/source/MetadataScanNode.java | 1 -
.../java/org/apache/doris/mtmv/MTMVPlanUtil.java | 3 +-
.../glue/translator/ExpressionTranslator.java | 6 +-
.../glue/translator/PhysicalPlanTranslator.java | 52 +--
.../glue/translator/PlanTranslatorContext.java | 1 -
.../doris/nereids/jobs/executor/Rewriter.java | 3 +
.../mv/PreMaterializedViewRewriter.java | 1 -
.../trees/expressions/TimestampArithmetic.java | 20 +-
.../PropagateNullableOnDateOrTimeLikeV2Args.java | 39 ---
.../executable/DateTimeExtractAndTransform.java | 31 ++
.../functions/scalar/{Year.java => Century.java} | 22 +-
.../expressions/functions/scalar/DateDiff.java | 4 +-
.../expressions/functions/scalar/DayName.java | 4 +-
.../expressions/functions/scalar/DayOfMonth.java | 4 +-
.../expressions/functions/scalar/DayOfWeek.java | 4 +-
.../expressions/functions/scalar/DayOfYear.java | 4 +-
.../expressions/functions/scalar/DaySecondAdd.java | 4 +-
.../expressions/functions/scalar/DaysAdd.java | 4 +-
.../expressions/functions/scalar/DaysDiff.java | 4 +-
.../expressions/functions/scalar/DaysSub.java | 4 +-
.../trees/expressions/functions/scalar/Hour.java | 4 +-
.../expressions/functions/scalar/HoursAdd.java | 4 +-
.../expressions/functions/scalar/HoursDiff.java | 4 +-
.../expressions/functions/scalar/HoursSub.java | 4 +-
.../expressions/functions/scalar/LastDay.java | 4 +-
.../functions/scalar/MicroSecondTimestamp.java | 4 +-
.../functions/scalar/MicroSecondsAdd.java | 4 +-
.../functions/scalar/MicroSecondsDiff.java | 4 +-
.../functions/scalar/MicroSecondsSub.java | 4 +-
.../expressions/functions/scalar/Microsecond.java | 8 +-
.../functions/scalar/MilliSecondTimestamp.java | 4 +-
.../functions/scalar/MilliSecondsAdd.java | 4 +-
.../functions/scalar/MilliSecondsDiff.java | 4 +-
.../functions/scalar/MilliSecondsSub.java | 4 +-
.../trees/expressions/functions/scalar/Minute.java | 4 +-
.../expressions/functions/scalar/MinutesAdd.java | 4 +-
.../expressions/functions/scalar/MinutesDiff.java | 4 +-
.../expressions/functions/scalar/MinutesSub.java | 4 +-
.../trees/expressions/functions/scalar/Month.java | 4 +-
.../expressions/functions/scalar/MonthName.java | 4 +-
.../expressions/functions/scalar/MonthsAdd.java | 4 +-
.../functions/scalar/MonthsBetween.java | 4 +-
.../expressions/functions/scalar/MonthsDiff.java | 4 +-
.../expressions/functions/scalar/MonthsSub.java | 4 +-
.../expressions/functions/scalar/Quarter.java | 4 +-
.../expressions/functions/scalar/QuartersAdd.java | 4 +-
.../expressions/functions/scalar/QuartersDiff.java | 4 +-
.../expressions/functions/scalar/QuartersSub.java | 4 +-
.../trees/expressions/functions/scalar/Second.java | 4 +-
.../functions/scalar/SecondTimestamp.java | 4 +-
.../expressions/functions/scalar/SecondsAdd.java | 4 +-
.../expressions/functions/scalar/SecondsDiff.java | 4 +-
.../expressions/functions/scalar/SecondsSub.java | 4 +-
.../trees/expressions/functions/scalar/Time.java | 4 +-
.../expressions/functions/scalar/TimeDiff.java | 4 +-
.../expressions/functions/scalar/Timestamp.java | 4 +-
.../trees/expressions/functions/scalar/ToDays.java | 4 +-
.../expressions/functions/scalar/ToMonday.java | 4 +-
.../trees/expressions/functions/scalar/Week.java | 4 +-
.../expressions/functions/scalar/WeekOfYear.java | 4 +-
.../expressions/functions/scalar/Weekday.java | 4 +-
.../expressions/functions/scalar/WeeksAdd.java | 4 +-
.../expressions/functions/scalar/WeeksDiff.java | 4 +-
.../expressions/functions/scalar/WeeksSub.java | 4 +-
.../trees/expressions/functions/scalar/Year.java | 4 +-
.../expressions/functions/scalar/YearOfWeek.java | 4 +-
.../expressions/functions/scalar/YearWeek.java | 4 +-
.../expressions/functions/scalar/YearsAdd.java | 4 +-
.../expressions/functions/scalar/YearsDiff.java | 4 +-
.../expressions/functions/scalar/YearsSub.java | 4 +-
.../expressions/visitor/ScalarFunctionVisitor.java | 5 +
.../trees/plans/commands/ExecuteActionCommand.java | 23 ++
.../trees/plans/commands/UnsetVariableCommand.java | 8 +-
.../org/apache/doris/nereids/types/DataType.java | 4 -
.../org/apache/doris/planner/HashJoinNode.java | 76 -----
.../org/apache/doris/planner/OlapScanNode.java | 7 -
.../org/apache/doris/planner/ResultFileSink.java | 3 -
.../java/org/apache/doris/planner/SortNode.java | 16 -
.../java/org/apache/doris/qe/ConnectProcessor.java | 12 +-
.../java/org/apache/doris/qe/SessionVariable.java | 9 -
.../main/java/org/apache/doris/qe/VariableMgr.java | 4 +-
.../apache/doris/statistics/AggStatsDerive.java | 87 -----
.../doris/statistics/AnalyticEvalStatsDerive.java | 41 ---
.../doris/statistics/AssertNumRowsStatsDerive.java | 30 --
.../apache/doris/statistics/BaseStatsDerive.java | 152 ---------
.../org/apache/doris/statistics/DeriveFactory.java | 66 ----
.../doris/statistics/EmptySetStatsDerive.java | 31 --
.../doris/statistics/ExchangeStatsDerive.java | 34 --
.../doris/statistics/HashJoinStatsDerive.java | 254 ---------------
.../apache/doris/statistics/MysqlStatsDerive.java | 33 --
.../statistics/NestedLoopJoinStatsDerive.java | 48 ---
.../doris/statistics/OlapScanStatsDerive.java | 93 ------
.../apache/doris/statistics/SelectStatsDerive.java | 35 --
.../doris/statistics/StatsRecursiveDerive.java | 60 ----
.../doris/statistics/TableFunctionStatsDerive.java | 34 --
.../org/apache/doris/catalog/ColumnStatTest.java | 87 -----
.../apache/doris/mtmv/MTMVSchemaChangeTest.java | 2 +-
.../translator/PhysicalPlanTranslatorTest.java | 2 +-
.../data/cloud_p0/cache/ttl/test_show_ttl.out | 4 +-
.../mtmv_p0/test_base_add_col_multi_level_mtmv.out | 8 +-
...est_base_alter_col_comment_multi_level_mtmv.out | 8 +-
.../test_base_alter_col_type_multi_level_mtmv.out | 8 +-
.../mtmv_p0/test_base_comment_multi_level_mtmv.out | 8 +-
.../test_base_drop_col_multi_level_mtmv.out | 8 +-
.../mtmv_p0/test_base_drop_multi_level_mtmv.out | 8 +-
regression-test/data/mtmv_p0/test_base_mtmv.out | 30 +-
.../data/mtmv_p0/test_base_recreate_col_mtmv.out | 7 +
.../mtmv_p0/test_base_recreate_on_commit_mtmv.out | 4 +-
.../test_base_rename_col_multi_level_mtmv.out | 8 +-
.../mtmv_p0/test_base_rename_multi_level_mtmv.out | 8 +-
.../test_base_rename_mv_multi_level_mtmv.out | 8 +-
.../mtmv_p0/test_base_rename_on_commit_mtmv.out | 6 +-
.../test_base_rename_p_mv_multi_level_mtmv.out | 8 +-
.../mtmv_p0/test_base_replace_multi_level_mtmv.out | 24 +-
.../test_base_replace_mv_multi_level_mtmv.out | 18 +-
.../mtmv_p0/test_base_replace_on_commit_mtmv.out | 4 +-
.../update/update_after_create_rollup.out | 11 +
.../datetime_functions/test_date_function.out | 118 +++++++
.../balance/test_expanding_node_balance.groovy | 111 +++++++
.../cloud_p0/cache/ttl/alter_ttl_max_int64.groovy | 2 +-
.../cloud_p0/cache/ttl/create_table_like.groovy | 2 +-
.../suites/cloud_p0/cache/ttl/test_ttl.groovy | 2 +-
.../cloud_p0/cache/ttl/test_ttl_lru_evict.groovy | 2 +-
.../cloud_p0/cache/ttl/test_ttl_preempt.groovy | 2 +-
.../hive/test_hive_query_cache.groovy | 88 ++---
.../hive/test_hive_statistic_auto.groovy | 6 +-
...berg_rewrite_data_files_where_conditions.groovy | 5 +
.../iceberg/test_iceberg_sys_table_auth.groovy | 176 ++++++++++
.../paimon/test_paimon_system_table_auth.groovy | 191 +++++++++++
.../external_table_p0/tvf/test_backends_tvf.groovy | 10 +-
.../tvf/test_frontends_disks_tvf.groovy | 8 +-
.../tvf/test_frontends_tvf.groovy | 9 +-
.../azure_blob_all_test.groovy | 141 ++++++++
.../iceberg_on_hms_and_filesystem_and_dlf.groovy | 103 +++++-
.../test_base_add_col_multi_level_mtmv.groovy | 8 +-
..._base_alter_col_comment_multi_level_mtmv.groovy | 8 +-
...est_base_alter_col_type_multi_level_mtmv.groovy | 8 +-
.../test_base_comment_multi_level_mtmv.groovy | 8 +-
.../test_base_drop_col_multi_level_mtmv.groovy | 8 +-
.../mtmv_p0/test_base_drop_multi_level_mtmv.groovy | 8 +-
.../suites/mtmv_p0/test_base_mtmv.groovy | 30 +-
...v.groovy => test_base_recreate_col_mtmv.groovy} | 56 ++--
.../test_base_recreate_on_commit_mtmv.groovy | 4 +-
.../test_base_rename_col_multi_level_mtmv.groovy | 8 +-
.../test_base_rename_multi_level_mtmv.groovy | 8 +-
.../test_base_rename_mv_multi_level_mtmv.groovy | 8 +-
.../mtmv_p0/test_base_rename_on_commit_mtmv.groovy | 6 +-
.../test_base_rename_p_mv_multi_level_mtmv.groovy | 8 +-
.../test_base_replace_multi_level_mtmv.groovy | 24 +-
.../test_base_replace_mv_multi_level_mtmv.groovy | 20 +-
.../test_base_replace_on_commit_mtmv.groovy | 4 +-
.../query_in_different_db.groovy | 5 +-
.../update/update_after_create_rollup.groovy | 164 ++++++++++
.../nereids_rules_p0/mv/limit/limit_rewrite.groovy | 6 +-
.../mv/nested/nested_materialized_view.groovy | 4 +-
.../mv/pre_rewrite/limit/query_with_limit.groovy | 5 +-
.../nereids_rules_p0/mv/topN/topN_rewrite.groovy | 6 +-
.../nereids_rules_p0/mv/tpch/mv_tpch_test.groovy | 7 +-
.../nereids_syntax_p0/test_cast_datetime.groovy | 8 -
.../datetime_functions/test_date_function.groovy | 86 ++++-
run-be-ut.sh | 5 +
200 files changed, 2168 insertions(+), 2553 deletions(-)
create mode 100644 be/test/olap/rowset/segment_v2/segment_corruption_test.cpp
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/catalog/ColumnStats.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/PropagateNullableOnDateOrTimeLikeV2Args.java
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{Year.java
=> Century.java} (83%)
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/AggStatsDerive.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/AnalyticEvalStatsDerive.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/AssertNumRowsStatsDerive.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/BaseStatsDerive.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/DeriveFactory.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/EmptySetStatsDerive.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/ExchangeStatsDerive.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/HashJoinStatsDerive.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/MysqlStatsDerive.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/NestedLoopJoinStatsDerive.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/OlapScanStatsDerive.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/SelectStatsDerive.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/StatsRecursiveDerive.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/TableFunctionStatsDerive.java
delete mode 100644
fe/fe-core/src/test/java/org/apache/doris/catalog/ColumnStatTest.java
create mode 100644 regression-test/data/mtmv_p0/test_base_recreate_col_mtmv.out
create mode 100644
regression-test/data/nereids_p0/update/update_after_create_rollup.out
create mode 100644
regression-test/suites/cloud_p0/balance/test_expanding_node_balance.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_sys_table_auth.groovy
create mode 100644
regression-test/suites/external_table_p0/paimon/test_paimon_system_table_auth.groovy
create mode 100644
regression-test/suites/external_table_p2/refactor_catalog_param/azure_blob_all_test.groovy
copy regression-test/suites/mtmv_p0/{test_base_recreate_on_commit_mtmv.groovy
=> test_base_recreate_col_mtmv.groovy} (53%)
create mode 100644
regression-test/suites/nereids_p0/update/update_after_create_rollup.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
