This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch auto-pick-60474-branch-4.0
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 03bc3fb0b71 [fix](parquet)fix parquet reader lazy materialization
cannot filter. (#60474)
add c01a0f26e52 branch-4.0: [Fix](dictionary) Fix empty
InsertIntoDictionaryCommand originSql #60631 (#60641)
add 9f38110eb66 branch-4.0: [opt](profile) change some metrics' level in
profile #60294 (#60653)
add 962c85b3761 branch-4.0: [opt](multi-catalog) Optimize file split size.
(#60637)
add 5f214b9521d branch-4.0: [fix](jni) fix JNI logging by migrating to
log4j2 with proper configuration #60584 (#60592)
add 0213008f7e7 branch-4.0: [Feature](Iceberg) Implement expire_snapshots
procedure for Iceberg tables #59979 (#60647)
add b1d881bf689 branch-4.0: [fix](test) fix unstable p2 cases (#60621)
(#60665)
add 343e3216b7e branch-4.0: [refine](function)In functions, ensure that an
empty input column returns an empty column. #60660 (#60696)
add e4207f6a6d7 branch-4.0: [fix](expr)Ensure short-circuit expressions
never receive a count of 0 #60594 (#60658)
add fb93bd37daf branch-4.0: [fix](nereids) Fix incorrect isDomain parsing
in SET PASSWORD statement #60565 (#60657)
add d2a73a13866 branch-4.0: [fix](nereids) fix empty layer in
CommonSubExpressionOpt when WhenClause is the only common sub-expression #60435
(#60619)
add 8cb910f6ac8 [pick](4.0) Use ColumnView to automatically handle
Nullable and Const, Fix array_join to handle non-constant columns. (#60707)
add c946cef4f41 branch-4.0: [test](sqlcache)Add sql cache with mtmv test
case #56753 (#60663)
add 490e098ffb4 branch-4.0: [fix](test) replace hardcoded IP with variable
in group commit redirect test #60573 (#60589)
add 7836fd2568b branch-4.0: [fix](regression-case) Fix routineload case :
test_routine_load_timeout_value #60664 (#60692)
add 64975c0e1ad branch-4.0: [fix](cloud) Fix CloudRowsetWriter vtable
use-after-free in delete bitmap task #60528 (#60708)
add 1b21d47b2b5 branch-4.0: [Fix](case) Fix unstale case
`test_ordered_compaction_num_seg_rows` due to be fuzzy config (#59970) (#60704)
add 4b3061c2d9f branch-4.0: (query cache) query cache shouldn't be hitted
when session variable changed or use udf (#60315) (#60661)
add 00ffd1ccd92 branch-4.0: [improve](log) Add segment file info when
bitshuffle page corruption detected #60547 (#60689)
add 0ae9ed206a6 branch-4.0: [Feature](func) Support function PREVIOUS_DAY
#60680 (#60726)
add 03af99507c3 branch-4.0: [fix](filecache) fix disk size calculation in
block_file_cache_factory #60644 (#60706)
add 85a1ea9a163 branch-4.0: [bugfix](k8s) fix log output for K8S
environment in cloud and add unit tests #60490 (#60678)
add 1507052edb9 branch-4.0: [fix](case) Fix `different_serialize_cloud`
case #59555 (#60675)
add 076332bb590 branch-4.0: [Fix](udf) fix frontends udf return rows
incompatible with show frontends command #60211 (#60602)
add 93277bde426 branch-4.0: [fix](cloud) Fix misleading CommittedVersion
display in show partitions #60623 (#60679)
add 84859cdf013 branch-4.0: [fix](regression) Fix case :
test_routine_load_adaptive_param #60673 (#60691)
add 0560eda8003 branch-4.0: [fix](custom analyzer) Fix basic and icu
tokenizer can not be customized #60506 (#60736)
add 37df2064d2a branch-4.0: [fix](iceberg) fix unstable iceberg case
#60646 (#60737)
add dce38b57051 branch-4.0: [fix](runtime) Clear
query_ctx_map_delay_delete in FragmentMgr::stop() to avoid UB #60718 (#60728)
add ccd1421cba3 branch-4.0: [fix](client) Handle empty S3 list page with
more results in concurrent deletion scenario #60332 (#60710)
add a12d20fffae branch-4.0: [test](nereids)fix sql cache of mtmv test case
#57177 (#60733)
add 427091c640e branch-4.0: [fix](CostBasedRewriteJob)restore
StatementContext.rewrittenCteProducer in CostBasedRewriteJob #59517 (#60742)
add 9817326de3e branch-4.0: [Feature](function) Support more INTERVAL
time-unit (#60347) (#60759)
add 866f1e7fd18 branch-4.0: [Enhancement](func) Add fold constant for
PREVIOUS_DAY #60755 (#60762)
add 51431716560 branch-4.0: [feature](geo) support 3 spatial functions:
ST_Distance, ST_GeometryType, ST_Length #60170 (#60748)
add 0067afdadd3 branch-4.0: [bugfix](k8s) fix Log4jConfig class loading
before Config.init in console mode #60531 (#60750)
add 47260908546 branch-4.0: [feat](libhdfs3) support
dfs.client.use.datanode.hostname for libhdfs3 #59915 (#60712)
add 1153e857641 branch-4.0: [feat](cloud) Enable split config by default
#60491 (#60596)
add a3faa308c02 branch-4.0: [test](nerieds)fix sql cache with mtmv test
case #57366 (#60760)
add 59481492f13 [fix](parquet)fix parquet reader lazy materialization
cannot filter. (#60474)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (03bc3fb0b71)
\
N -- N -- N refs/heads/auto-pick-60474-branch-4.0 (59481492f13)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/src/cloud/cloud_rowset_writer.cpp | 11 +-
be/src/geo/geo_types.cpp | 371 +++++++
be/src/geo/geo_types.h | 26 +-
be/src/io/cache/block_file_cache_factory.cpp | 6 +-
be/src/olap/rowset/segment_v2/bitshuffle_page.h | 8 +-
be/src/olap/rowset/segment_v2/column_reader.cpp | 11 +-
.../rowset/segment_v2/indexed_column_reader.cpp | 5 +
be/src/runtime/fragment_mgr.cpp | 4 +
be/src/runtime_filter/runtime_filter_consumer.cpp | 4 +-
be/src/vec/columns/column_execute_util.h | 101 ++
be/src/vec/columns/column_string.cpp | 14 -
be/src/vec/columns/column_string.h | 14 +-
.../exec/format/parquet/vparquet_group_reader.cpp | 1 -
be/src/vec/exprs/short_circuit_evaluation_expr.cpp | 79 +-
be/src/vec/functions/array/function_array_join.h | 126 ++-
be/src/vec/functions/date_format_type.h | 148 +++
be/src/vec/functions/date_time_transforms.h | 47 +
be/src/vec/functions/datetime_errors.h | 32 +-
be/src/vec/functions/function.h | 10 +
be/src/vec/functions/function_const.h | 3 +-
.../function_date_or_datetime_computation.cpp | 64 +-
.../function_date_or_datetime_computation.h | 680 ++++++------
.../function_date_or_datetime_to_string.cpp | 22 +
be/src/vec/functions/functions_geo.cpp | 532 +++++-----
be/src/vec/runtime/vdatetime_value.cpp | 22 +
be/test/common/logconfig_test.cpp | 264 +++++
be/test/geo/geo_types_test.cpp | 534 ++++++++++
be/test/vec/columns/column_execute_util_test.cpp | 164 +++
be/test/vec/function/function_time_test.cpp | 668 ++++++++++++
cloud/script/start.sh | 4 +-
cloud/src/common/config.h | 2 +-
cloud/src/common/logging.cpp | 72 +-
cloud/src/recycler/s3_obj_client.cpp | 17 +-
cloud/test/log_test.cpp | 205 ++++
cloud/test/s3_accessor_client_test.cpp | 13 +-
.../doris/common/classloader/ScannerLoader.java | 68 +-
.../java-common/src/main/resources/log4j2.xml | 63 ++
.../doris/trinoconnector/TrinoConnectorCache.java | 15 +-
.../trinoconnector/TrinoConnectorPluginLoader.java | 29 +-
.../antlr4/org/apache/doris/nereids/DorisLexer.g4 | 14 +-
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 13 +-
.../src/main/java/org/apache/doris/DorisFE.java | 9 +-
.../apache/doris/blockrule/SqlBlockRuleMgr.java | 3 +
.../doris/catalog/BuiltinScalarFunctions.java | 30 +
.../apache/doris/cloud/catalog/CloudPartition.java | 6 +
.../doris/common/proc/FrontendsProcNode.java | 16 +-
.../doris/common/profile/RuntimeProfile.java | 3 +-
.../doris/datasource/FederationBackendPolicy.java | 12 +-
.../apache/doris/datasource/FileQueryScanNode.java | 19 +-
.../org/apache/doris/datasource/FileScanNode.java | 10 +-
.../org/apache/doris/datasource/FileSplitter.java | 230 +++-
.../apache/doris/datasource/SplitGenerator.java | 2 +-
.../doris/datasource/hive/source/HiveScanNode.java | 78 +-
.../action/IcebergExpireSnapshotsAction.java | 221 +++-
.../datasource/iceberg/source/IcebergScanNode.java | 80 +-
.../datasource/paimon/source/PaimonScanNode.java | 47 +-
.../doris/datasource/tvf/source/TVFScanNode.java | 31 +-
.../apache/doris/dictionary/DictionaryManager.java | 10 +-
.../apache/doris/indexpolicy/IndexPolicyMgr.java | 6 +
.../doris/load/routineload/KafkaTaskInfo.java | 4 +-
.../org/apache/doris/nereids/StatementContext.java | 160 ++-
.../glue/translator/PhysicalPlanTranslator.java | 93 +-
.../nereids/jobs/rewrite/CostBasedRewriteJob.java | 27 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 8 +-
.../post/CommonSubExpressionCollector.java | 2 +
.../processor/post/CommonSubExpressionOpt.java | 16 +-
.../rules/analysis/DatetimeFunctionBinder.java | 54 +
.../functions/executable/DateTimeArithmetic.java | 497 ++++++++-
.../executable/DateTimeExtractAndTransform.java | 97 ++
.../expressions/functions/scalar/DayHour.java | 66 ++
.../expressions/functions/scalar/DayHourSub.java | 84 ++
.../functions/scalar/DayMicrosecond.java | 66 ++
.../functions/scalar/DayMicrosecondAdd.java | 85 ++
.../functions/scalar/DayMicrosecondSub.java | 85 ++
.../expressions/functions/scalar/DayMinute.java | 66 ++
.../expressions/functions/scalar/DayMinuteAdd.java | 84 ++
.../expressions/functions/scalar/DayMinuteSub.java | 84 ++
.../expressions/functions/scalar/DaySecond.java | 66 ++
.../expressions/functions/scalar/DaySecondSub.java | 84 ++
.../functions/scalar/HourMicrosecond.java | 66 ++
.../functions/scalar/HourMicrosecondAdd.java | 85 ++
.../functions/scalar/HourMicrosecondSub.java | 85 ++
.../expressions/functions/scalar/HourMinute.java | 66 ++
.../functions/scalar/HourMinuteAdd.java | 84 ++
.../functions/scalar/HourMinuteSub.java | 84 ++
.../expressions/functions/scalar/HourSecond.java | 66 ++
.../functions/scalar/HourSecondAdd.java | 84 ++
.../functions/scalar/HourSecondSub.java | 84 ++
.../functions/scalar/MinuteMicrosecond.java | 66 ++
.../functions/scalar/MinuteMicrosecondAdd.java | 85 ++
.../functions/scalar/MinuteMicrosecondSub.java | 85 ++
.../expressions/functions/scalar/MinuteSecond.java | 66 ++
.../functions/scalar/MinuteSecondSub.java | 84 ++
.../expressions/functions/scalar/PreviousDay.java | 67 ++
.../functions/scalar/SecondMicrosecond.java | 66 ++
.../functions/scalar/SecondMicrosecondSub.java | 88 ++
.../expressions/functions/scalar/StDistance.java | 75 ++
.../functions/scalar/StGeometryType.java | 74 ++
.../expressions/functions/scalar/StLength.java | 75 ++
.../expressions/functions/scalar/YearMonth.java | 73 ++
.../expressions/functions/scalar/YearMonthAdd.java | 84 ++
.../expressions/functions/scalar/YearMonthSub.java | 84 ++
.../trees/expressions/literal/Interval.java | 17 +-
.../expressions/visitor/ScalarFunctionVisitor.java | 173 ++-
.../trees/plans/commands/SetOptionsCommand.java | 4 +
.../trees/plans/commands/ShowFrontendsCommand.java | 6 +-
.../trees/plans/commands/info/SetPassVarOp.java | 4 +
.../org/apache/doris/planner/AggregationNode.java | 10 +
.../planner/normalize/QueryCacheNormalizer.java | 35 +-
.../java/org/apache/doris/qe/SessionVariable.java | 60 ++
.../FrontendsDisksTableValuedFunction.java | 11 +
.../FrontendsTableValuedFunction.java | 16 +-
.../doris/cloud/catalog/CloudPartitionTest.java | 10 +
.../org/apache/doris/common/Log4jConfigTest.java | 76 ++
.../apache/doris/datasource/FileSplitterTest.java | 216 ++++
.../paimon/source/PaimonScanNodeTest.java | 17 +
.../doris/nereids/parser/SetPasswordParseTest.java | 128 +++
.../postprocess/CommonSubExpressionTest.java | 50 +
.../plans/commands/ShowFrontendsCommandTest.java | 62 +-
.../doris/planner/FederationBackendPolicyTest.java | 4 +-
.../doris/planner/QueryCacheNormalizerTest.java | 1 +
.../data/export_p2/test_export_max_file_size.out | 1105 ++------------------
.../hive/test_hive_compress_type.out | 572 ----------
.../action/test_iceberg_expire_snapshots.out | 10 +
.../analyzer/test_custom_analyzer.out | 9 +
.../datetime_functions/test_add_sub_union_type.out | 810 ++++++++++++++
.../spatial_functions/test_gis_function.out | 225 ++++
.../array_functions/test_array_functions.out | 10 +
.../test_dateadd_with_other_timeunit.out | 97 ++
.../string_functions/test_previous_day.out | 185 ++++
.../suites/account_p0/test_set_password.groovy | 69 ++
.../different_serialize/different_serialize.groovy | 12 +-
.../sql-functions/doc_date_functions_test.groovy | 4 +-
.../export_p2/test_export_max_file_size.groovy | 57 +-
.../hive/test_hive_compress_type.groovy | 25 +-
.../action/test_iceberg_execute_actions.groovy | 92 +-
.../action/test_iceberg_expire_snapshots.groovy | 299 ++++++
.../iceberg_branch_retention_and_snapshot.groovy | 18 +-
.../iceberg/test_iceberg_sys_table.groovy | 29 +-
.../tvf/test_frontends_disks_tvf.groovy | 13 +
.../tvf/test_frontends_tvf.groovy | 26 +-
.../test_ordered_compaction_num_seg_rows.groovy | 3 +-
.../analyzer/test_custom_analyzer.groovy | 73 +-
.../test_routine_load_adaptive_param.groovy | 14 +-
.../test_routine_load_timeout_value.groovy | 6 +
.../stream_load/test_group_commit_redirect.groovy | 4 +-
.../nereids_p0/cache/mtmv_with_sql_cache.groovy | 971 +++++++++++++++++
.../nereids_p0/cache/mv_with_sql_cache.groovy | 263 +++++
.../cache/parse_sql_from_sql_cache.groovy | 31 +
.../costbasedrewrite_producer.groovy | 43 +-
.../test_add_sub_union_type.groovy | 645 ++++++++++++
.../spatial_functions/test_gis_function.groovy | 111 ++
.../suites/query_p0/cache/query_cache.groovy | 2 +
.../query_p0/cache/query_cache_with_context.groovy | 65 ++
.../array_functions/test_array_functions.groovy | 36 +
.../datetime_functions/test_date_function.groovy | 6 -
.../test_dateadd_with_other_timeunit.groovy | 125 +--
.../string_functions/test_previous_day.groovy | 127 +++
thirdparty/download-thirdparty.sh | 13 +
thirdparty/patches/libhdfs3-v2.3.9-hostname.patch | 74 ++
160 files changed, 13136 insertions(+), 2846 deletions(-)
create mode 100644 be/src/vec/columns/column_execute_util.h
create mode 100644 be/test/common/logconfig_test.cpp
create mode 100644 be/test/vec/columns/column_execute_util_test.cpp
create mode 100644
fe/be-java-extensions/java-common/src/main/resources/log4j2.xml
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/DayHour.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/DayHourSub.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/DayMicrosecond.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/DayMicrosecondAdd.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/DayMicrosecondSub.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/DayMinute.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/DayMinuteAdd.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/DayMinuteSub.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/DaySecond.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/DaySecondSub.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/HourMicrosecond.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/HourMicrosecondAdd.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/HourMicrosecondSub.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/HourMinute.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/HourMinuteAdd.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/HourMinuteSub.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/HourSecond.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/HourSecondAdd.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/HourSecondSub.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/MinuteMicrosecond.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/MinuteMicrosecondAdd.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/MinuteMicrosecondSub.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/MinuteSecond.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/MinuteSecondSub.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/PreviousDay.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/SecondMicrosecond.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/SecondMicrosecondSub.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/StDistance.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/StGeometryType.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/StLength.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/YearMonth.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/YearMonthAdd.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/YearMonthSub.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/common/Log4jConfigTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/FileSplitterTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/parser/SetPasswordParseTest.java
create mode 100644
regression-test/data/external_table_p0/iceberg/action/test_iceberg_expire_snapshots.out
create mode 100644
regression-test/data/nereids_p0/sql_functions/datetime_functions/test_add_sub_union_type.out
create mode 100644
regression-test/data/query_p0/sql_functions/string_functions/test_previous_day.out
create mode 100644 regression-test/suites/account_p0/test_set_password.groovy
create mode 100644
regression-test/suites/external_table_p0/iceberg/action/test_iceberg_expire_snapshots.groovy
create mode 100644
regression-test/suites/nereids_p0/cache/mtmv_with_sql_cache.groovy
create mode 100644
regression-test/suites/nereids_p0/cache/mv_with_sql_cache.groovy
rename
fe/be-java-extensions/java-common/src/main/java/org/apache/doris/common/jni/utils/Log4jOutputStream.java
=>
regression-test/suites/nereids_p0/cte/costbasedrewrite_producer/costbasedrewrite_producer.groovy
(55%)
create mode 100644
regression-test/suites/nereids_p0/sql_functions/datetime_functions/test_add_sub_union_type.groovy
create mode 100644
regression-test/suites/query_p0/cache/query_cache_with_context.groovy
create mode 100644
regression-test/suites/query_p0/sql_functions/string_functions/test_previous_day.groovy
create mode 100644 thirdparty/patches/libhdfs3-v2.3.9-hostname.patch
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
