This is an automated email from the ASF dual-hosted git repository.
diwu pushed a change to branch streaming-job-dev
in repository https://gitbox.apache.org/repos/asf/doris.git
from 6d1374279cf [fix](streaming job) fix streaming job ut (#56314)
add ded661503a9 [minor](refactor) Refine orc/parquet readers (#56187)
add 70ad298789b [Opt](cloud-mow) BE can limit the size of
`get_delete_bitmap` response roughly (#55712)
add 4d52e23b4fc [feature](regression test & stream-load) Add the
enableUtf8Encoding field to control the behavior of the HTTP client encoding
header. (#56205)
add 14c7745b962 [Refactor](cast) Remove old cast to datelike type codes
(#55887)
add d5ffa12db4c [Fix](date) Fix the wrong result of str_to_date when input
is Time type (#56192)
add 8dc41eab13d [fix](export) avoid throw npe when export task has illegal
url (#56161)
add eae985648ef [fix](fold constant) abs's return type should be argument
type (#56190)
add 944b4e54121 [fix](sc) Skip empty rowset version hole filling for
versions <= alter_version (#56209)
add 2ce06f04705 [Chore](fragment) some refactor of PipelineFragmentContext
(#56177)
add 29511878a81 [fix](jdbc catalog) Use SQL to get column without using `
enclosed (#55922)
add 1ce7bf0d46f [fix](coordinator) Fix wrong bucket assignments by nereids
coordinator (#56201)
add 84cb785d863 [fix](iceberg) Fix classloader usage in the Iceberg system
table scanner (#56150)
add 7f9b130c1d3 [fix](nereids) runtime filter generation bug for topn lazy
materialization (#56137)
add 3e9b5600c0e [chore](test) improve coverage of function_jsonb.cpp
(#56151)
add d9e5a115acb [chore](task) set tablet id in create finish req and skip
warn for drop (#56178)
add 598073fef26 [Bug](type) add PGenericType for varbinary type (#56188)
add 058e31d3f70 [fix](nereids)useless common sub expression is inferred
for aggregation (#55815)
add a64e6a3fb2b [fix](test) fix test_routine_load_alter case fail (#56206)
add b776be4fbd7 [enhance](metric)add metrics for statistics/mtmv/sql
cache/plan (#55617)
add ac8b1b15020 [test](exchange) set _send_multi_blocks only false (#56211)
add 56d6863f31a [enhance](mtmv)log snapshot after task finish (#56198)
add 1edd28f2a68 [fix](nereids) fix bugs about convert hot value from
string type to date type (#56185)
add e602e48e30b [Fix](Catalog)S3A: Support assuming IAM role via
ProfileCredentialsProvider (#56213)
add f0f26d7c7da [fix](script) Fix recycler cannot find `core-site.xml` and
`hdfs-site.xml` (#56248)
add 972941b0c15 [fix](prepare statement)Prepare stage only explain sql to
get output slots. (#56224)
add 643caa7f5c9 [fix](count) fix wrong count push down logic (#56182)
add f8fac2d2a15 [fix](multi-catalog) should set initedScanRangeLocations
after getScanRangeLocations (#56245)
add 03c3afd3c1a [improvement](load) improve load strict mode (#55902)
add 99d000bbdd5 [fix](cloud) make recycle_snapshot_meta_and_data public
(#56240)
add 1364d3670e3 [Feat](Snapshot) Support Snapshot MS Http Interface
(#56202)
add 23acc85a58a [fix](cases) add load ddl test cases (#56263)
add 242444b2ecc [Refactor](function) Throw exception rather than return
null for datetime function error handling (#56079)
add 6131f4633a2 [fix](function) incorrect result of json_extract with path
'**' (#56226)
add d7c9e5ec3a0 [fix](file writer) fix value of s3 bytes written bvar
incorrect (#56262)
add 4717a022fe4 [fix](test) Reduce cache cleanup interval to fix flaky
test (#56253)
add 79ddf566cc9 [Chore](auto-pick)4.0.x autopick (#56282)
add 9076cc3a96e [opt](exec) opt the row id fetcher performance (#56222)
add d46a04ea0c2 [feature](function) add is_ipv4/is_ipv6 (#56255)
add 41aeb12ffcc [fix](nereids)fix tableNameInfo is null in tableRefInfo
(#56219)
add 317d5601acb [opt](ai) detail optimization for AI Funcion (#55762)
add d61d2cbfa57 [fix](nereids) fix unstable test of sql cache (#56264)
add dd4c598e769 [Fix](datetime) fix wrong implicit microsecond digits
after reducing precision of datetime (#53659)
add 8d9c5d65176 [enhance](mtmv)Base table changes should not cause nested
MTMV to schema change status (#56244)
add 9b39be28eeb [fix](docker case) Fix warm up case failed due to schema
change (#56252)
add cf536ab068d [fix](regression) fix unstable case cse.groovy (#56227)
add cf84078447e [fix](case) test_csv_with_header (#56107)
add f4d164d547d [fix](nereids)prevent null exception in ShowTableCommand
(#56239)
add 0fbab818735 [Fix](s3) Fix hdfs will throw an exception if the URL
verification fails (#56268)
add a793b19ef35 [fix](es) Handle object type in Elasticsearch mapping when
table is empty (#56152)
new b8719f16fb7 Merge branch 'master' into streaming-job-dev
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/auto-cherry-pick.yml | 10 +-
be/src/agent/task_worker_pool.cpp | 16 +-
be/src/cloud/cloud_delta_writer.cpp | 5 +
be/src/cloud/cloud_meta_mgr.cpp | 185 +-
be/src/cloud/cloud_meta_mgr.h | 5 +
be/src/cloud/cloud_schema_change_job.cpp | 13 +-
be/src/cloud/config.cpp | 7 +
be/src/cloud/config.h | 3 +
be/src/exec/rowid_fetcher.cpp | 201 +-
be/src/exec/rowid_fetcher.h | 7 +-
be/src/http/action/http_stream.cpp | 1 +
be/src/http/action/stream_load.cpp | 9 +-
be/src/io/fs/s3_file_writer.cpp | 1 +
be/src/olap/partial_update_info.cpp | 6 +-
be/src/olap/types.h | 36 +-
be/src/olap/uint24.h | 17 +-
be/src/pipeline/exec/exchange_sink_buffer.cpp | 3 +-
be/src/pipeline/pipeline_fragment_context.cpp | 518 ++-
be/src/pipeline/pipeline_fragment_context.h | 31 +-
be/src/runtime/fragment_mgr.cpp | 9 +-
.../routine_load/routine_load_task_executor.cpp | 3 +
be/src/runtime/runtime_state.cpp | 31 +-
be/src/runtime/runtime_state.h | 8 +-
.../runtime/stream_load/stream_load_executor.cpp | 1 +
be/src/util/asan_util.h | 15 +-
be/src/util/jsonb_document.cpp | 16 +
.../vec/aggregate_functions/aggregate_function.h | 3 +
.../aggregate_function_ai_agg.h | 17 +
be/src/vec/columns/column_vector.h | 6 +-
be/src/vec/core/column_with_type_and_name.cpp | 13 +-
be/src/vec/core/column_with_type_and_name.h | 2 +-
be/src/vec/data_types/data_type.cpp | 3 +
be/src/vec/data_types/data_type.h | 2 +
.../data_types/data_type_date_or_datetime_v2.cpp | 3 +-
.../vec/data_types/data_type_date_or_datetime_v2.h | 7 +-
be/src/vec/data_types/data_type_nullable.cpp | 3 +-
be/src/vec/data_types/data_type_time.cpp | 2 +-
be/src/vec/data_types/data_type_time.h | 6 +-
be/src/vec/exec/format/generic_reader.h | 13 +-
be/src/vec/exec/format/orc/vorc_reader.cpp | 6 +-
be/src/vec/exec/format/orc/vorc_reader.h | 40 +-
be/src/vec/exec/format/parquet/vparquet_reader.cpp | 12 +-
be/src/vec/exec/format/parquet/vparquet_reader.h | 5 +-
be/src/vec/exec/jni_connector.cpp | 2 +
be/src/vec/exec/scan/file_scanner.cpp | 18 +-
be/src/vec/exprs/vexpr.cpp | 2 +-
be/src/vec/functions/ai/ai_adapter.h | 188 +-
be/src/vec/functions/ai/ai_functions.h | 6 +-
.../vec/functions/array/function_array_range.cpp | 2 +-
be/src/vec/functions/cast/cast_to_date.h | 55 +-
be/src/vec/functions/cast/cast_to_time_impl.hpp | 5 +-
be/src/vec/functions/cast/function_cast.cpp | 6 +-
be/src/vec/functions/date_time_transforms.h | 192 +-
be/src/vec/functions/datetime_errors.h | 130 +
be/src/vec/functions/function.cpp | 10 +-
be/src/vec/functions/function_convert_tz.cpp | 357 +-
be/src/vec/functions/function_convert_tz.h | 358 --
.../function_date_or_datetime_computation.h | 203 +-
.../function_date_or_datetime_to_something.h | 73 +-
.../function_date_or_datetime_to_string.cpp | 90 +-
.../function_date_or_datetime_to_string.h | 112 -
.../vec/functions/function_datetime_floor_ceil.cpp | 380 ++-
.../functions/function_datetime_string_to_string.h | 85 +-
be/src/vec/functions/function_jsonb.cpp | 291 +-
...estamp.cpp => function_other_types_to_date.cpp} | 536 ++-
be/src/vec/functions/function_string.h | 14 +-
be/src/vec/functions/functions_comparison.h | 4 +-
be/src/vec/functions/functions_geo.cpp | 2 +-
be/src/vec/functions/time_of_function.cpp | 4 -
be/src/vec/runtime/time_value.h | 17 +-
be/src/vec/runtime/vdatetime_value.cpp | 445 +--
be/src/vec/runtime/vdatetime_value.h | 20 +-
be/src/vec/sink/tablet_sink_hash_partitioner.cpp | 4 +-
be/src/vec/sink/vrow_distribution.cpp | 5 +-
be/src/vec/sink/vrow_distribution.h | 2 +-
be/src/vec/sink/vtablet_block_convertor.cpp | 104 +-
be/src/vec/sink/vtablet_block_convertor.h | 11 +-
be/src/vec/sink/writer/vtablet_writer.cpp | 4 +-
be/src/vec/sink/writer/vtablet_writer_v2.cpp | 4 +-
be/src/vec/utils/util.hpp | 14 +
be/test/ai/aggregate_function_ai_agg_test.cpp | 80 +
be/test/ai/ai_adapter_test.cpp | 99 +-
be/test/ai/embed_test.cpp | 6 +-
be/test/cloud/cloud_meta_mgr_test.cpp | 448 +++
.../test_data/parquet_scanner/dict-decoder.txt | 32 +-
.../test_data/parquet_scanner/type-decoder.txt | 28 +-
...mev2_0_to_string.out => TimeV2_0_to_string.out} | Bin
..._0_to_string_2.out => TimeV2_0_to_string_2.out} | Bin
..._0_to_string_3.out => TimeV2_0_to_string_3.out} | Bin
...ring_batch.out => TimeV2_0_to_string_batch.out} | Bin
...mev2_5_to_string.out => TimeV2_5_to_string.out} | Bin
..._5_to_string_2.out => TimeV2_5_to_string_2.out} | Bin
..._5_to_string_3.out => TimeV2_5_to_string_3.out} | Bin
...ring_batch.out => TimeV2_5_to_string_batch.out} | Bin
...mev2_6_to_string.out => TimeV2_6_to_string.out} | Bin
..._6_to_string_2.out => TimeV2_6_to_string_2.out} | Bin
..._6_to_string_3.out => TimeV2_6_to_string_3.out} | Bin
...ring_batch.out => TimeV2_6_to_string_batch.out} | Bin
.../vec/data_types/timev2_to_string.out | Bin 468 -> 0 bytes
.../vec/data_types/timev2_to_string_2.out | Bin 468 -> 0 bytes
.../vec/data_types/timev2_to_string_3.out | Bin 468 -> 0 bytes
.../vec/data_types/timev2_to_string_batch.out | Bin 468 -> 0 bytes
be/test/pipeline/pipeline_task_test.cpp | 3 +-
be/test/pipeline/pipeline_test.cpp | 3 +-
be/test/vec/columns/common_column_test.h | 101 +-
.../vec/core/column_with_type_and_name_test.cpp | 6 +-
..._v2_test.cpp => data_type_datetime_v2_test.cpp} | 53 +-
be/test/vec/data_types/from_string_test.cpp | 9 +-
.../data_types/serde/data_type_serde_text_test.cpp | 474 +--
.../vec/exec/format/parquet/parquet_read_lines.cpp | 2 +-
.../exec/format/parquet/parquet_thrift_test.cpp | 2 +
be/test/vec/exec/orc/orc_read_lines.cpp | 2 +-
be/test/vec/exprs/vexpr_test.cpp | 15 +-
be/test/vec/function/function_convert_tz_test.cpp | 59 -
be/test/vec/function/function_jsonb_test.cpp | 85 +-
be/test/vec/function/function_test_util.h | 4 +-
be/test/vec/function/function_time_test.cpp | 618 ++--
.../utils/arrow_column_to_doris_column_test.cpp | 7 +-
cloud/script/start.sh | 3 +-
cloud/src/meta-service/meta_service.cpp | 17 +
cloud/src/meta-service/meta_service_http.cpp | 130 +
cloud/src/recycler/recycler.h | 10 +-
cloud/src/snapshot/snapshot_manager.cpp | 6 +
cloud/src/snapshot/snapshot_manager.h | 3 +
.../elasticsearch/scripts/es_init.sh | 2 +
.../scripts/index/es7_test_object.json | 16 +
.../doris/iceberg/IcebergSysTableJniScanner.java | 60 +-
.../java/org/apache/doris/catalog/BrokerMgr.java | 5 +-
.../doris/catalog/BuiltinScalarFunctions.java | 4 +-
.../java/org/apache/doris/catalog/Database.java | 29 +
.../main/java/org/apache/doris/catalog/Env.java | 9 +
.../apache/doris/cloud/catalog/CloudReplica.java | 23 +-
.../doris/cloud/catalog/CloudTabletRebalancer.java | 6 +-
.../doris/common/cache/NereidsSqlCacheManager.java | 10 +-
.../doris/common/profile/SummaryProfile.java | 46 +-
.../org/apache/doris/datasource/es/EsUtil.java | 2 +
.../doris/datasource/hive/source/HiveScanNode.java | 3 +
.../datasource/iceberg/source/IcebergScanNode.java | 4 +
.../datasource/jdbc/client/JdbcMySQLClient.java | 4 +-
.../datasource/paimon/source/PaimonScanNode.java | 4 +
.../datasource/property/storage/S3Properties.java | 3 +
.../datasource/tvf/source/MetadataScanNode.java | 1 +
.../apache/doris/job/extensions/mtmv/MTMVJob.java | 4 +
.../apache/doris/job/extensions/mtmv/MTMVTask.java | 11 +
.../doris/load/routineload/KafkaTaskInfo.java | 1 +
.../doris/load/routineload/RoutineLoadJob.java | 4 +
.../java/org/apache/doris/master/MasterImpl.java | 8 +-
.../java/org/apache/doris/metric/MetricRepo.java | 357 +-
.../org/apache/doris/mtmv/MTMVRelationManager.java | 2 +-
.../main/java/org/apache/doris/mtmv/MTMVUtil.java | 26 +
.../org/apache/doris/nereids/NereidsPlanner.java | 6 +-
.../org/apache/doris/nereids/StatementContext.java | 27 +-
.../glue/translator/PhysicalPlanTranslator.java | 138 +-
.../post/ProjectAggregateExpressionsForCse.java | 18 +-
.../doris/nereids/rules/analysis/BindSink.java | 4 +-
.../nereids/rules/analysis/ExpressionAnalyzer.java | 4 +-
.../mv/AbstractMaterializedViewRule.java | 15 +-
.../nereids/rules/expression/check/CheckCast.java | 4 +-
.../rules/expression/rules/PartitionPruner.java | 18 +
.../LogicalResultSinkToShortCircuitPointQuery.java | 4 +-
.../doris/nereids/stats/ExpressionEstimation.java | 19 +-
.../doris/nereids/stats/FilterEstimation.java | 24 +
.../doris/nereids/trees/expressions/Cast.java | 4 +-
.../nereids/trees/expressions/Placeholder.java | 4 +-
.../executable/DateTimeExtractAndTransform.java | 22 +-
.../functions/executable/NumericArithmetic.java | 5 +-
.../expressions/functions/scalar/ConvertTz.java | 9 +-
.../trees/expressions/functions/scalar/Date.java | 4 +-
.../expressions/functions/scalar/DateFormat.java | 11 +-
.../expressions/functions/scalar/DateTrunc.java | 5 +-
.../trees/expressions/functions/scalar/DateV2.java | 5 +-
.../expressions/functions/scalar/DayCeil.java | 4 +-
.../expressions/functions/scalar/DayFloor.java | 4 +-
.../expressions/functions/scalar/FromDays.java | 4 +-
.../functions/scalar/FromIso8601Date.java | 5 +-
.../functions/scalar/FromMicrosecond.java | 5 +-
.../functions/scalar/FromMillisecond.java | 5 +-
.../expressions/functions/scalar/FromSecond.java | 5 +-
.../expressions/functions/scalar/FromUnixtime.java | 4 +-
.../expressions/functions/scalar/HourCeil.java | 4 +-
.../expressions/functions/scalar/HourFloor.java | 4 +-
.../expressions/functions/scalar/MakeDate.java | 12 +-
.../expressions/functions/scalar/MinuteCeil.java | 5 +-
.../expressions/functions/scalar/MinuteFloor.java | 5 +-
.../expressions/functions/scalar/MonthCeil.java | 4 +-
.../expressions/functions/scalar/MonthFloor.java | 4 +-
.../expressions/functions/scalar/NextDay.java | 5 +-
.../functions/scalar/PreparePlaceholder.java | 73 -
.../expressions/functions/scalar/QuarterCeil.java | 4 +-
.../expressions/functions/scalar/QuarterFloor.java | 5 +-
.../expressions/functions/scalar/SecondCeil.java | 4 +-
.../expressions/functions/scalar/SecondFloor.java | 4 +-
.../expressions/functions/scalar/StrToDate.java | 4 +-
.../trees/expressions/functions/scalar/ToDate.java | 4 +-
.../expressions/functions/scalar/ToDateV2.java | 4 +-
.../functions/scalar/UnixTimestamp.java | 28 +-
.../expressions/functions/scalar/WeekCeil.java | 5 +-
.../expressions/functions/scalar/WeekFloor.java | 5 +-
.../expressions/functions/scalar/YearCeil.java | 5 +-
.../expressions/functions/scalar/YearFloor.java | 5 +-
.../expressions/visitor/ScalarFunctionVisitor.java | 5 -
.../nereids/trees/plans/PrepareCommandPlanner.java | 39 +-
.../trees/plans/commands/ExecuteCommand.java | 8 +
.../trees/plans/commands/ExplainCommand.java | 7 +
.../trees/plans/commands/ShowTableCommand.java | 3 +-
.../trees/plans/commands/info/TableRefInfo.java | 4 +-
.../commands/insert/InsertIntoTableCommand.java | 1 +
.../insert/InsertOverwriteTableCommand.java | 1 +
.../trees/plans/commands/insert/InsertUtils.java | 37 +-
.../distribute/worker/job/BucketScanSource.java | 24 +
.../job/UnassignedScanBucketOlapTableJob.java | 101 +-
.../java/org/apache/doris/qe/ConnectProcessor.java | 10 +
.../java/org/apache/doris/qe/SessionVariable.java | 12 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 78 +-
.../org/apache/doris/qe/cache/CacheAnalyzer.java | 4 +-
.../java/org/apache/doris/qe/cache/SqlCache.java | 4 +-
.../apache/doris/service/FrontendServiceImpl.java | 17 +-
.../apache/doris/statistics/AnalysisManager.java | 7 +
.../doris/statistics/AnalysisTaskWrapper.java | 8 +
.../apache/doris/statistics/BaseAnalysisTask.java | 4 +
.../statistics/StatisticsMetricCollector.java | 138 +
.../ExternalFileTableValuedFunction.java | 14 +-
.../tvf/source/MetadataScanNodeTest.java | 166 +
.../java/org/apache/doris/metric/MetricsTest.java | 105 +
.../doris/nereids/stats/FilterEstimationTest.java | 15 +
.../executable/NumericArithmeticTest.java | 47 +
gensrc/proto/cloud.proto | 6 +
gensrc/proto/types.proto | 1 +
gensrc/thrift/BackendService.thrift | 1 +
gensrc/thrift/PlanNodes.thrift | 2 +-
.../cast_between_datetime.out} | Bin 171 -> 143 bytes
regression-test/data/cast_p0/cast_to_datetime.out | Bin 5783 -> 5755 bytes
regression-test/data/cast_p0/cast_to_time.out | Bin 2784 -> 2951 bytes
.../test_from_millisecond_microsecond.out | Bin 5001 -> 4619 bytes
.../data/correctness/test_str_to_date.out | Bin 757 -> 586 bytes
.../data/correctness_p0/test_time_round.out | Bin 7106 -> 6940 bytes
.../data/datatype_p0/date/test_from_unixtime.out | Bin 681 -> 585 bytes
.../test_nested_types_insert_into_with_s3.out | Bin 5559373 -> 5499966
bytes
...e_functions.out => doc_date_functions_test.out} | Bin 17973 -> 17611 bytes
.../data/external_table_p0/es/test_es_query.out | Bin 162279 -> 162443
bytes
.../iceberg/test_iceberg_optimize_count.out | Bin 245 -> 313 bytes
.../jdbc/test_doris_jdbc_catalog.out | Bin 3724 -> 3695 bytes
.../external_table_p0/tvf/test_file_tvf_hdfs.out | Bin 40945 -> 40964 bytes
.../data/external_table_p0/tvf/test_hdfs_tvf.out | Bin 41176 -> 41195 bytes
.../external_table_p0/tvf/test_s3_tvf_globlist.out | Bin 0 -> 503 bytes
.../insert_group_commit_into_max_filter_ratio.out | Bin 297 -> 290 bytes
.../http_stream/test_group_commit_http_stream.out | Bin 260 -> 284 bytes
.../test_insert_strict_mode_and_filter_ratio.out | Bin 0 -> 1104 bytes
.../data/load_p0/load_ddl/full_columns_data.csv | 0
.../load_ddl/test_load_ddl_hidden_column.csv | 1 +
.../test_load_ddl_hidden_column_with_func.csv | 1 +
.../load_ddl/test_load_ddl_unavaliable_column.csv | 1 +
.../load_p0/mysql_load/test_decimal_overflow.csv | 10 +
...est_mysql_load_strict_mode_and_filter_ratio.out | Bin 0 -> 1427 bytes
.../data/load_p0/mysql_load/test_no_partition.csv | 10 +
.../data/load_p0/mysql_load/test_not_number.csv | 10 +
.../data/load_p0/mysql_load/test_null_number.csv | 10 +
...t_routine_load_strict_mode_and_filter_ratio.out | Bin 0 -> 473 bytes
.../load_p0/stream_load/chinese_col_complex.csv | 3 +
.../stream_load/load_json_null_to_nullable.out | Bin 157 -> 150 bytes
.../data/load_p0/stream_load/test_char.json | 2 +-
.../load_p0/stream_load/test_decimal_overflow.csv | 10 +
.../data/load_p0/stream_load/test_no_partition.csv | 10 +
.../data/load_p0/stream_load/test_not_number.csv | 10 +
.../data/load_p0/stream_load/test_null_number.csv | 10 +
...st_stream_load_strict_mode_and_filter_ratio.out | Bin 0 -> 1427 bytes
.../tvf/test_tvf_strict_mode_and_filter_ratio.out | Bin 0 -> 983 bytes
.../test_base_alter_col_type_multi_level_mtmv.out | Bin 452 -> 445 bytes
.../test_base_drop_col_multi_level_mtmv.out | Bin 428 -> 421 bytes
.../mtmv_p0/test_base_drop_multi_level_mtmv.out | Bin 400 -> 393 bytes
.../test_base_rename_col_multi_level_mtmv.out | Bin 436 -> 429 bytes
.../mtmv_p0/test_base_rename_multi_level_mtmv.out | Bin 408 -> 401 bytes
.../mtmv_p0/test_base_replace_multi_level_mtmv.out | Bin 1075 -> 1061 bytes
.../data/mtmv_p0/test_multi_level_mtmv.out | Bin 445 -> 438 bytes
.../data/nereids_function_p0/scalar_function/S.out | Bin 53858 -> 53416 bytes
.../data/nereids_function_p0/scalar_function/U.out | Bin 2752 -> 2418 bytes
.../nereids_p0/insert_into_table/insert_values.out | Bin 2606 -> 2613 bytes
.../datetime_functions/test_date_function.out | Bin 11069 -> 10701 bytes
.../stats/col_stats/hot_value_str_to_date.out | Bin 0 -> 245 bytes
.../unique_function/agg_with_unique_function.out | Bin 13561 -> 13017 bytes
.../data/prepared_stmt_p0/prepared_stmt.out | Bin 5389 -> 5414 bytes
.../conditional_functions/test_json_parse.out | Bin 1066 -> 1666 bytes
.../datetime_functions/test_date_floor_ceil.out | Bin 6924 -> 6504 bytes
.../datetime_functions/test_date_function.out | Bin 10819 -> 10539 bytes
.../datetime_functions/test_from_iso8601_date.out | Bin 2676 -> 1925 bytes
.../ip_functions/test_is_ip_string_functions.out | Bin 171 -> 550 bytes
.../sql_functions/json_functions/json_search.out | Bin 6323 -> 7471 bytes
.../json_functions/test_json_exists_path.out | Bin 0 -> 1132 bytes
.../json_functions/test_json_extract.out | Bin 1893 -> 2936 bytes
.../json_functions/test_json_function.out | Bin 2996 -> 3586 bytes
.../test_schema_change_with_empty_rowset.out} | Bin 157 -> 116 bytes
regression-test/data/tpch_sf0.1_p1/sql/cse.out | Bin 455 -> 3579 bytes
.../regression/action/StreamLoadAction.groovy | 48 +-
.../org/apache/doris/regression/util/Hdfs.groovy | 20 +-
.../pipeline/cloud_p0/conf/be_custom.conf | 3 +
.../bloom_filter_p0/test_bloom_filter_hit.groovy | 1 +
.../suites/cast_p0/cast_between_datetime.groovy | 30 +-
regression-test/suites/cast_p0/cast_to_time.groovy | 10 +
...test_warm_up_cluster_event_schema_change.groovy | 6 +-
...test_warm_up_cluster_periodic_add_new_be.groovy | 1 +
.../test_from_millisecond_microsecond.groovy | 59 +-
.../suites/correctness/test_str_to_date.groovy | 41 +-
...est_colocate_join_with_different_tablets.groovy | 3479 ++++++++++++++++++++
.../test_ctas_mv/test_ctas_mv.groovy | 2 +
.../test_inlineview_with_window_function.groovy | 2 +
.../test_mv_case/test_mv_case.groovy | 2 +
.../test_select_with_predicate_like.groovy | 2 +
.../suites/correctness_p0/test_time_round.groovy | 28 +-
.../csv_header_p0/test_csv_with_header.groovy | 84 +-
.../datatype_p0/date/test_from_unixtime.groovy | 19 +-
.../suites/datatype_p0/decimalv3/test_load.groovy | 3 +-
.../one_level_nestedtypes_with_s3data.groovy | 1 -
..._nested_types_insert_into_with_agg_table.groovy | 10 +
..._nested_types_insert_into_with_dup_table.groovy | 10 +
...sted_types_insert_into_with_unique_table.groovy | 20 +
.../test_nested_types_insert_into_with_s3.groovy | 3 +
...test_nestedtypes_csv_insert_into_with_s3.groovy | 1 +
...est_nestedtypes_json_insert_into_with_s3.groovy | 1 +
...tions.groovy => doc_date_functions_test.groovy} | 79 +-
.../outfile/csv/test_outfile_csv_map_type.groovy | 2 +
.../parquet/test_outfile_parquet_map_type.groovy | 2 +
.../test_export_table_with_label_retry.groovy | 3 +
.../export_p0/test_outfile_orc_map_type.groovy | 2 +
.../external_table_p0/es/test_es_query.groovy | 2 +
.../hive/ddl/test_hive_write_type.groovy | 4 +-
.../iceberg/test_iceberg_optimize_count.groovy | 12 +-
.../jdbc/test_doris_jdbc_catalog.groovy | 17 +
.../jdbc/test_jdbc_query_pg.groovy | 30 +-
.../tvf/test_file_tvf_hdfs.groovy | 6 +-
.../tvf/test_hdfs_parquet_group4.groovy | 4 +-
.../tvf/test_hdfs_parquet_group5.groovy | 4 +-
.../tvf/test_hdfs_parquet_group6.groovy | 6 +-
.../external_table_p0/tvf/test_hdfs_tvf.groovy | 6 +-
.../tvf/test_s3_tvf_globlist.groovy | 54 +
.../test_disable_move_memtable.groovy | 4 +-
...nsert_group_commit_into_max_filter_ratio.groovy | 4 +-
.../suites/insert_p0/test_struct_insert.groovy | 1 +
.../test_group_commit_http_stream.groovy | 7 +-
.../http_stream/test_http_stream_properties.groovy | 2 +-
...test_insert_strict_mode_and_filter_ratio.groovy | 409 +++
.../data/load_ddl_basic_data_json_by_line.json | 0
.../load_p0/load_ddl/ddl/agg_tbl_basic_create.sql | 58 +
.../load_p0/load_ddl/ddl/agg_tbl_basic_drop.sql | 1 +
.../ddl/test_load_ddl_hidden_column_create.sql | 21 +
.../ddl/test_load_ddl_hidden_column_drop.sql | 1 +
.../test_load_ddl_unavaliable_column_create.sql | 19 +
.../ddl/test_load_ddl_unavaliable_column_drop.sql | 1 +
.../suites/load_p0/load_ddl/test_load_ddl.groovy | 216 ++
.../test_routine_load_advanced_mapping.groovy | 202 ++
.../test_stream_load_advanced_mapping.groovy | 327 ++
..._mysql_load_strict_mode_and_filter_ratio.groovy | 365 ++
.../routine_load/data/test_decimal_overflow.csv | 10 +
.../routine_load/data/test_no_partition.csv | 10 +
.../load_p0/routine_load/data/test_not_number.csv | 10 +
.../data/test_strict_mode_and_filter_ratio.csv | 10 +
.../routine_load/test_routine_load_alter.groovy | 6 +-
...outine_load_strict_mode_and_filter_ratio.groovy | 411 +++
.../routine_load/test_routine_load_with_sc.groovy | 1 +
.../stream_load/load_json_null_to_nullable.groovy | 15 +-
.../stream_load/test_chinese_col_load.groovy | 128 +
.../test_s3_bytes_written_metrics.groovy | 80 +
.../load_p0/stream_load/test_stream_load.groovy | 1 +
...stream_load_strict_mode_and_filter_ratio.groovy | 526 +++
.../load_p0/tvf/test_tvf_error_column.groovy | 6 +-
.../suites/load_p0/tvf/test_tvf_error_data.groovy | 12 +
.../test_tvf_strict_mode_and_filter_ratio.groovy | 312 ++
...est_base_alter_col_type_multi_level_mtmv.groovy | 2 +-
.../test_base_drop_col_multi_level_mtmv.groovy | 2 +-
.../mtmv_p0/test_base_drop_multi_level_mtmv.groovy | 2 +-
.../test_base_rename_col_multi_level_mtmv.groovy | 2 +-
.../test_base_rename_multi_level_mtmv.groovy | 2 +-
.../test_base_replace_multi_level_mtmv.groovy | 2 +-
.../mv_p0/mv_negative/agg_negative_test.groovy | 2 +
.../mv_p0/mv_negative/dup_negative_test.groovy | 2 +
.../mv_p0/mv_negative/mor_negative_test.groovy | 2 +
.../mv_p0/mv_negative/mow_negative_test.groovy | 2 +
.../suites/mv_p0/test_o2/test_o2.groovy | 2 +
.../suites/nereids_function_p0/load.groovy | 8 +-
.../nereids_function_p0/scalar_function/S.groovy | 20 +-
.../nereids_function_p0/scalar_function/U.groovy | 20 +-
.../cache/parse_sql_from_sql_cache.groovy | 2 +
.../fold_constant_date_arithmatic.groovy | 13 +-
.../fold_constant/fold_constant_nullable.groovy | 2 +-
.../insert_into_table/complex_insert.groovy | 2 +
.../insert_into_table/insert_values.groovy | 4 +-
.../nereids_p0/show/test_nereids_show_views.groovy | 57 +
.../datetime_functions/test_date_function.groovy | 31 +-
.../stats/col_stats/hot_value_str_to_date.groovy | 60 +
.../test_select_with_predicate_like.groovy | 3 +-
.../mv/date_trunc/mv_with_date_trunc.groovy | 10 +-
.../union_all_compensate.groovy | 2 +
.../union_rewrite_grace_big.groovy | 2 +
.../partition_prune/always_mono_func.groovy | 2 +-
.../multi_column_range_partition.groovy | 8 +-
.../partition_prune/test_convert_tz.groovy | 9 +-
...une_mono.groovy => test_date_prune_mono.groovy} | 2 +-
.../partition_prune/test_date_trunc_prune.groovy | 2 +-
.../suites/nereids_syntax_p0/any_value.groovy | 1 +
.../nereids_syntax_p0/test_cast_datetime.groovy | 2 +
.../suites/nereids_tpch_p0/tpch/agg_cse.groovy | 15 +
.../test_col_data_type_boundary.groovy | 2 +
.../suites/point_query_p0/test_point_query.groovy | 2 +
regression-test/suites/postgres/load.groovy | 4 +
.../suites/prepared_stmt_p0/prepared_stmt.groovy | 29 +
.../aggregate/aggregate_max_min_by_test.groovy | 2 +
.../conditional_functions/test_json_parse.groovy | 27 +-
.../datetime_functions/test_date_floor_ceil.groovy | 76 +-
.../datetime_functions/test_date_function.groovy | 94 +-
.../test_from_iso8601_date.groovy | 167 +-
.../test_is_ip_string_functions.groovy | 23 +-
.../json_functions/json_search.groovy | 39 +-
.../json_functions/test_json_exists_path.groovy | 180 +
.../json_functions/test_json_extract.groovy | 111 +-
.../json_functions/test_json_function.groovy | 49 +-
.../test_select_with_predicate_like.groovy | 35 -
.../suites/query_p0/topn_lazy/topn_lazy.groovy | 9 +-
.../test_agg_schema_key_change_modify1.groovy | 1 +
.../test_dup_schema_key_change_modify1.groovy | 1 +
...test_schema_change_mow_with_empty_rowset.groovy | 1 +
...=> test_schema_change_with_empty_rowset.groovy} | 23 +-
.../test_schema_reordering_dup.groovy | 1 +
.../test_schema_reordering_unique.groovy | 2 +
.../test_unique_schema_key_change_modify.groovy | 1 +
.../statistics/test_drop_stats_and_truncate.groovy | 4 +
.../suites/tpch_sf0.1_p1/sql/cse.groovy | 11 +-
425 files changed, 13659 insertions(+), 4369 deletions(-)
create mode 100644 be/src/vec/functions/datetime_errors.h
delete mode 100644 be/src/vec/functions/function_convert_tz.h
delete mode 100644 be/src/vec/functions/function_date_or_datetime_to_string.h
rename be/src/vec/functions/{function_timestamp.cpp =>
function_other_types_to_date.cpp} (79%)
rename be/test/expected_result/vec/data_types/{timev2_0_to_string.out =>
TimeV2_0_to_string.out} (100%)
rename be/test/expected_result/vec/data_types/{timev2_0_to_string_2.out =>
TimeV2_0_to_string_2.out} (100%)
rename be/test/expected_result/vec/data_types/{timev2_0_to_string_3.out =>
TimeV2_0_to_string_3.out} (100%)
rename be/test/expected_result/vec/data_types/{timev2_0_to_string_batch.out =>
TimeV2_0_to_string_batch.out} (100%)
rename be/test/expected_result/vec/data_types/{timev2_5_to_string.out =>
TimeV2_5_to_string.out} (100%)
rename be/test/expected_result/vec/data_types/{timev2_5_to_string_2.out =>
TimeV2_5_to_string_2.out} (100%)
rename be/test/expected_result/vec/data_types/{timev2_5_to_string_3.out =>
TimeV2_5_to_string_3.out} (100%)
rename be/test/expected_result/vec/data_types/{timev2_5_to_string_batch.out =>
TimeV2_5_to_string_batch.out} (100%)
rename be/test/expected_result/vec/data_types/{timev2_6_to_string.out =>
TimeV2_6_to_string.out} (100%)
rename be/test/expected_result/vec/data_types/{timev2_6_to_string_2.out =>
TimeV2_6_to_string_2.out} (100%)
rename be/test/expected_result/vec/data_types/{timev2_6_to_string_3.out =>
TimeV2_6_to_string_3.out} (100%)
rename be/test/expected_result/vec/data_types/{timev2_6_to_string_batch.out =>
TimeV2_6_to_string_batch.out} (100%)
delete mode 100644 be/test/expected_result/vec/data_types/timev2_to_string.out
delete mode 100644
be/test/expected_result/vec/data_types/timev2_to_string_2.out
delete mode 100644
be/test/expected_result/vec/data_types/timev2_to_string_3.out
delete mode 100644
be/test/expected_result/vec/data_types/timev2_to_string_batch.out
rename be/test/vec/data_types/{data_type_time_v2_test.cpp =>
data_type_datetime_v2_test.cpp} (96%)
delete mode 100644 be/test/vec/function/function_convert_tz_test.cpp
create mode 100644
docker/thirdparties/docker-compose/elasticsearch/scripts/index/es7_test_object.json
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/PreparePlaceholder.java
copy be/src/util/asan_util.h =>
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/PrepareCommandPlanner.java
(50%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/StatisticsMetricCollector.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/tvf/source/MetadataScanNodeTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/trees/expressions/functions/executable/NumericArithmeticTest.java
copy
regression-test/data/{query_p0/sql_functions/ip_functions/test_is_ip_string_functions.out
=> cast_p0/cast_between_datetime.out} (73%)
rename regression-test/data/doc/sql-manual/sql-functions/{date_functions.out
=> doc_date_functions_test.out} (97%)
create mode 100644
regression-test/data/external_table_p0/tvf/test_s3_tvf_globlist.out
create mode 100644
regression-test/data/load_p0/insert/test_insert_strict_mode_and_filter_ratio.out
copy docker/thirdparties/docker-compose/kafka/scripts/basic_data.csv =>
regression-test/data/load_p0/load_ddl/full_columns_data.csv (100%)
create mode 100644
regression-test/data/load_p0/load_ddl/test_load_ddl_hidden_column.csv
create mode 100644
regression-test/data/load_p0/load_ddl/test_load_ddl_hidden_column_with_func.csv
create mode 100644
regression-test/data/load_p0/load_ddl/test_load_ddl_unavaliable_column.csv
create mode 100644
regression-test/data/load_p0/mysql_load/test_decimal_overflow.csv
create mode 100644
regression-test/data/load_p0/mysql_load/test_mysql_load_strict_mode_and_filter_ratio.out
create mode 100644
regression-test/data/load_p0/mysql_load/test_no_partition.csv
create mode 100644 regression-test/data/load_p0/mysql_load/test_not_number.csv
create mode 100644 regression-test/data/load_p0/mysql_load/test_null_number.csv
create mode 100644
regression-test/data/load_p0/routine_load/test_routine_load_strict_mode_and_filter_ratio.out
create mode 100644
regression-test/data/load_p0/stream_load/chinese_col_complex.csv
create mode 100644
regression-test/data/load_p0/stream_load/test_decimal_overflow.csv
create mode 100644
regression-test/data/load_p0/stream_load/test_no_partition.csv
create mode 100644 regression-test/data/load_p0/stream_load/test_not_number.csv
create mode 100644
regression-test/data/load_p0/stream_load/test_null_number.csv
create mode 100644
regression-test/data/load_p0/stream_load/test_stream_load_strict_mode_and_filter_ratio.out
create mode 100644
regression-test/data/load_p0/tvf/test_tvf_strict_mode_and_filter_ratio.out
create mode 100644
regression-test/data/nereids_p0/stats/col_stats/hot_value_str_to_date.out
create mode 100644
regression-test/data/query_p0/sql_functions/json_functions/test_json_exists_path.out
copy regression-test/data/{load_p0/stream_load/load_json_null_to_nullable.out
=> schema_change_p0/test_schema_change_with_empty_rowset.out} (61%)
copy be/src/vec/functions/function_convert_tz.cpp =>
regression-test/suites/cast_p0/cast_between_datetime.groovy (57%)
rename
regression-test/suites/doc/sql-manual/sql-functions/{date_functions.groovy =>
doc_date_functions_test.groovy} (97%)
create mode 100644
regression-test/suites/external_table_p0/tvf/test_s3_tvf_globlist.groovy
create mode 100644
regression-test/suites/load_p0/insert/test_insert_strict_mode_and_filter_ratio.groovy
copy
docker/thirdparties/docker-compose/kafka/scripts/basic_data_json_by_line.json
=>
regression-test/suites/load_p0/load_ddl/data/load_ddl_basic_data_json_by_line.json
(100%)
create mode 100644
regression-test/suites/load_p0/load_ddl/ddl/agg_tbl_basic_create.sql
create mode 100644
regression-test/suites/load_p0/load_ddl/ddl/agg_tbl_basic_drop.sql
create mode 100644
regression-test/suites/load_p0/load_ddl/ddl/test_load_ddl_hidden_column_create.sql
create mode 100644
regression-test/suites/load_p0/load_ddl/ddl/test_load_ddl_hidden_column_drop.sql
create mode 100644
regression-test/suites/load_p0/load_ddl/ddl/test_load_ddl_unavaliable_column_create.sql
create mode 100644
regression-test/suites/load_p0/load_ddl/ddl/test_load_ddl_unavaliable_column_drop.sql
create mode 100644 regression-test/suites/load_p0/load_ddl/test_load_ddl.groovy
create mode 100644
regression-test/suites/load_p0/load_ddl/test_routine_load_advanced_mapping.groovy
create mode 100644
regression-test/suites/load_p0/load_ddl/test_stream_load_advanced_mapping.groovy
create mode 100644
regression-test/suites/load_p0/mysql_load/test_mysql_load_strict_mode_and_filter_ratio.groovy
create mode 100644
regression-test/suites/load_p0/routine_load/data/test_decimal_overflow.csv
create mode 100644
regression-test/suites/load_p0/routine_load/data/test_no_partition.csv
create mode 100644
regression-test/suites/load_p0/routine_load/data/test_not_number.csv
create mode 100644
regression-test/suites/load_p0/routine_load/data/test_strict_mode_and_filter_ratio.csv
create mode 100644
regression-test/suites/load_p0/routine_load/test_routine_load_strict_mode_and_filter_ratio.groovy
create mode 100644
regression-test/suites/load_p0/stream_load/test_chinese_col_load.groovy
create mode 100644
regression-test/suites/load_p0/stream_load/test_s3_bytes_written_metrics.groovy
create mode 100644
regression-test/suites/load_p0/stream_load/test_stream_load_strict_mode_and_filter_ratio.groovy
create mode 100644
regression-test/suites/load_p0/tvf/test_tvf_strict_mode_and_filter_ratio.groovy
create mode 100644
regression-test/suites/nereids_p0/show/test_nereids_show_views.groovy
create mode 100644
regression-test/suites/nereids_p0/stats/col_stats/hot_value_str_to_date.groovy
rename
regression-test/suites/nereids_rules_p0/partition_prune/{test_date_function_prune_mono.groovy
=> test_date_prune_mono.groovy} (99%)
create mode 100644
regression-test/suites/query_p0/sql_functions/json_functions/test_json_exists_path.groovy
delete mode 100644
regression-test/suites/query_p0/test_select_with_predicate_like.groovy
copy
regression-test/suites/schema_change_p0/{test_schema_change_mow_with_empty_rowset.groovy
=> test_schema_change_with_empty_rowset.groovy} (80%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
