This is an automated email from the ASF dual-hosted git repository.
kxiao pushed a change to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from 969dd9b4f45 [feat](Nereids) Support tablesample syntax (#23717)
(#25135)
new cfd44a5cb97 [typo](doc) fix error description about
load_to_single_tablet (#24270)
new f1edf77453f [fix](analysis)fix use regex determine whether time part
exists may cause backtracking (#24882)
new 94969e73431 [fix](help-module)fix use regex match replaceAll may cause
backtracking (#24918)
new bce289ece10 [fix](hudi) hbase-2.5.5 conflict with hudi (#25136)
new 9997871d780 [fix](parse_url) fix `parse_url` is not working in some
case to extract the HOST (#25040)
new 32b90a05142 [fix](load)fix use regex split partition may cause
backtracking (#24903)
new 1bccbf9b2d9 [fix](catalog)fix use regex parse partition may cause
backtracking (#24876)
new e6febc12d71 min max rf type (#25129)
new eaa00dcf883 [bugfix](policy) Forbid creating policy with same name
with different resource name (#25025)
new 74e5ecd3193 [bugfix](DDL) Fix the bug of incorrect partition policy
setting (#25021)
new f1f5e972837 [fix](Nereids) miss BoolLiteral when convert literal to
Nereids' one (#25159)
new d34f1d861a2 [fix](Nereids) deep copier generate wrong slot for TVF
(#25156)
new dbff64ccbbb [Bug](java-udf) fix java-udf memory leak (#25151)
new c341963deec [opt](Nereids) support like and regexp function (#25148)
new 2a08834e14f [enhancement](regression-test) add stream load json case
(#25168)
new 5781bd7b549 [fix](Insert select tvf) fix NPE because tvf do not have
catalog name (#25149)
new 922162fb882 [fix](Nereids) alias function support arithmetic functions
(#25162)
new c471d3589bc [Enhancement](log) Improve Safety and Robustness of Log4j
Configuration (#24861)
new 361acea3e9b [opt](Nereids) add two args signature to trim family
functions (#25169)
new e8e1e6178f6 [FIX](filter) update for filter_by_select logic (#25007)
new a530d6ccfe1 missed file for e8e1e6178f6e6191876941d2137c393ed188333d
new 535986cfdc1 [feature](Nereids) fold weeks_sub/add on fe (#25155)
new d980ca68c8f [FIX](serde)fix scale with decimalv2 in mysql writer which
get real scale #25190
new da480bbd774 [case](regresstest) update query for parquet/orc with
array/map nested type and insert into (#24746)
new c3f7ea0a80e fix: ubsan compile bug (#25199)
new 684f2da2408 [fix](case) Update analyze_stats.groovy (#25146)
new 6c543d7b74e [fix](httpserver) creating this cookie without the
"secure" flag and enabling cross-origin resource safe (#25107)
new 6f23a0f86bf [Fix](func numbers) Remove backend_nums argument of
numbers function (#25200)
new c7cf6a7a91b [fix](stack trace) Optimize stack trace output (#24933)
new cf0b763281e [enhancement](regression-test) open routine load
regression test by default and add data check (#25122)
new 76488d18ee0 [regression-test](merge-on-write) Fix partial update
concurrency conflict case (#25212)
new 343d649a3bc [FIX](array_function) fix array_map function with array
index function without checkout arg… #25226
new 3b3cd921e85 [enhancement](node) add filter in partition sort node in
BE #25188
new 462c3f9dc5b [compile](simdjson reader) use `__AVX2__` macro to decide
whether use simdjson to parse (#25165)
new f540d164acb [Chore](cases) set enable_nereids_planner on mv cases
(#25277)
new 369dd5d597e [enhancement](nereids)add eliminate filter on one row
relation rule (#24980)
new f25adf6d03f [test](nereids)add more case in
PushdownFilterThroughAggregationTest (#24927)
new c03ed2f897b [fix](nereids)disable parallel scan in some case (#25089)
new e8db348b800 [fix](planner)implicit cast should use type member
variable instead of targetTypeDef (#24582)
new 7ff5a4c0e19 [fix](planner)should always use plan node's getTblRefIds
method to get unassigned conjuncts for this node (#25130)
new d3a1d6ba798 [fix](planner)need call materializeSrcExpr for
materialized slots in join node (#25204)
new 40516486082 [fix](point-query) Support mow table with sequence column
(#25308)
new cbe7e129ff8 [fix](case) use the custom DB explicitly in
analyze_stats.groovy (#25285)
new 5696daf1825 [enhancement](regression-test) add routine load json case
(#25253)
new a4bbd132ca0 [bugfix](stream receiver) be will core during stop because
receiver is not closed (#25298)
new d9fccf56579 [fix](catalog)fix when modifying comments in property, it
will modify the comments in the catalog (#24857)
new d9357cc58f3 [fix](Nereids)Fix the bug that count(*) does not push down
for tables with only one column. (#25222)
The 47 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/CMakeLists.txt | 2 +-
be/src/olap/schema.cpp | 20 -
be/src/service/point_query_executor.cpp | 2 +-
be/src/util/url_parser.cpp | 5 +
be/src/vec/columns/column.h | 11 +-
be/src/vec/columns/column_array.cpp | 32 -
be/src/vec/columns/column_array.h | 2 -
be/src/vec/columns/column_complex.h | 4 -
be/src/vec/columns/column_const.h | 2 -
be/src/vec/columns/column_decimal.h | 2 -
be/src/vec/columns/column_dictionary.h | 4 -
be/src/vec/columns/column_fixed_length_object.h | 2 -
be/src/vec/columns/column_map.cpp | 34 -
be/src/vec/columns/column_map.h | 2 -
be/src/vec/columns/column_nullable.cpp | 12 +-
be/src/vec/columns/column_nullable.h | 2 -
be/src/vec/columns/column_object.cpp | 17 +-
be/src/vec/columns/column_object.h | 2 -
be/src/vec/columns/column_string.h | 2 -
be/src/vec/columns/column_struct.cpp | 10 -
be/src/vec/columns/column_struct.h | 2 -
be/src/vec/columns/column_vector.h | 7 -
be/src/vec/columns/predicate_column.h | 4 -
.../vec/exec/data_gen_functions/vnumbers_tvf.cpp | 3 +
be/src/vec/exec/format/json/new_json_reader.cpp | 3 +
be/src/vec/exec/scan/vscan_node.cpp | 6 +
be/src/vec/exec/vpartition_sort_node.cpp | 8 +-
be/src/vec/functions/array/function_array_index.h | 4 +
be/src/vec/functions/function_java_udf.cpp | 56 +-
be/src/vec/functions/function_java_udf.h | 4 -
be/src/vec/runtime/vdata_stream_mgr.cpp | 6 +
be/src/vec/sink/vmysql_result_writer.cpp | 10 +-
be/test/vec/function/function_string_test.cpp | 4 +
.../kafka/scripts/basic_array_data_json.json | 1 +
.../scripts/basic_array_data_json_by_line.json | 18 +
.../kafka/scripts/basic_data_json.json | 1 +
.../kafka/scripts/basic_data_json_by_line.json | 20 +
docker/thirdparties/run-thirdparties-docker.sh | 13 +-
.../sql-functions/table-functions/numbers.md | 4 +-
.../Alter/ALTER-CATALOG.md | 15 +
.../Create/CREATE-CATALOG.md | 4 +-
.../Load/BROKER-LOAD.md | 2 +-
.../Load/CREATE-ROUTINE-LOAD.md | 2 +-
.../Load/STREAM-LOAD.md | 48 +-
.../sql-functions/table-functions/numbers.md | 4 +-
.../Alter/ALTER-CATALOG.md | 15 +
.../Create/CREATE-CATALOG.md | 4 +-
.../Load/BROKER-LOAD.md | 2 +-
.../Load/CREATE-ROUTINE-LOAD.md | 2 +-
.../Load/STREAM-LOAD.md | 27 +-
.../main/java/org/apache/doris/common/Config.java | 7 +
fe/fe-core/src/main/cup/sql_parser.cup | 4 +
.../catalog/converters/PartitionNameParser.java | 13 +-
.../doris/analysis/AlterCatalogCommentStmt.java | 49 ++
.../doris/analysis/AlterCatalogNameStmt.java | 26 +-
.../doris/analysis/AlterCatalogPropertyStmt.java | 33 +-
...rCatalogNameStmt.java => AlterCatalogStmt.java} | 40 +-
.../java/org/apache/doris/analysis/Analyzer.java | 9 +-
.../java/org/apache/doris/analysis/CastExpr.java | 3 +-
.../org/apache/doris/analysis/DateLiteral.java | 25 +-
.../java/org/apache/doris/analysis/DeleteStmt.java | 10 +-
.../org/apache/doris/analysis/SlotDescriptor.java | 1 +
.../org/apache/doris/analysis/StmtRewriter.java | 3 +
.../doris/catalog/BuiltinScalarFunctions.java | 4 +
.../java/org/apache/doris/common/Log4jConfig.java | 19 +-
.../org/apache/doris/common/MarkDownParser.java | 15 +-
.../apache/doris/datasource/CatalogFactory.java | 8 +-
.../org/apache/doris/datasource/CatalogIf.java | 3 +
.../org/apache/doris/datasource/CatalogMgr.java | 34 +
.../apache/doris/datasource/ExternalCatalog.java | 6 -
.../apache/doris/datasource/InternalCatalog.java | 15 +-
.../apache/doris/httpv2/config/WebConfigurer.java | 2 +-
.../doris/httpv2/controller/BaseController.java | 1 +
.../org/apache/doris/journal/JournalEntity.java | 1 +
.../glue/translator/PhysicalPlanTranslator.java | 31 +
.../org/apache/doris/nereids/rules/RuleType.java | 2 +
.../nereids/rules/analysis/BindExpression.java | 7 +-
.../rules/expression/rules/FunctionBinder.java | 9 +-
.../rules/implementation/AggregateStrategies.java | 7 +
.../nereids/rules/rewrite/EliminateFilter.java | 61 +-
.../rewrite/PushdownFilterThroughSetOperation.java | 27 +-
.../trees/copier/LogicalPlanDeepCopier.java | 2 +-
.../expressions/functions/FunctionBuilder.java | 6 +-
.../functions/executable/DateTimeArithmetic.java | 48 +-
.../trees/expressions/functions/scalar/Ltrim.java | 20 +-
.../trees/expressions/functions/scalar/Rtrim.java | 20 +-
.../trees/expressions/functions/scalar/Trim.java | 20 +-
.../expressions/functions/udf/AliasUdfBuilder.java | 4 +-
.../trees/expressions/literal/DateLiteral.java | 5 +
.../trees/expressions/literal/DateTimeLiteral.java | 5 +
.../expressions/literal/DateTimeV2Literal.java | 7 +
.../trees/expressions/literal/DateV2Literal.java | 5 +
.../nereids/trees/expressions/literal/Literal.java | 17 +-
.../java/org/apache/doris/persist/EditLog.java | 5 +
.../org/apache/doris/persist/OperationType.java | 2 +
.../org/apache/doris/planner/DataGenScanNode.java | 10 +
.../org/apache/doris/planner/JoinNodeBase.java | 7 +-
.../org/apache/doris/planner/PlanFragment.java | 2 +
.../java/org/apache/doris/policy/PolicyMgr.java | 11 +-
.../main/java/org/apache/doris/qe/Coordinator.java | 15 +-
.../main/java/org/apache/doris/qe/DdlExecutor.java | 3 +
.../java/org/apache/doris/qe/MultiLoadMgr.java | 41 +-
.../tablefunction/NumbersTableValuedFunction.java | 32 +-
.../java/org/apache/doris/task/StreamLoadTask.java | 10 +-
.../java/org/apache/doris/alter/AlterTest.java | 37 +
.../apache/doris/datasource/CatalogMgrTest.java | 19 +-
.../rules/analysis/FunctionRegistryTest.java | 2 +-
.../nereids/rules/expression/FoldConstantTest.java | 5 +-
.../PushdownFilterThroughAggregationTest.java | 58 ++
.../doris/nereids/util/LogicalPlanBuilder.java | 9 +-
.../org/apache/doris/planner/QueryPlanTest.java | 24 +-
fe/pom.xml | 16 -
gensrc/thrift/PlanNodes.thrift | 17 +
.../test_inlineview_with_project.out | 3 +
.../test_nested_types_insert_into_with_s3.out | 192 ++++
.../data/delete_p0/test_array_column_delete.out | 2 +
.../data/delete_p0/test_map_column_delete.out | 5 +-
.../data/delete_p0/test_struct_column_delete.out | 5 +-
.../tvf/test_insert_from_tvf_with_common_user.out} | 12 +-
.../load_p0/routine_load/test_routine_load.out | 966 ++++++++++++++++++++-
.../data/load_p0/stream_load/basic_array_data.json | 1 +
.../stream_load/basic_array_data_by_line.json | 18 +
.../data/load_p0/stream_load/basic_data.json | 1 +
.../load_p0/stream_load/basic_data_by_line.json | 20 +
.../stream_load/test_stream_load_properties.out | 432 +++++++++
.../data/nereids_function_p0/scalar_function/L.out | 95 +-
.../data/nereids_function_p0/scalar_function/R.out | 87 ++
.../data/nereids_function_p0/scalar_function/T.out | 90 +-
.../data/nereids_p0/test_filter_pushdown_set.out | 24 +
regression-test/data/nereids_p0/with/test_with.out | 5 +
.../data/performance_p0/redundant_conjuncts.out | 4 +
.../data/point_query_p0/test_point_query.out | 168 ++++
regression-test/data/query_p0/arr_max.orc | Bin 0 -> 777600 bytes
.../test_array_with_single_row_max_than_uint16.out | 8 +
.../view/test_view2.out} | 9 +-
.../partial_update/partial_update_parallel1.csv | 5 +
.../partial_update/partial_update_parallel2.csv | 5 +
.../partial_update/partial_update_parallel3.csv | 5 +
.../test_partial_update_parallel.out | 8 +
.../pipeline/p0/conf/regression-conf.groovy | 6 +
.../cold_heat_separation/policy/create.groovy | 48 +
.../suites/correctness_p0/test_implict_cast.groovy | 47 +
.../test_inlineview_with_project.groovy | 73 ++
.../test_push_conjuncts_inlineview.groovy | 34 +
.../test_nested_types_insert_into_with_s3.groovy | 286 ++++++
.../delete_p0/test_array_column_delete.groovy | 6 +-
.../suites/delete_p0/test_map_column_delete.groovy | 6 +-
.../delete_p0/test_struct_column_delete.groovy | 6 +-
.../external_table_p0/test_catalog_ddl.groovy | 47 +
.../test_insert_from_tvf_with_common_user.groovy | 109 +++
.../hive/test_select_count_optimize.groovy | 102 +++
.../http_rest_api/post/test_query_stmt.groovy | 2 +-
.../index_change/test_index_change_7.groovy | 141 ---
.../inverted_index_p0/test_array_index.groovy | 73 --
.../load_p0/routine_load/test_routine_load.groovy | 435 +++++++++-
.../stream_load/test_stream_load_properties.groovy | 150 ++++
.../agg_have_dup_base/agg_have_dup_base.groovy | 2 +-
.../mv_p0/sum_divede_count/sum_devide_count.groovy | 2 +-
.../testAggQueryOnAggMV1.groovy | 2 +-
.../testAggQueryOnAggMV10.groovy | 1 +
.../testAggQueryOnAggMV2.groovy | 2 +-
.../testAggQueryOnAggMV3.groovy | 2 +-
.../testAggQuqeryOnAggMV5.groovy | 1 +
.../testAggQuqeryOnAggMV6.groovy | 2 +-
.../testAggQuqeryOnAggMV7.groovy | 2 +-
.../testCountDistinctToBitmap.groovy | 2 +-
.../testJoinOnLeftProjectToJoin.groovy | 2 +-
.../mv_p0/ut/testNDVToHll/testNDVToHll.groovy | 2 +-
.../mv_p0/ut/testSubQuery/testSubQuery.groovy | 1 +
.../suites/mv_p0/where/k123/k123.groovy | 1 +
.../nereids_function_p0/scalar_function/L.groovy | 6 +
.../nereids_function_p0/scalar_function/R.groovy | 30 +-
.../nereids_function_p0/scalar_function/T.groovy | 4 +
.../nereids_p0/javaudf/test_alias_function.groovy | 14 +
.../nereids_p0/test_disable_parallel_scan.groovy | 56 ++
.../nereids_p0/test_filter_pushdown_set.groovy | 24 +-
.../suites/nereids_p0/with/test_with.groovy | 3 +
.../nereids_syntax_p0/aggregate_strategies.groovy | 8 +-
.../suites/nereids_syntax_p0/function.groovy | 4 +-
.../nereids_syntax_p2/aggregate_strategies.groovy | 8 +-
.../suites/point_query_p0/test_point_query.groovy | 293 ++++---
.../array_functions/test_array_map_function.groovy | 13 +-
...st_array_with_single_row_max_than_uint16.groovy | 62 ++
.../suites/query_p0/view/test_view2.groovy | 154 ++++
.../suites/statistics/analyze_stats.groovy | 18 +-
.../test_partial_update_parallel.groovy | 41 +-
186 files changed, 4888 insertions(+), 1042 deletions(-)
create mode 100644
docker/thirdparties/docker-compose/kafka/scripts/basic_array_data_json.json
create mode 100644
docker/thirdparties/docker-compose/kafka/scripts/basic_array_data_json_by_line.json
create mode 100644
docker/thirdparties/docker-compose/kafka/scripts/basic_data_json.json
create mode 100644
docker/thirdparties/docker-compose/kafka/scripts/basic_data_json_by_line.json
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/AlterCatalogCommentStmt.java
copy
fe/fe-core/src/main/java/org/apache/doris/analysis/{AlterCatalogNameStmt.java
=> AlterCatalogStmt.java} (67%)
create mode 100644
regression-test/data/datatype_p0/nested_types/query/test_nested_types_insert_into_with_s3.out
copy regression-test/data/{correctness_p0/test_inlineview_with_project.out =>
external_table_p0/tvf/test_insert_from_tvf_with_common_user.out} (64%)
create mode 100644
regression-test/data/load_p0/stream_load/basic_array_data.json
create mode 100644
regression-test/data/load_p0/stream_load/basic_array_data_by_line.json
create mode 100644 regression-test/data/load_p0/stream_load/basic_data.json
create mode 100644
regression-test/data/load_p0/stream_load/basic_data_by_line.json
create mode 100644 regression-test/data/query_p0/arr_max.orc
create mode 100644
regression-test/data/query_p0/test_array_with_single_row_max_than_uint16.out
copy regression-test/data/{correctness_p0/test_inlineview_with_project.out =>
query_p0/view/test_view2.out} (62%)
create mode 100644
regression-test/data/unique_with_mow_p0/partial_update/partial_update_parallel1.csv
create mode 100644
regression-test/data/unique_with_mow_p0/partial_update/partial_update_parallel2.csv
create mode 100644
regression-test/data/unique_with_mow_p0/partial_update/partial_update_parallel3.csv
create mode 100644
regression-test/data/unique_with_mow_p0/partial_update/test_partial_update_parallel.out
create mode 100644
regression-test/suites/datatype_p0/nested_types/query/test_nested_types_insert_into_with_s3.groovy
create mode 100644
regression-test/suites/external_table_p0/test_catalog_ddl.groovy
create mode 100644
regression-test/suites/external_table_p0/tvf/test_insert_from_tvf_with_common_user.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/index_change/test_index_change_7.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/test_array_index.groovy
create mode 100644
regression-test/suites/nereids_p0/test_disable_parallel_scan.groovy
create mode 100644
regression-test/suites/query_p0/test_array_with_single_row_max_than_uint16.groovy
create mode 100644 regression-test/suites/query_p0/view/test_view2.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
