This is an automated email from the ASF dual-hosted git repository.
kxiao pushed a change to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from a6512c1c50 [fix](fe-meta) fix paimon file catalog meta issue and
replication num analysis issue (#24683)
new 79f9ecb7eb [Imporve](UNIX_TIMESTAMP) UNIX_TIMESTAMP func support
'yyyy-MM-dd HH:mm:ss' format (#24561)
new 7c45b214fa [fix](case) ensure jar downloaded (#24475)
new c94a971947 [fix](iceberg) should call UserGroupInformation when enable
security authentication (#24614)
new e6a4c21571 [Fix](RoutineLoad)multi-table query table error (#24538)
new 5856de5b6c [Improve](start-shell)Optimize fe&be startup (#24556)
new 7b6d97071d [Improve](Fe)Ensure that only one FE process uses the
metedata file (#24442)
new 0fc60b01dc [fix](Nereids) select outfile column order is wrong (#24595)
new 3c3f3c2539 [feature](jsonb)support json_length and json_contains
function (#24332)
new 8e9fc45acb [fix](nested_join) incorrect result of semi/anti mark join
(#24616)
new 08833b9907 [fix](broker) fix broker read issue (#24635)
new b14e85e210 [enhancement](be-meta) sync rocksdb by default to protect
data (#24571)
new eaa95144a7 [fix](broker-load) fix file offset for compressed file
#24564
new 39651722fe [fix](csv_reader)Fixed bug when parsing multi-character
delimiters. (#24572)
new dbd85106b7 [fix](multi-catalog)Es catalog needs to verify whether it
is a valid configuration. (#24309)
new 0ae98f8316 [fix](timezone) fix timezone parse when there is no tzfile
(#24578)
new 6090063a89 [Improve](array-func)improve array union support multi
params (#24327)
new d7e906eab5 [Fix](broker load) broker load with or predicate error fix
#24157
new 6fc19c1246 [feature](restore) Add thrift RestoreSnapshotRequest
support table alias (#24547)
new f35b251d9d [Fix](point query) Fix point query unstable (#24570)
new f04fe7b818 [bug](function) fix width bucket function return wrong
result (#24673)
The 20 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/common/config.cpp | 2 +-
be/src/olap/compaction.cpp | 9 +
be/src/olap/compaction.h | 1 +
be/src/runtime/runtime_state.h | 1 +
be/src/util/jsonb_document.h | 148 ++++++++++-
be/src/util/timezone_utils.cpp | 21 +-
be/src/util/timezone_utils.h | 4 +
be/src/vec/exec/format/csv/csv_reader.cpp | 22 +-
be/src/vec/exec/join/vnested_loop_join_node.cpp | 2 +-
be/src/vec/functions/array/function_array_map.h | 55 ++--
be/src/vec/functions/array/function_array_set.h | 5 -
.../vec/functions/array/function_array_union.cpp | 49 ++--
be/src/vec/functions/function_convert_tz.h | 2 +-
be/src/vec/functions/function_json.cpp | 9 +-
be/src/vec/functions/function_jsonb.cpp | 276 ++++++++++++++++++++-
be/src/vec/functions/function_width_bucket.cpp | 5 +-
be/test/testutil/function_utils.cpp | 10 +-
be/test/testutil/function_utils.h | 3 +-
be/test/vec/function/function_test_util.h | 7 +-
be/test/vec/function/function_time_test.cpp | 60 ++++-
bin/start_be.sh | 10 +-
bin/start_fe.sh | 10 +-
.../{json_contains.md => json-contains.md} | 14 +-
.../sql-functions/json-functions/json-length.md | 68 +++++
docs/sidebars.json | 2 +
.../{json_contains.md => json-contains.md} | 14 +-
.../sql-functions/json-functions/json-length.md | 68 +++++
.../src/main/java/org/apache/doris/DorisFE.java | 61 ++++-
.../apache/doris/analysis/FunctionCallExpr.java | 3 +-
.../java/org/apache/doris/backup/Snapshot.java | 4 -
.../doris/catalog/BuiltinScalarFunctions.java | 4 +
.../doris/catalog/HiveMetaStoreClientHelper.java | 19 ++
.../catalog/external/IcebergExternalTable.java | 26 +-
.../apache/doris/datasource/EsExternalCatalog.java | 5 +
.../apache/doris/datasource/ExternalCatalog.java | 11 +
.../datasource/iceberg/IcebergExternalCatalog.java | 20 +-
.../datasource/paimon/PaimonExternalCatalog.java | 11 -
.../doris/external/elasticsearch/EsRestClient.java | 5 +
.../doris/load/loadv2/LoadingTaskPlanner.java | 9 +
.../glue/translator/PhysicalPlanTranslator.java | 2 +-
.../expression/rules/SupportJavaDateFormatter.java | 14 ++
.../LogicalFileSinkToPhysicalFileSink.java | 1 +
...ogicalOlapTableSinkToPhysicalOlapTableSink.java | 3 +-
.../expressions/functions/scalar/ArrayUnion.java | 63 +----
.../{JsonbExtractBool.java => JsonContains.java} | 34 ++-
.../{JsonbExtractInt.java => JsonLength.java} | 34 ++-
.../expressions/visitor/ScalarFunctionVisitor.java | 10 +
.../trees/plans/logical/LogicalOlapTableSink.java | 15 +-
.../PhysicalDeferMaterializeResultSink.java | 12 +-
.../trees/plans/physical/PhysicalFileSink.java | 50 ++--
.../plans/physical/PhysicalOlapTableSink.java | 41 +--
.../trees/plans/physical/PhysicalResultSink.java | 12 +-
.../nereids/trees/plans/physical/PhysicalSink.java | 17 ++
.../doris/planner/external/FileGroupInfo.java | 13 +-
.../doris/planner/external/hudi/HudiScanNode.java | 19 +-
.../external/iceberg/IcebergMetadataCache.java | 6 +-
.../planner/external/iceberg/IcebergScanNode.java | 5 +
.../apache/doris/service/FrontendServiceImpl.java | 22 +-
.../apache/doris/utframe/TestWithFeService.java | 6 +
.../org/apache/doris/utframe/UtFrameUtils.java | 6 +
.../doris/broker/hdfs/FileSystemManager.java | 13 +-
gensrc/script/doris_builtins_functions.py | 46 ++--
gensrc/thrift/FrontendService.thrift | 1 +
.../data/jsonb_p0/test_jsonb_load_and_function.out | 262 +++++++++++++++++++
.../test_jsonb_load_unique_key_and_function.out | 238 ++++++++++++++++++
.../load_p0/broker_load/broker_load_with_where.csv | 6 +
.../data/load_p0/broker_load/test_array_load.out | 12 +
.../load_p0/stream_load/test_csv_split_line.out | 42 ++++
.../load_p0/stream_load/test_csv_split_line2.csv | 5 +-
.../load_p0/stream_load/test_csv_split_line3.csv | 3 +
.../load_p0/stream_load/test_csv_split_line4.csv | 16 ++
.../data/load_p0/stream_load/test_json_load.out | 6 +
.../nereids_function_p0/scalar_function/Array.out | 128 +++++-----
.../nereids_syntax_p0/sub_query_correlated.out | 8 -
.../array_functions/test_array_functions.out | 33 ++-
.../test_array_functions_by_literal.out | 40 +--
.../datetime_functions/test_date_function.out | 3 +
.../json_functions/test_json_function.out | 14 +-
.../test_width_bucket_function.out | 15 ++
.../org/apache/doris/regression/suite/Suite.groovy | 3 +-
.../ccr_mow_syncer_p0/test_get_binlog.groovy | 2 +-
.../suites/ccr_mow_syncer_p0/test_txn_case.groovy | 6 +-
.../suites/ccr_syncer_p0/test_get_binlog.groovy | 2 +-
.../suites/ccr_syncer_p0/test_txn_case.groovy | 6 +-
.../flink_connector_p0/flink_connector.groovy | 13 +-
.../jsonb_p0/test_jsonb_load_and_function.groovy | 34 +++
.../test_jsonb_load_unique_key_and_function.groovy | 33 +++
.../load_p0/broker_load/test_array_load.groovy | 10 +-
.../broker_load/test_broker_load_with_where.groovy | 162 ++++++++++++
.../load_p0/spark_load/test_spark_load.groovy | 4 +-
.../load_p0/stream_load/test_csv_split_line.groovy | 41 +++
.../load_p0/stream_load/test_json_load.groovy | 2 +-
.../nereids_syntax_p0/sub_query_correlated.groovy | 6 +-
.../array_functions/test_array_functions.groovy | 23 +-
.../test_array_functions_by_literal.groovy | 6 +
.../datetime_functions/test_date_function.groovy | 9 +
.../test_width_bucket_function.groovy | 6 +
97 files changed, 2254 insertions(+), 445 deletions(-)
copy docs/en/docs/sql-manual/sql-functions/json-functions/{json_contains.md =>
json-contains.md} (79%)
create mode 100644
docs/en/docs/sql-manual/sql-functions/json-functions/json-length.md
copy docs/zh-CN/docs/sql-manual/sql-functions/json-functions/{json_contains.md
=> json-contains.md} (78%)
create mode 100644
docs/zh-CN/docs/sql-manual/sql-functions/json-functions/json-length.md
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{JsonbExtractBool.java
=> JsonContains.java} (65%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{JsonbExtractInt.java
=> JsonLength.java} (68%)
create mode 100644
regression-test/data/load_p0/broker_load/broker_load_with_where.csv
create mode 100644
regression-test/data/load_p0/stream_load/test_csv_split_line4.csv
create mode 100644
regression-test/suites/load_p0/broker_load/test_broker_load_with_where.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
