This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch array-type
in repository https://gitbox.apache.org/repos/asf/incubator-doris.git.
discard b67314d [feature-wip][array-type] Support nested array insertion.
(#8305)
omit 07d16d4 [feature-wip][array-type] Array data can be loaded in stream
load. (#8368)
omit 30e93e0 [feature-wip](array-type)support select ARRAY data type on
vectorized engine (#8217)
omit 28ea295 [feature-wip][array-type] Support ArrayLiteral in SQL. (#8089)
omit 3e2d90d [feature-wip](array-type) Create table with nested array
type. (#8003)
add d9c2c2c Revert "[refactor] remove unused new_in_predicate code
(#8263)" (#8372)
add c647def [community] Modify doris connector release doc (#8275)
add ca3be24 [typo]fix some typo in fe_config (#8325)
add 50a59f3 [license] Organize third-party dependent licenses for bianry
releases (#8350)
add 089ef53 [chore] fix build with parallel parameter only (#8352)
add d711d64 [fix](vectorization)Some small fix for SegmentIter
Vectorization (#8267)
add 454b45b [feature](vectorize)(function) support regexp&&sm4&&aes
functions (#8307)
add 3eedd15 [optimize] optimze tablet read, avoid to create too much
scanner for small tablet (#8096)
add b9010e3 [doc] Translate Chinese comment to English (#8340)
add 1e70f99 [improvement][fix](insert)(replay) support SHOW LAST INSERT
stmt and fix json replay bug (#8355)
add 22bafef [fix](broker-load) fix bug that a cancelled job's state is
LOADING (#8363)
add 9c7d519 [improvement](regression-test) add aggregation tests from
trino to doris (#8375)
add 8214f32 [fix] fix core dump on minmax_filter with decimal type (#8381)
add cd8694e [feature][vectorized] support replace() (#8384)
add 40a5fac [fix](vectorized) Fix the datetime type read error and
is_same set error in reader (#8386)
add 58e8537 [fix](vectorized) fix float to string inaccurate (#8392)
add b536c18 [fix] fix wrong examples in week.md (#8397)
add 826467e [fix](replica) handle replica version missing info to avoid
-214 error (#8209)
add 10c3712 [fix](vectorized) fix arithmetic calculate get wrong
result(#8226)
add 0ff7de4 [refactor] remove agent status (#8273)
add 3d30209 [docs] add document conditional-functions (#8339)
add d880559 [refactor] remove old schema change code on BE (#8342)
add 25532c6 [doc] Update BROKER LOAD.md (#8361)
add 97020bc [doc] update substring.md (#8398)
add 51103dc [typo] translate the comments of delete_handler.cpp (#8402)
add f4663ad [improvement](vectorized) Merge block in scanner to speed up
query with conjunct (#8395)
add 2a43313 [fix] fix compile error (#8410)
add 8eec4bf [feature](thread-local) Add thread local variable
ThreadContext (#7234)
add 8c84160 [doc](vectorized) Add vectorized execution engine docs (#8358)
add 548fde6 [doc] Fix dead link in build docker environment in developer
guide (#8379)
add d3d8301 [feature](function) support vectorized digital_masking (#8409)
new b4f227e [feature-wip](array-type) Create table with nested array
type. (#8003)
new 5ad6472 [feature-wip][array-type] Support ArrayLiteral in SQL. (#8089)
new d041fd0 [feature-wip](array-type)support select ARRAY data type on
vectorized engine (#8217)
new 8dba572 [feature-wip][array-type] Array data can be loaded in stream
load. (#8368)
new 3f74fb6 [feature-wip][array-type] Support nested array insertion.
(#8305)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (b67314d)
\
N -- N -- N refs/heads/array-type (3f74fb6)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 5 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
NOTICE.txt | 2 +-
be/src/agent/cgroups_mgr.cpp | 99 +-
be/src/agent/cgroups_mgr.h | 20 +-
be/src/agent/heartbeat_server.cpp | 6 +-
be/src/agent/heartbeat_server.h | 4 +-
be/src/agent/status.h | 48 -
be/src/agent/task_worker_pool.cpp | 93 +-
be/src/agent/task_worker_pool.h | 9 +-
be/src/agent/utils.cpp | 104 +-
be/src/agent/utils.h | 25 +-
be/src/common/config.h | 7 +-
be/src/common/daemon.cpp | 2 +
be/src/common/status.cpp | 6 +
be/src/common/status.h | 1 +
be/src/exec/olap_scan_node.cpp | 54 +-
be/src/exec/olap_scan_node.h | 6 -
be/src/exec/tablet_sink.cpp | 2 -
be/src/exec/tablet_sink.h | 1 -
be/src/exprs/CMakeLists.txt | 1 +
be/src/exprs/arithmetic_expr.cpp | 66 +
be/src/exprs/arithmetic_expr.h | 11 +
be/src/exprs/encryption_functions.cpp | 21 -
be/src/exprs/encryption_functions.h | 21 +-
be/src/exprs/expr.cpp | 2 +
be/src/exprs/minmax_predicate.h | 30 +-
be/src/exprs/new_in_predicate.cpp | 185 +++
be/src/exprs/new_in_predicate.h | 348 +++++
be/src/exprs/runtime_filter.cpp | 34 +-
be/src/exprs/string_functions.cpp | 4 +-
be/src/exprs/string_functions.h | 3 +
be/src/olap/delete_handler.cpp | 10 +-
be/src/olap/delta_writer.cpp | 34 -
be/src/olap/delta_writer.h | 3 -
be/src/olap/row_block2.cpp | 3 +-
be/src/olap/rowset/run_length_byte_reader.h | 2 +-
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 5 +-
be/src/olap/storage_engine.h | 1 -
be/src/olap/tablet.cpp | 23 +-
be/src/olap/tablet.h | 13 +-
be/src/olap/tablet_manager.h | 1 -
be/src/olap/tablet_meta.h | 19 +-
be/src/olap/task/engine_batch_load_task.cpp | 53 +-
be/src/olap/task/engine_batch_load_task.h | 14 +-
be/src/olap/task/engine_clone_task.cpp | 46 +-
be/src/olap/task/engine_clone_task.h | 9 +-
be/src/olap/txn_manager.h | 1 -
be/src/runtime/CMakeLists.txt | 3 +-
be/src/runtime/dpp_sink.cpp | 927 ------------
be/src/runtime/dpp_sink.h | 84 --
be/src/runtime/dpp_sink_internal.cpp | 44 -
be/src/runtime/dpp_sink_internal.h | 58 -
be/src/runtime/tablets_channel.cpp | 1 -
.../src/runtime/thread_context.cpp | 23 +-
be/src/runtime/thread_context.h | 143 ++
be/src/runtime/threadlocal.cc | 84 ++
be/src/runtime/threadlocal.h | 127 ++
be/src/service/doris_main.cpp | 5 +-
be/src/vec/CMakeLists.txt | 3 +
.../aggregate_function_percentile_approx.cpp | 1 -
be/src/vec/columns/column_complex.h | 16 +
be/src/vec/columns/column_vector.h | 4 +-
be/src/vec/common/string_ref.h | 27 +-
be/src/vec/data_types/data_type_number_base.cpp | 14 +-
be/src/vec/exec/join/vhash_join_node.cpp | 1 -
be/src/vec/exec/volap_scan_node.cpp | 87 +-
be/src/vec/exec/volap_scanner.cpp | 8 +-
be/src/vec/functions/function_encryption.cpp | 245 +++
be/src/vec/functions/function_hex.cpp | 183 +++
be/src/vec/functions/function_regexp.cpp | 216 +++
be/src/vec/functions/function_string.cpp | 133 +-
be/src/vec/functions/function_string.h | 79 +-
be/src/vec/functions/math.cpp | 51 -
be/src/vec/functions/minus.cpp | 1 +
be/src/vec/functions/modulo.cpp | 3 +
be/src/vec/functions/multiply.cpp | 1 +
be/src/vec/functions/plus.cpp | 1 +
be/src/vec/functions/simple_function_factory.h | 6 +
be/src/vec/olap/vcollect_iterator.cpp | 9 +-
be/test/agent/cgroups_mgr_test.cpp | 26 +-
be/test/agent/mock_task_worker_pool.h | 2 +-
be/test/agent/mock_utils.h | 14 +-
be/test/exprs/runtime_filter_test.cpp | 72 +-
be/test/olap/file_helper_test.cpp | 2 +-
be/test/olap/file_utils_test.cpp | 2 +-
be/test/runtime/data_spliter_test.cpp | 91 --
be/test/runtime/dpp_sink_internal_test.cpp | 108 --
be/test/runtime/dpp_sink_test.cpp | 263 ----
be/test/runtime/load_channel_mgr_test.cpp | 7 -
be/test/vec/function/function_like_test.cpp | 59 +
be/test/vec/function/function_string_test.cpp | 258 +++-
build.sh | 13 +-
dist/LICENSE-dist.txt | 1561 ++++++++++++++++++++
dist/README | 30 +
dist/licenses/LICENSE-CC0.txt | 29 +
dist/licenses/LICENSE-CDDL-1.0.txt | 131 ++
dist/licenses/LICENSE-CDDL-1.1.txt | 77 +
dist/licenses/LICENSE-CUP.txt | 5 +
dist/licenses/LICENSE-EDL-1.0.txt | 11 +
dist/licenses/LICENSE-EPL-1.0.txt | 60 +
dist/licenses/LICENSE-EPL-2.0.txt | 79 +
dist/licenses/LICENSE-GPLv2-CE.txt | 131 ++
dist/licenses/LICENSE-JSch.txt | 30 +
dist/licenses/LICENSE-MIT.txt | 9 +
dist/licenses/LICENSE-antlr4.txt | 52 +
dist/licenses/LICENSE-asm.txt | 27 +
dist/licenses/LICENSE-automaton.txt | 24 +
dist/licenses/LICENSE-bitshuffle.txt | 21 +
dist/licenses/LICENSE-boost.txt | 23 +
dist/licenses/LICENSE-breakpad.txt | 132 ++
dist/licenses/LICENSE-brotli.txt | 19 +
dist/licenses/LICENSE-bzip2.txt | 42 +
dist/licenses/LICENSE-commons-compiler.txt | 31 +
dist/licenses/LICENSE-curl.txt | 22 +
dist/licenses/LICENSE-cyrus-sasl.txt | 44 +
dist/licenses/LICENSE-fmt.txt | 11 +
dist/licenses/LICENSE-gflag.txt | 28 +
dist/licenses/LICENSE-glog.txt | 65 +
dist/licenses/LICENSE-gperftools.txt | 28 +
dist/licenses/LICENSE-gtest.txt | 28 +
dist/licenses/LICENSE-hamcrest.txt | 27 +
dist/licenses/LICENSE-javolution.txt | 27 +
dist/licenses/LICENSE-jemalloc.txt | 26 +
dist/licenses/LICENSE-jline.txt | 34 +
dist/licenses/LICENSE-jta.txt | 245 +++
dist/licenses/LICENSE-kryo.txt | 10 +
dist/licenses/LICENSE-leveldb.txt | 27 +
dist/licenses/LICENSE-leveldbjni.txt | 27 +
dist/licenses/LICENSE-libdivide.txt | 29 +
dist/licenses/LICENSE-libevent.txt | 99 ++
dist/licenses/LICENSE-librdkafka.txt | 31 +
dist/licenses/LICENSE-lz4.txt | 11 +
dist/licenses/LICENSE-lzma.txt | 64 +
dist/licenses/LICENSE-minlog.txt | 10 +
dist/licenses/LICENSE-openssl.txt | 125 ++
dist/licenses/LICENSE-paranamer.txt | 28 +
dist/licenses/LICENSE-pdqsort.txt | 16 +
dist/licenses/LICENSE-protobuf.txt | 33 +
dist/licenses/LICENSE-py4j.txt | 26 +
dist/licenses/LICENSE-rapidjson.txt | 57 +
dist/licenses/LICENSE-re2.txt | 27 +
dist/licenses/LICENSE-snappy.txt | 54 +
dist/licenses/LICENSE-unixodbc.txt | 511 +++++++
dist/licenses/LICENSE-xmlenc.txt | 23 +
dist/licenses/LICENSE-xsimd.txt | 28 +
dist/licenses/LICENSE-zlib.txt | 31 +
dist/licenses/LICENSE-zstd-jni.txt | 26 +
dist/licenses/LICENSE-zstd.txt | 30 +
dist/tools/README | 45 +
dist/tools/parse_licenses.py | 180 +++
.../public/images/vectorized-execution-engine1.png | Bin 0 -> 113770 bytes
.../public/images/vectorized-execution-engine2.png | Bin 0 -> 179015 bytes
docs/.vuepress/sidebar/en.js | 13 +
docs/.vuepress/sidebar/zh-CN.js | 13 +
docs/en/administrator-guide/config/be_config.md | 4 +
docs/en/administrator-guide/config/fe_config.md | 45 +-
.../load-data/insert-into-manual.md | 22 +
.../vectorized-execution-engine.md | 126 ++
.../release-and-verify/release-doris-connectors.md | 82 +-
docs/en/developer-guide/docker-dev.md | 2 +-
.../sql-functions/conditional-functions/case.md | 72 +
.../conditional-functions/coalesce.md | 47 +
.../sql-functions/conditional-functions/if.md | 50 +
.../sql-functions/conditional-functions/ifnull.md | 54 +
.../sql-functions/conditional-functions/nullif.md | 61 +
.../Data Manipulation/SHOW-LAST-INSERT.md | 67 +
docs/zh-CN/administrator-guide/config/be_config.md | 5 +
docs/zh-CN/administrator-guide/config/fe_config.md | 112 +-
.../load-data/insert-into-manual.md | 23 +-
.../vectorized-execution-engine.md | 123 ++
.../release-and-verify/release-doris-connectors.md | 78 +-
docs/zh-CN/developer-guide/docker-dev.md | 4 +-
.../sql-functions/conditional-functions/case.md | 72 +
.../conditional-functions/coalesce.md | 47 +
.../sql-functions/conditional-functions/if.md | 50 +
.../sql-functions/conditional-functions/ifnull.md | 54 +
.../sql-functions/conditional-functions/nullif.md | 61 +
.../sql-functions/date-time-functions/week.md | 36 +-
.../sql-functions/string-functions/substring.md | 2 +-
.../Data Manipulation/BROKER LOAD.md | 4 +-
.../Data Manipulation/SHOW-LAST-INSERT.md | 68 +
fe/fe-core/pom.xml | 110 +-
fe/fe-core/src/main/cup/sql_parser.cup | 7 +
.../apache/doris/analysis/ShowLastInsertStmt.java | 58 +
.../org/apache/doris/catalog/AliasFunction.java | 35 +-
.../java/org/apache/doris/catalog/Catalog.java | 48 +-
.../java/org/apache/doris/catalog/EsTable.java | 3 +-
.../java/org/apache/doris/catalog/Function.java | 2 +-
.../java/org/apache/doris/catalog/Replica.java | 60 +-
.../apache/doris/catalog/TabletInvertedIndex.java | 10 +-
.../apache/doris/common/proc/TransDbProcDir.java | 1 +
.../doris/external/elasticsearch/EsRestClient.java | 17 +-
.../org/apache/doris/journal/JournalEntity.java | 6 +
.../main/java/org/apache/doris/load/LoadJob.java | 152 +-
.../org/apache/doris/load/loadv2/JobState.java | 6 +-
.../java/org/apache/doris/load/loadv2/LoadJob.java | 34 +-
.../apache/doris/load/loadv2/LoadLoadingTask.java | 7 +-
.../org/apache/doris/master/ReportHandler.java | 37 +-
.../apache/doris/persist/BackendReplicasInfo.java | 105 ++
.../apache/doris/persist/BackendTabletsInfo.java | 2 +
.../java/org/apache/doris/persist/EditLog.java | 10 +
.../org/apache/doris/persist/OperationType.java | 2 +
.../java/org/apache/doris/qe/ConnectContext.java | 17 +
.../java/org/apache/doris/qe/InsertResult.java | 66 +
.../java/org/apache/doris/qe/SessionVariable.java | 6 +-
.../java/org/apache/doris/qe/ShowExecutor.java | 18 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 7 +
.../doris/transaction/GlobalTransactionMgr.java | 7 +
.../doris/persist/BackendReplicaInfosTest.java | 81 +
fe/pom.xml | 217 ++-
fe/spark-dpp/pom.xml | 109 --
fs_brokers/apache_hdfs_broker/pom.xml | 13 +
gensrc/proto/internal_service.proto | 2 +-
gensrc/script/doris_builtins_functions.py | 74 +-
gensrc/thrift/DataSinks.thrift | 18 +-
regression-test/data/aggregate/aggregate.out | 75 +
regression-test/data/aggregate/datetype.csv | 16 +
regression-test/suites/aggregate/aggregate.groovy | 101 ++
thirdparty/vars.sh | 10 +-
218 files changed, 9413 insertions(+), 3147 deletions(-)
delete mode 100644 be/src/agent/status.h
create mode 100644 be/src/exprs/new_in_predicate.cpp
create mode 100644 be/src/exprs/new_in_predicate.h
delete mode 100644 be/src/runtime/dpp_sink.cpp
delete mode 100644 be/src/runtime/dpp_sink.h
copy fe/fe-core/src/main/java/org/apache/doris/load/loadv2/JobState.java =>
be/src/runtime/thread_context.cpp (60%)
create mode 100644 be/src/runtime/thread_context.h
create mode 100644 be/src/runtime/threadlocal.cc
create mode 100644 be/src/runtime/threadlocal.h
create mode 100644 be/src/vec/functions/function_encryption.cpp
create mode 100644 be/src/vec/functions/function_hex.cpp
create mode 100644 be/src/vec/functions/function_regexp.cpp
delete mode 100644 be/test/runtime/dpp_sink_test.cpp
create mode 100644 dist/LICENSE-dist.txt
create mode 100644 dist/README
create mode 100644 dist/licenses/LICENSE-CC0.txt
create mode 100644 dist/licenses/LICENSE-CDDL-1.0.txt
create mode 100644 dist/licenses/LICENSE-CDDL-1.1.txt
create mode 100644 dist/licenses/LICENSE-CUP.txt
create mode 100644 dist/licenses/LICENSE-EDL-1.0.txt
create mode 100644 dist/licenses/LICENSE-EPL-1.0.txt
create mode 100644 dist/licenses/LICENSE-EPL-2.0.txt
create mode 100644 dist/licenses/LICENSE-GPLv2-CE.txt
create mode 100644 dist/licenses/LICENSE-JSch.txt
create mode 100644 dist/licenses/LICENSE-MIT.txt
create mode 100644 dist/licenses/LICENSE-antlr4.txt
create mode 100644 dist/licenses/LICENSE-asm.txt
create mode 100644 dist/licenses/LICENSE-automaton.txt
create mode 100644 dist/licenses/LICENSE-bitshuffle.txt
create mode 100644 dist/licenses/LICENSE-boost.txt
create mode 100644 dist/licenses/LICENSE-breakpad.txt
create mode 100644 dist/licenses/LICENSE-brotli.txt
create mode 100644 dist/licenses/LICENSE-bzip2.txt
create mode 100644 dist/licenses/LICENSE-commons-compiler.txt
create mode 100644 dist/licenses/LICENSE-curl.txt
create mode 100644 dist/licenses/LICENSE-cyrus-sasl.txt
create mode 100644 dist/licenses/LICENSE-fmt.txt
create mode 100644 dist/licenses/LICENSE-gflag.txt
create mode 100644 dist/licenses/LICENSE-glog.txt
create mode 100644 dist/licenses/LICENSE-gperftools.txt
create mode 100644 dist/licenses/LICENSE-gtest.txt
create mode 100644 dist/licenses/LICENSE-hamcrest.txt
create mode 100644 dist/licenses/LICENSE-javolution.txt
create mode 100644 dist/licenses/LICENSE-jemalloc.txt
create mode 100644 dist/licenses/LICENSE-jline.txt
create mode 100644 dist/licenses/LICENSE-jta.txt
create mode 100644 dist/licenses/LICENSE-kryo.txt
create mode 100644 dist/licenses/LICENSE-leveldb.txt
create mode 100644 dist/licenses/LICENSE-leveldbjni.txt
create mode 100644 dist/licenses/LICENSE-libdivide.txt
create mode 100644 dist/licenses/LICENSE-libevent.txt
create mode 100644 dist/licenses/LICENSE-librdkafka.txt
create mode 100644 dist/licenses/LICENSE-lz4.txt
create mode 100644 dist/licenses/LICENSE-lzma.txt
create mode 100644 dist/licenses/LICENSE-minlog.txt
create mode 100644 dist/licenses/LICENSE-openssl.txt
create mode 100644 dist/licenses/LICENSE-paranamer.txt
create mode 100644 dist/licenses/LICENSE-pdqsort.txt
create mode 100644 dist/licenses/LICENSE-protobuf.txt
create mode 100644 dist/licenses/LICENSE-py4j.txt
create mode 100644 dist/licenses/LICENSE-rapidjson.txt
create mode 100644 dist/licenses/LICENSE-re2.txt
create mode 100644 dist/licenses/LICENSE-snappy.txt
create mode 100644 dist/licenses/LICENSE-unixodbc.txt
create mode 100644 dist/licenses/LICENSE-xmlenc.txt
create mode 100644 dist/licenses/LICENSE-xsimd.txt
create mode 100644 dist/licenses/LICENSE-zlib.txt
create mode 100644 dist/licenses/LICENSE-zstd-jni.txt
create mode 100644 dist/licenses/LICENSE-zstd.txt
create mode 100644 dist/tools/README
create mode 100644 dist/tools/parse_licenses.py
create mode 100644
docs/.vuepress/public/images/vectorized-execution-engine1.png
create mode 100644
docs/.vuepress/public/images/vectorized-execution-engine2.png
create mode 100644 docs/en/administrator-guide/vectorized-execution-engine.md
create mode 100644
docs/en/sql-reference/sql-functions/conditional-functions/case.md
create mode 100644
docs/en/sql-reference/sql-functions/conditional-functions/coalesce.md
create mode 100644
docs/en/sql-reference/sql-functions/conditional-functions/if.md
create mode 100644
docs/en/sql-reference/sql-functions/conditional-functions/ifnull.md
create mode 100644
docs/en/sql-reference/sql-functions/conditional-functions/nullif.md
create mode 100644 docs/en/sql-reference/sql-statements/Data
Manipulation/SHOW-LAST-INSERT.md
create mode 100644
docs/zh-CN/administrator-guide/vectorized-execution-engine.md
create mode 100644
docs/zh-CN/sql-reference/sql-functions/conditional-functions/case.md
create mode 100644
docs/zh-CN/sql-reference/sql-functions/conditional-functions/coalesce.md
create mode 100644
docs/zh-CN/sql-reference/sql-functions/conditional-functions/if.md
create mode 100644
docs/zh-CN/sql-reference/sql-functions/conditional-functions/ifnull.md
create mode 100644
docs/zh-CN/sql-reference/sql-functions/conditional-functions/nullif.md
create mode 100644 docs/zh-CN/sql-reference/sql-statements/Data
Manipulation/SHOW-LAST-INSERT.md
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/ShowLastInsertStmt.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/persist/BackendReplicasInfo.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/qe/InsertResult.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/persist/BackendReplicaInfosTest.java
create mode 100644 regression-test/data/aggregate/aggregate.out
create mode 100644 regression-test/data/aggregate/datetype.csv
create mode 100644 regression-test/suites/aggregate/aggregate.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
