This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
from 4735c5b50fa 2.1.0-rc08
new 0ab81435656 [fix](catalog recycle bin) table partition meta is error
if recover partition in some case (#31125)
new 99cdbc7e12a [fix](memory) Fix jemalloc lib name for thirdparty arrow
(#28843)
new 87b5ed187e5 Fix hive p2 case (#31149)
new 7c1bb4cb22d [fix](docs) add joinHint.md to sidebars (#31155)
new e2514c950c6 Fix load stats cache FE ut case. (#31162)
new 27ae96c5d03 [fix](case) adjust case if running on muti BEs (#31160)
new 872e1f6687c [fix](backup) fix concurrent upload and release snapshot
crash (#31144)
new 1d6dc9a5f09 [fix](catalog recycle bin) Forbid recover partition if
table schame is changed #31146
new 69c7750db2d [Improment](executor)Create workload thread pool without
cgroup #31170
new ccac4208e1f [fix](regression test) fix
test_dynamic_partition_with_alter #31154
new 1e3968fe7ee [fix](group_commit) Need to wait wal to be deleted when
creating MaterializedView (#30956)
new c734e79d146 [docs](docs) fix doc MySQL Load format (#30182)
new cd7230885f2 [fix](nereids)push more than one runtime filters into cte
(#30901)
new 8b6d6d01657 [pipelineX](refactor) refactor streaming agg structure
(#31151)
new 278b232e76f [Bug](json reader) object should stop processing when
encounter error (#31159)
new 728b12cfdf5 [regression-test](point query) make test stable (#31140)
new f121ee907f6 [fix](invert index) fix the inaccurate
rows_inverted_index_filtered in the profile (#31158)
new a4f9eec810c [chore](third-party) Link protobuf with zlib statically
(#31173)
new c27692fb3bd [Enhancement](jdbc catalog) Add security check on driver
when creating Jdbc Catalog (#31153)
The 19 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/build-thirdparty.yml | 4 +-
be/cmake/thirdparty.cmake | 2 +-
be/src/agent/workload_group_listener.cpp | 10 +-
be/src/exprs/json_functions.cpp | 2 +-
be/src/io/fs/s3_file_system.cpp | 5 +-
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 2 +
be/src/olap/wal/wal_manager.cpp | 2 +-
be/src/pipeline/exec/aggregation_sink_operator.cpp | 172 +--
be/src/pipeline/exec/aggregation_sink_operator.h | 57 +-
.../pipeline/exec/aggregation_source_operator.cpp | 6 +-
be/src/pipeline/exec/aggregation_source_operator.h | 7 +-
be/src/pipeline/exec/data_queue.cpp | 14 +-
be/src/pipeline/exec/data_queue.h | 4 +-
.../distinct_streaming_aggregation_operator.cpp | 406 ++++++
.../exec/distinct_streaming_aggregation_operator.h | 128 ++
...istinct_streaming_aggregation_sink_operator.cpp | 151 ---
.../distinct_streaming_aggregation_sink_operator.h | 56 -
...tinct_streaming_aggregation_source_operator.cpp | 49 -
...istinct_streaming_aggregation_source_operator.h | 14 -
be/src/pipeline/exec/empty_source_operator.h | 2 +-
be/src/pipeline/exec/join_probe_operator.cpp | 6 +-
be/src/pipeline/exec/join_probe_operator.h | 2 +-
be/src/pipeline/exec/multi_cast_data_stream_sink.h | 2 +-
.../exec/multi_cast_data_stream_source.cpp | 2 +-
.../pipeline/exec/multi_cast_data_stream_source.h | 2 +-
.../exec/nested_loop_join_probe_operator.h | 2 +-
be/src/pipeline/exec/operator.cpp | 2 +-
be/src/pipeline/exec/operator.h | 8 +-
.../exec/streaming_aggregation_operator.cpp | 1302 ++++++++++++++++++++
.../pipeline/exec/streaming_aggregation_operator.h | 231 ++++
.../exec/streaming_aggregation_sink_operator.cpp | 298 -----
.../exec/streaming_aggregation_sink_operator.h | 61 -
.../exec/streaming_aggregation_source_operator.cpp | 39 -
.../exec/streaming_aggregation_source_operator.h | 13 -
be/src/pipeline/pipeline_x/dependency.h | 4 +-
.../local_exchange_source_operator.h | 2 +-
be/src/pipeline/pipeline_x/operator.cpp | 17 +-
be/src/pipeline/pipeline_x/operator.h | 2 +-
.../pipeline_x/pipeline_x_fragment_context.cpp | 39 +-
be/src/runtime/task_group/task_group_manager.cpp | 50 +-
be/src/runtime/task_group/task_group_manager.h | 2 +-
be/src/vec/exec/format/json/new_json_reader.cpp | 6 +-
docs/en/docs/admin-manual/workload-group.md | 10 +-
.../import/import-scenes/local-file-load.md | 12 +-
.../import/import-way/mysql-load-manual.md | 28 +-
docs/en/docs/lakehouse/multi-catalog/jdbc.md | 24 +-
docs/en/docs/query-acceleration/hint/joinHint.md | 2 +
.../Show-Statements/SHOW-CATALOG-RECYCLE-BIN.md | 2 +
docs/sidebars.json | 7 +
docs/zh-CN/docs/admin-manual/workload-group.md | 12 +-
.../import/import-scenes/local-file-load.md | 12 +-
.../import/import-way/mysql-load-manual.md | 14 +-
docs/zh-CN/docs/lakehouse/multi-catalog/jdbc.md | 24 +-
.../zh-CN/docs/query-acceleration/hint/joinHint.md | 3 +
.../Show-Statements/SHOW-CATALOG-RECYCLE-BIN.md | 2 +
.../main/java/org/apache/doris/common/Config.java | 8 +
.../doris/alter/MaterializedViewHandler.java | 10 +
.../org/apache/doris/alter/SchemaChangeJobV2.java | 33 +-
.../apache/doris/catalog/CatalogRecycleBin.java | 20 +-
.../org/apache/doris/catalog/JdbcResource.java | 19 +-
.../doris/datasource/jdbc/JdbcExternalCatalog.java | 24 +-
.../org/apache/doris/load/GroupCommitManager.java | 28 +
.../glue/translator/PhysicalPlanTranslator.java | 6 +-
.../glue/translator/RuntimeFilterTranslator.java | 7 -
.../processor/post/RuntimeFilterContext.java | 41 +-
.../processor/post/RuntimeFilterGenerator.java | 57 +-
.../org/apache/doris/catalog/JdbcResourceTest.java | 15 +
.../nereids/postprocess/RuntimeFilterTest.java | 2 +-
.../org/apache/doris/statistics/CacheTest.java | 28 +-
.../recover_with_schema_change.out | 39 +
.../data/insert_p0/insert_group_commit_into.out | 18 +
.../data/load_p0/stream_load/test_json_load.out | 4 +
.../stream_load/test_malformed_json_with_path.json | 3 +
.../noStatsRfPrune/query95.out | 2 +-
.../no_stats_shape/query95.out | 2 +-
.../doris/regression/action/TestAction.groovy | 1 +
.../suites/catalog_recycle_bin_p0/recover.groovy | 60 +
.../recover_with_schema_change.groovy | 127 ++
.../decimalv3/test_decimal256_outfile_csv.groovy | 5 +
.../hive/test_hive_analyze_db.groovy | 226 ++--
.../insert_p0/insert_group_commit_into.groovy | 126 ++
.../load_p0/stream_load/test_json_load.groovy | 33 +-
.../test_dynamic_partition_with_alter.groovy | 19 +-
.../suites/point_query_p0/test_point_query.groovy | 18 +-
.../test_point_query_cluster_key.groovy | 19 +-
thirdparty/build-thirdparty.sh | 4 +-
86 files changed, 3068 insertions(+), 1273 deletions(-)
create mode 100644
be/src/pipeline/exec/distinct_streaming_aggregation_operator.cpp
create mode 100644
be/src/pipeline/exec/distinct_streaming_aggregation_operator.h
create mode 100644 be/src/pipeline/exec/streaming_aggregation_operator.cpp
create mode 100644 be/src/pipeline/exec/streaming_aggregation_operator.h
create mode 100644
regression-test/data/catalog_recycle_bin_p0/recover_with_schema_change.out
create mode 100644
regression-test/data/load_p0/stream_load/test_malformed_json_with_path.json
create mode 100644 regression-test/suites/catalog_recycle_bin_p0/recover.groovy
create mode 100644
regression-test/suites/catalog_recycle_bin_p0/recover_with_schema_change.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]