This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a change to branch branch-4.0-preview
in repository https://gitbox.apache.org/repos/asf/doris.git
from 6130aa3c6d3 [fix][mow] segment_creator should not flush data when
encouter abnormal exit (#33802)
new 2d71f990597 [Fix](Variant) check column index validation for extracted
columns (#33766)
new cab05996c1a [opt](nereids)clear min/max column stats if table is
partially analyzed (#33685)
new bc8de980328 [fix](cloud) Disable enable_feature_binlog in the cloud
mode (#33719)
new 225185d1cb4 [Improvementation](join) empty_block shall be set true
when build block only one row (#33721)
new dde19fe7688 [fix](Nereids)fix unstable plan shape in limit_push_down
case
new 53eaf4ef10a [fix](restore) Reset index id for MaterializedIndexMeta
(#33831)
new a8e3cd402d8 [fix](txn insert) Fix txn insert commit failed when schema
change (#33706)
new 4f735edf554 [fix](Regression) Don't override the regression's
enableCacheData and enableStorageVault conf (#33830)
new eec97ae352b [imporve](cloud) Get key values in batch during txn commit
(#33771)
new 7bb167c9314 [feature-wip](Cloud) Show isDefault vault in show storage
vault stmt (#33839)
new 9b70b74ea3f [feature](agg) support aggregate function
group_array_intersect (#33265)
new 5c8c7bb9963 [fix](compile) fix two compile errors on MacOS (#33834)
new 872ddba92f5 [feature](Cloud) Enable write into file cache for hdfs
writer (#33796)
new 77916e37a27 [fix](mow) cloud full compaction should check unique key
when trying to calculate delete bitmap (#33859)
new d5b1d66ad6c [fix](cloud) change preheat cache default value to fasle
(#33909)
new def76402e91 [bugfix](hive)Modify the method used to obtain the txnId
#33883
The 16 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/cloud/cloud_full_compaction.cpp | 11 +-
be/src/common/config.cpp | 1 +
be/src/common/config.h | 1 +
be/src/io/cache/file_cache_common.cpp | 11 +
be/src/io/cache/file_cache_common.h | 12 +
be/src/io/fs/hdfs_file_system.cpp | 4 +-
be/src/io/fs/hdfs_file_writer.cpp | 201 ++++++--
be/src/io/fs/hdfs_file_writer.h | 35 +-
be/src/io/hdfs_util.cpp | 11 +
be/src/io/hdfs_util.h | 12 +
.../olap/rowset/segment_v2/inverted_index_writer.h | 22 +
be/src/olap/rowset/segment_v2/segment_writer.cpp | 6 +-
.../rowset/segment_v2/vertical_segment_writer.cpp | 5 +-
be/src/olap/task/index_builder.cpp | 3 +
be/src/pipeline/exec/hashjoin_build_sink.cpp | 17 +-
be/src/pipeline/exec/hashjoin_probe_operator.cpp | 17 +-
.../aggregate_function_group_array_intersect.cpp | 90 ++++
.../aggregate_function_group_array_intersect.h | 526 +++++++++++++++++++++
.../aggregate_function_simple_factory.cpp | 2 +
be/src/vec/core/column_with_type_and_name.cpp | 12 +-
cloud/src/meta-service/meta_service_resource.cpp | 4 +
cloud/src/meta-service/meta_service_txn.cpp | 237 ++++++----
cloud/src/meta-service/txn_kv.cpp | 87 ++--
cloud/src/meta-service/txn_kv.h | 14 +-
.../main/java/org/apache/doris/common/Config.java | 2 +-
.../src/main/java/org/apache/doris/DorisFE.java | 9 +
.../apache/doris/binlog/AddPartitionRecord.java | 2 +-
.../apache/doris/catalog/AggregateFunction.java | 3 +-
.../doris/catalog/BuiltinAggregateFunctions.java | 2 +
.../java/org/apache/doris/catalog/FunctionSet.java | 6 +-
.../doris/catalog/MaterializedIndexMeta.java | 4 +
.../java/org/apache/doris/catalog/OlapTable.java | 14 +-
.../java/org/apache/doris/catalog/Partition.java | 4 -
.../org/apache/doris/catalog/StorageVault.java | 34 +-
.../apache/doris/cloud/catalog/CloudPartition.java | 5 -
.../doris/datasource/hive/HMSExternalCatalog.java | 1 -
.../org/apache/doris/nereids/cost/CostModelV1.java | 2 +-
.../doris/nereids/stats/StatsCalculator.java | 56 ++-
.../{ArrayAgg.java => GroupArrayIntersect.java} | 31 +-
.../visitor/AggregateFunctionVisitor.java | 5 +
.../apache/doris/planner/StreamLoadPlanner.java | 4 +
.../apache/doris/qe/InsertStreamTxnExecutor.java | 153 +++---
.../java/org/apache/doris/qe/ShowExecutor.java | 4 +
.../doris/transaction/HiveTransactionManager.java | 14 +-
.../doris/transaction/TransactionManager.java | 3 -
gensrc/proto/cloud.proto | 2 +
.../txn_insert_values_with_schema_change.out} | 10 +-
.../data/nereids_function_p0/agg_function/agg.out | 142 ++++++
.../limit_push_down/limit_push_down.out | 89 ++--
.../limit_push_down/order_push_down.out | 86 ++--
.../query_p0/aggregate/group_array_intersect.out | 93 ++++
.../data/variant_p0/with_index/var_index.out | 12 +
.../org/apache/doris/regression/Config.groovy | 4 +-
.../cloud_p0/conf/regression-conf-custom.groovy | 2 +
.../cloud_p1/conf/regression-conf-custom.groovy | 2 +
.../txn_insert_values_with_schema_change.groovy | 109 +++++
.../nereids_function_p0/agg_function/agg.groovy | 66 +++
.../limit_push_down/limit_push_down.groovy | 8 +-
.../limit_push_down/order_push_down.groovy | 48 +-
.../aggregate/group_array_intersect.groovy | 106 +++++
.../suites/variant_github_events_p0/load.groovy | 108 ++++-
.../suites/variant_p0/with_index/var_index.groovy | 8 +-
62 files changed, 2120 insertions(+), 474 deletions(-)
create mode 100644
be/src/vec/aggregate_functions/aggregate_function_group_array_intersect.cpp
create mode 100644
be/src/vec/aggregate_functions/aggregate_function_group_array_intersect.h
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/agg/{ArrayAgg.java
=> GroupArrayIntersect.java} (75%)
copy
regression-test/data/{correctness/test_exceed_max_pushdown_conditions_per_column.out
=> insert_p0/txn_insert_values_with_schema_change.out} (69%)
create mode 100644
regression-test/data/query_p0/aggregate/group_array_intersect.out
create mode 100644
regression-test/suites/insert_p0/txn_insert_values_with_schema_change.groovy
create mode 100644
regression-test/suites/query_p0/aggregate/group_array_intersect.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
