This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch auto-pick-56502-branch-4.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from c0b05463459 branch-4.0: [feat](deps) add hadoop 3.4.2 #57181 #57359
(#57577)
add c5b5fc28953 [Improvement](Variant) hash-shard sparse subcolumns via
`variant_sparse_hash_shard_count` (#56502)
No new revisions were added by this update.
Summary of changes:
be/src/common/consts.h | 1 +
be/src/olap/compaction.cpp | 4 +
.../variant/sparse_column_merge_iterator.cpp | 3 +-
.../segment_v2/variant/variant_column_reader.cpp | 251 +++++++++++++++++--
.../segment_v2/variant/variant_column_reader.h | 48 +++-
.../variant/variant_column_writer_impl.cpp | 278 +++++++++++++++++----
.../variant/variant_column_writer_impl.h | 72 +++++-
.../rowset/segment_v2/variant_stats_calculator.cpp | 3 +-
be/src/olap/tablet_meta.cpp | 3 +
be/src/olap/tablet_schema.cpp | 4 +
be/src/olap/tablet_schema.h | 8 +
be/src/vec/common/schema_util.cpp | 43 +++-
be/src/vec/common/schema_util.h | 6 +
.../variant_column_writer_reader_test.cpp | 31 ++-
.../java/org/apache/doris/catalog/ScalarType.java | 9 +
.../java/org/apache/doris/catalog/VariantType.java | 20 +-
.../main/java/org/apache/doris/catalog/Column.java | 9 +
.../apache/doris/common/util/PropertyAnalyzer.java | 21 ++
.../doris/nereids/parser/LogicalPlanBuilder.java | 10 +-
.../org/apache/doris/nereids/types/DataType.java | 3 +-
.../apache/doris/nereids/types/VariantType.java | 23 +-
.../java/org/apache/doris/qe/SessionVariable.java | 227 +++++++++--------
gensrc/proto/olap_file.proto | 2 +
gensrc/thrift/Descriptors.thrift | 1 +
.../predefine/test_all_prdefine_type_to_sparse.out | 144 +++++------
regression-test/suites/variant_p0/desc.groovy | 1 +
.../test_all_prdefine_type_to_sparse.groovy | 3 +-
.../suites/variant_sparse_benchmark_p2/load.groovy | 208 +++++++++++++++
28 files changed, 1157 insertions(+), 279 deletions(-)
create mode 100644
regression-test/suites/variant_sparse_benchmark_p2/load.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
