This is an automated email from the ASF dual-hosted git repository.
eldenmoon pushed a change to branch cs_opt_version-3.1
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 4328880bc36 fix compile
discard c00f15ccf71 [enhance](variant) typed_paths_to sparse column
discard 974d8ebe985 cherry pick like opt/lru-k
add 60b92564178 branch-3.1: [ci](cloud_p0) pipeline fail if stop grace
fail #52886 (#53024)
add 57675f06e47 branch-3.1: [opt](partial update) use a separate config to
control the behavior of newly inserted rows in partial update #41950 #41232
(#52998)
add ec5936cd08c branch-3.1: [opt](audit) use one line in audit log and
origin statement in audit table #52032 #52587 #52968 (#53022)
add 4b76b3e7f2c branch-3.1: [Enhancement](sql-dialect) Support multiple
sql-converter service urls #52636 (#53027)
add 8d79e6e73d1 branch-3.1: [enhance](variant) typed_paths_to sparse
column (#52927)
add 7bbcb6d7ccd Branch 3.1: [fix](nereids) fix insert into values throw
'Invalid call to sql on unbound object' and 'Insert has filtered data in strict
mode' exception #52802 (#53032)
add 579a9028edf branch-3.1: [fix](TabletSched)Prioritize non-drop replicas
as src replicas #53006 (#53035)
add 46ebb2bb25b branch-3.1: [fix](ci) adjust docker image #52853 (#53053)
add 8cf0e55e8c8 [fix](variant) fix protobuf in `gensrc/proto/data.proto`
(#53061)
add 7087986ffc1 branch-3.1: [Bug](function) fix bitmap_from_base64
function cause heap-buffer-overflow error #53018 (#53045)
add 00f8f74055b [Improvement](variant) improve performance of variant's
caculate stats (#53077)
add c48c9e5bebf branch-3.1: [fix](case) fix case bug in
test_temp_table.groovy #52900 (#53060)
new c04d179e340 cherry pick like opt/lru-k
new cc92be9e2db fix compile
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (4328880bc36)
\
N -- N -- N refs/heads/cs_opt_version-3.1 (cc92be9e2db)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/common/status.h | 1 +
be/src/exec/tablet_info.cpp | 27 ++
be/src/exec/tablet_info.h | 5 +
be/src/http/action/stream_load.cpp | 19 +
be/src/http/http_common.h | 1 +
be/src/olap/delta_writer_v2.cpp | 1 +
be/src/olap/partial_update_info.cpp | 104 ++---
be/src/olap/partial_update_info.h | 13 +-
be/src/olap/rowset/segment_v2/segment_writer.cpp | 409 +------------------
be/src/olap/rowset/segment_v2/segment_writer.h | 26 +-
.../rowset/segment_v2/variant_stats_calculator.cpp | 111 +++++
.../rowset/segment_v2/variant_stats_calculator.h | 55 +++
.../rowset/segment_v2/vertical_segment_writer.cpp | 22 +-
be/src/olap/rowset_builder.cpp | 1 +
be/src/vec/functions/function_bitmap.cpp | 4 +-
.../segment_v2/variant_stats_calculator_test.cpp | 448 +++++++++++++++++++++
.../java/org/apache/doris/analysis/LoadStmt.java | 18 +
.../org/apache/doris/clone/TabletSchedCtx.java | 28 +-
.../doris/cloud/load/CloudBrokerLoadJob.java | 3 +-
.../doris/cloud/load/CloudLoadLoadingTask.java | 7 +-
.../apache/doris/load/loadv2/BrokerLoadJob.java | 3 +-
.../java/org/apache/doris/load/loadv2/LoadJob.java | 6 +
.../apache/doris/load/loadv2/LoadLoadingTask.java | 9 +-
.../doris/load/loadv2/LoadingTaskPlanner.java | 12 +-
.../doris/nereids/analyzer/UnboundTableSink.java | 33 +-
.../nereids/analyzer/UnboundTableSinkCreator.java | 11 +-
.../glue/translator/PhysicalPlanTranslator.java | 3 +
.../doris/nereids/parser/LogicalPlanBuilder.java | 1 +
.../doris/nereids/rules/analysis/BindSink.java | 14 +-
...ogicalOlapTableSinkToPhysicalOlapTableSink.java | 1 +
.../trees/plans/commands/DeleteFromCommand.java | 4 +-
.../nereids/trees/plans/commands/LoadCommand.java | 4 +-
.../trees/plans/commands/UpdateCommand.java | 4 +-
.../insert/InsertOverwriteTableCommand.java | 4 +
.../trees/plans/commands/insert/InsertUtils.java | 42 +-
.../trees/plans/logical/LogicalOlapTableSink.java | 32 +-
.../plans/physical/PhysicalOlapTableSink.java | 37 +-
.../org/apache/doris/planner/OlapTableSink.java | 18 +-
.../apache/doris/planner/StreamLoadPlanner.java | 3 +
.../java/org/apache/doris/plugin/AuditEvent.java | 94 +++--
.../org/apache/doris/plugin/audit/AuditLoader.java | 88 ++--
.../apache/doris/plugin/audit/AuditLogBuilder.java | 6 +
.../doris/plugin/audit/AuditStreamLoader.java | 2 +
.../doris/plugin/dialect/HttpDialectUtils.java | 268 +++++++++++-
.../java/org/apache/doris/qe/AuditLogHelper.java | 7 +-
.../java/org/apache/doris/qe/SessionVariable.java | 36 ++
.../java/org/apache/doris/task/LoadTaskInfo.java | 5 +
.../java/org/apache/doris/task/StreamLoadTask.java | 10 +
.../org/apache/doris/clone/TabletSchedCtxTest.java | 27 +-
.../nereids/rules/rewrite/EliminateSortTest.java | 5 +-
.../apache/doris/plugin/HttpDialectUtilsTest.java | 360 ++++++++++++++++-
.../doris/plugin/audit/AuditLogBuilderTest.java | 24 +-
gensrc/proto/data.proto | 4 +-
gensrc/proto/descriptors.proto | 1 +
gensrc/proto/olap_file.proto | 6 +
gensrc/thrift/Descriptors.thrift | 6 +
gensrc/thrift/FrontendService.thrift | 1 +
.../import/import-way/error-data-handling.md.out | Bin 420 -> 287 bytes
.../nereids_p0/insert_into_table/insert_values.out | Bin 2495 -> 2621 bytes
.../flexible/test_f_new_key_policy.out | Bin 0 -> 491 bytes
...ate_restricts.out => test_f_segment_writer.out} | Bin 185 -> 275 bytes
.../test_f_seq_col_no_vertical_segment_writer.out | Bin 5916 -> 0 bytes
.../partial_update/row_policy1.csv | 4 +
.../partial_update/row_policy2.csv | 4 +
.../partial_update/row_policy3.csv | 4 +
.../test_partial_update_new_key_policy.out | Bin 0 -> 1646 bytes
.../test_partial_update_new_row_policy.out | Bin 0 -> 835 bytes
.../test_partial_update_strict_mode.out | Bin 1505 -> 2005 bytes
regression-test/pipeline/cloud_p0/clean.sh | 3 +-
regression-test/pipeline/cloud_p0/run.sh | 20 +-
regression-test/pipeline/common/doris-utils.sh | 50 ++-
regression-test/pipeline/performance/compile.sh | 8 +-
regression-test/pipeline/vault_p0/clean.sh | 3 +-
regression-test/pipeline/vault_p0/run.sh | 20 +-
.../import-way/error-data-handling.md.groovy | 59 ---
.../insert_into_table/insert_values.groovy | 34 ++
.../insert_into_table/partial_update.groovy | 5 +-
.../bitmap_functions/test_bitmap_function.groovy | 5 +
.../suites/temp_table_p0/test_temp_table.groovy | 1 +
.../flexible/test_f_new_key_policy.groovy | 95 +++++
.../flexible/test_f_segment_writer.groovy | 65 +++
...est_f_seq_col_no_vertical_segment_writer.groovy | 289 -------------
...est_flexible_partial_update_filter_ratio.groovy | 4 +-
...artial_update_insert_light_schema_change.groovy | 8 +-
...test_partial_update_insert_schema_change.groovy | 8 +-
.../test_partial_update_native_insert_stmt.groovy | 6 +-
.../test_partial_update_new_key_policy.groovy | 267 ++++++++++++
.../test_partial_update_only_keys.groovy | 7 +-
.../test_partial_update_schema_change.groovy | 12 +-
...t_partial_update_schema_change_row_store.groovy | 14 +-
.../test_partial_update_strict_mode.groovy | 18 +-
.../test_partial_update_upsert.groovy | 5 +-
92 files changed, 2375 insertions(+), 1137 deletions(-)
create mode 100644 be/src/olap/rowset/segment_v2/variant_stats_calculator.cpp
create mode 100644 be/src/olap/rowset/segment_v2/variant_stats_calculator.h
create mode 100644
be/test/olap/rowset/segment_v2/variant_stats_calculator_test.cpp
create mode 100644
regression-test/data/unique_with_mow_p0/flexible/test_f_new_key_policy.out
copy
regression-test/data/unique_with_mow_p0/flexible/{test_flexible_partial_update_restricts.out
=> test_f_segment_writer.out} (67%)
delete mode 100644
regression-test/data/unique_with_mow_p0/flexible/test_f_seq_col_no_vertical_segment_writer.out
create mode 100644
regression-test/data/unique_with_mow_p0/partial_update/row_policy1.csv
create mode 100644
regression-test/data/unique_with_mow_p0/partial_update/row_policy2.csv
create mode 100644
regression-test/data/unique_with_mow_p0/partial_update/row_policy3.csv
create mode 100644
regression-test/data/unique_with_mow_p0/partial_update/test_partial_update_new_key_policy.out
create mode 100644
regression-test/data/unique_with_mow_p0/partial_update/test_partial_update_new_row_policy.out
create mode 100644
regression-test/suites/unique_with_mow_p0/flexible/test_f_new_key_policy.groovy
create mode 100644
regression-test/suites/unique_with_mow_p0/flexible/test_f_segment_writer.groovy
delete mode 100644
regression-test/suites/unique_with_mow_p0/flexible/test_f_seq_col_no_vertical_segment_writer.groovy
create mode 100644
regression-test/suites/unique_with_mow_p0/partial_update/test_partial_update_new_key_policy.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
