This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch auto-pick-56930-branch-4.0
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 150a6923878 [enhance](job) support adaptive batch param for routine
load job (#56930)
add dcac65f445d branch-4.0: [Fix](job) fix streaming job block when fe
restart #57103 (#57135)
add aada45d36f1 branch-4.0: [Chore](runtime-filter) catch Exception from
runtime filter rpc #57085 (#57110)
add da04c6a0f50 branch-4.0: [opt](ann index) omp_threads_limit working
better & minor change for observability #56796 (#57126)
add c046ff86070 branch-4.0: [enhance](job) delay load task schedule when
transaction fail #57092 (#57131)
add 1c0bb3b4540 branch-4.0: [mem](jemalloc) Improve memory reuse
efficiency and reduce page faults to change jemalloc conf #57076 (#57151)
add 77f82833ff6 branch-4.0: [fix](filecache) fix flaky case
populate_empty_cache_with_normal #57091 (#57171)
add 65b8c030c70 branch-4.0: [function](mask) mask_last/first second
parameter can be non-const #57062 (#57136)
add f7ff87ff4c3 branch-4.0: [fix](load) fix load plan when using WHERE
clause with CompoundPredicate #57128 (#57170)
add ca8c3a50347 branch-4.0: [fix](parquet) incorrect skip files when
returning eof #57071 (#57157)
add 6da2db54388 branch-4.0: [fix](nullable) Fix nullable property for
array #57179 (#57193)
add 91c82f81555 branch-4.0: [fix](docker) update node to v14 in docker
compilation image #56029 (#57188)
add 9e9feacaa62 branch-4.0: [Fix](column) Fix
`ColumnFixedLengthObject::{insert_many_continuous_binary_data,
insert_many_strings}` #57164 (#57173)
add 7bc7db07f43 branch-4.0: [Opt](MergeIO) make read slice size is
configurable #55936 (#57160)
add 0911be1bddb branch-4.0: [opt](ann index) Support product quantization
#56954 (#57158)
add 2277577e92e branch-4.0: [improve](job) support change offset for
streaming job #57138 (#57206)
add fe8b08b71c9 branch-4.0: [Enhancement] add column_uid and
schema_version field for table schema open api #56919 (#57185)
add e2b7a11161e branch-4.0: [Fix](ai) Fix the wrong check in AI_FILTER
#56960 (#57186)
add 13f17f24448 branch-4.0: [Bug](cloud restore) Fix npe in show restore
command after fe restart #57051 (#57172)
add 4c209faf571 [enhance](job) support adaptive batch param for routine
load job (#56930)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (150a6923878)
\
N -- N -- N refs/heads/auto-pick-56930-branch-4.0 (4c209faf571)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/src/common/config.cpp | 19 +-
be/src/common/config.h | 3 +-
be/src/io/fs/buffered_reader.cpp | 4 +-
be/src/io/fs/buffered_reader.h | 11 +-
.../olap/rowset/segment_v2/ann_index/ann_index.h | 14 +-
.../segment_v2/ann_index/ann_index_writer.cpp | 4 +-
.../rowset/segment_v2/ann_index/ann_index_writer.h | 2 +
.../segment_v2/ann_index/faiss_ann_index.cpp | 132 +++++++++++-
.../rowset/segment_v2/ann_index/faiss_ann_index.h | 51 +++--
be/src/service/internal_service.cpp | 28 ++-
be/src/util/doris_metrics.cpp | 2 +
be/src/util/doris_metrics.h | 1 +
be/src/vec/columns/column_fixed_length_object.h | 4 +-
be/src/vec/data_types/data_type_factory.cpp | 4 +-
be/src/vec/exec/format/parquet/vparquet_reader.cpp | 13 +-
be/src/vec/exec/scan/file_scanner.cpp | 6 +
be/src/vec/exec/scan/file_scanner.h | 1 +
be/src/vec/functions/ai/ai_functions.h | 6 +-
be/src/vec/functions/function_string.h | 43 ++--
be/test/io/cache/block_file_cache_test.cpp | 2 +-
.../columns/column_fixed_length_object_test.cpp | 22 +-
conf/be.conf | 2 +-
docker/compilation/Dockerfile | 10 +-
.../doris/analysis/AnnIndexPropertiesChecker.java | 54 ++++-
.../apache/doris/cloud/backup/CloudRestoreJob.java | 1 +
.../doris/httpv2/rest/TableSchemaAction.java | 80 ++++++--
.../insert/streaming/StreamingInsertJob.java | 73 ++++++-
.../insert/streaming/StreamingJobProperties.java | 9 +-
.../org/apache/doris/job/manager/JobManager.java | 11 +-
.../java/org/apache/doris/job/offset/Offset.java | 5 +
.../doris/job/offset/SourceOffsetProvider.java | 6 +
.../org/apache/doris/job/offset/s3/S3Offset.java | 5 +
.../job/offset/s3/S3SourceOffsetProvider.java | 42 +++-
.../job/scheduler/StreamingTaskScheduler.java | 23 ++-
.../load/routineload/KafkaRoutineLoadJob.java | 3 +-
.../doris/load/routineload/RoutineLoadJob.java | 8 +-
.../load/routineload/RoutineLoadTaskInfo.java | 10 +
.../load/routineload/RoutineLoadTaskScheduler.java | 4 +-
.../nereids/load/NereidsLoadPlanInfoCollector.java | 15 +-
.../expressions/functions/scalar/MaskFirstN.java | 8 -
.../expressions/functions/scalar/MaskLastN.java | 8 -
.../trees/plans/commands/AlterJobCommand.java | 55 +++--
.../java/org/apache/doris/qe/SessionVariable.java | 9 +-
gensrc/thrift/PaloInternalService.thrift | 1 +
.../product_quantization.out} | 8 +-
.../data/correctness_p0/test_mask_function.out | 48 ++---
...ud.out => test_streaming_insert_job_offset.out} | 22 ++
..._with_where.out => test_s3_load_with_where.out} | 4 +-
.../regression/util/RoutineLoadTestUtils.groovy | 152 ++++++++++++++
.../ann_index_p0/product_quantization.groovy | 107 ++++++++++
.../suites/ann_index_p0/scalar_quantization.groovy | 6 +-
.../correctness_p0/test_mask_function.groovy | 16 +-
.../test_streaming_insert_job_crud.groovy | 23 +++
.../test_streaming_insert_job_offset.groovy | 226 +++++++++++++++++++++
... test_streaming_job_schedule_task_error.groovy} | 75 +++----
...where.groovy => test_s3_load_with_where.groovy} | 138 ++++++++-----
...ovy => test_routine_load_delay_schedule.groovy} | 40 ++--
57 files changed, 1331 insertions(+), 348 deletions(-)
copy
regression-test/data/{auto_increment_p2/test_unique_auto_inc_concurrent.out =>
ann_index_p0/product_quantization.out} (64%)
copy
regression-test/data/job_p0/streaming_job/{test_streaming_insert_job_crud.out
=> test_streaming_insert_job_offset.out} (55%)
copy regression-test/data/load_p0/broker_load/{test_broker_load_with_where.out
=> test_s3_load_with_where.out} (91%)
create mode 100644
regression-test/framework/src/main/groovy/org/apache/doris/regression/util/RoutineLoadTestUtils.groovy
create mode 100644
regression-test/suites/ann_index_p0/product_quantization.groovy
create mode 100644
regression-test/suites/job_p0/streaming_job/test_streaming_insert_job_offset.groovy
copy
regression-test/suites/job_p0/streaming_job/{test_streaming_job_auto_resume.groovy
=> test_streaming_job_schedule_task_error.groovy} (51%)
copy
regression-test/suites/load_p0/broker_load/{test_broker_load_with_where.groovy
=> test_s3_load_with_where.groovy} (54%)
copy
regression-test/suites/load_p0/routine_load/{test_routine_load_adaptive_param.groovy
=> test_routine_load_delay_schedule.groovy} (64%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
