This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-4.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from 31f3d01aa7e branch-4.0: [fix](cloud) Disable
AdminSetPartitionVersionCommand in cloud mode #60263 (#60471)
add 691a881a0fa branch-4.0: [Fix](StreamingJob) Optimize CDC consumption
strategy #60181 (#60463)
No new revisions were added by this update.
Summary of changes:
.licenserc.yaml | 1 +
.../apache/doris/job/cdc/DataSourceConfigKeys.java | 4 +-
.../streaming/DataSourceConfigValidator.java | 3 +-
.../insert/streaming/StreamingInsertJob.java | 5 +
.../insert/streaming/StreamingMultiTblTask.java | 51 +-
.../apache/doris/job/offset/jdbc/JdbcOffset.java | 76 +-
.../job/offset/jdbc/JdbcSourceOffsetProvider.java | 141 +-
fs_brokers/cdc_client/pom.xml | 3 +
.../mysql/MySqlStreamingChangeEventSource.java | 1571 ++++++++++++++++++++
.../apache/doris/cdcclient/common/Constants.java | 5 +-
.../cdcclient/controller/ClientController.java | 4 +-
.../cdcclient/model/response/RecordWithMeta.java | 5 +-
.../cdcclient/service/PipelineCoordinator.java | 484 ++++--
.../doris/cdcclient/sink/DorisBatchStreamLoad.java | 60 +-
.../doris/cdcclient/sink/HttpPutBuilder.java | 9 +
.../source/reader/JdbcIncrementalSourceReader.java | 612 ++++++--
...tReadResult.java => SnapshotReaderContext.java} | 23 +-
.../cdcclient/source/reader/SourceReader.java | 12 +-
.../cdcclient/source/reader/SplitReadResult.java | 34 +-
.../source/reader/mysql/MySqlSourceReader.java | 580 +++++---
.../reader/postgres/PostgresSourceReader.java | 33 +-
.../apache/doris/cdcclient/utils/ConfigUtil.java | 5 -
.../cdc/test_streaming_postgres_job_split.out} | 11 +-
.../test_streaming_mysql_job_create_alter.groovy | 2 +-
...vy => test_streaming_postgres_job_split.groovy} | 57 +-
25 files changed, 3149 insertions(+), 642 deletions(-)
create mode 100644
fs_brokers/cdc_client/src/main/java/io/debezium/connector/mysql/MySqlStreamingChangeEventSource.java
copy
fs_brokers/cdc_client/src/main/java/org/apache/doris/cdcclient/source/reader/{SplitReadResult.java
=> SnapshotReaderContext.java} (65%)
copy regression-test/data/{ann_index_p0/scalar_quantization.out =>
job_p0/streaming_job/cdc/test_streaming_postgres_job_split.out} (59%)
copy
regression-test/suites/job_p0/streaming_job/cdc/{test_streaming_postgres_job_dup.groovy
=> test_streaming_postgres_job_split.groovy} (55%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
