This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a change to branch auto-pick-66409-branch-4.1
in repository https://gitbox.apache.org/repos/asf/doris.git
from fa410f73f9f branch-4.1: [chore](ci) Disable macOS BE UT workflow
(#67129)
add 72994726f93 [improvement](streamingjob) change streaming job source
log lag in bytes (#66409)
No new revisions were added by this update.
Summary of changes:
...cordRequest.java => FetchEndOffsetRequest.java} | 27 ++-
.../job/cdc/response/FetchEndOffsetResult.java} | 19 +-
.../doris/job/extensions/insert/InsertJob.java | 4 +-
.../insert/streaming/StreamingInsertJob.java | 31 +--
.../doris/job/offset/SourceOffsetProvider.java | 23 +-
.../job/offset/jdbc/JdbcSourceOffsetProvider.java | 130 +++++++----
.../java/org/apache/doris/metric/MetricRepo.java | 44 +++-
.../streaming/StreamingInsertJobLagTest.java | 76 +++++++
.../jdbc/JdbcSourceOffsetProviderLagTest.java | 243 +++++++++++++++++++++
.../java/org/apache/doris/metric/MetricsTest.java | 54 +++++
.../cdcclient/controller/ClientController.java | 10 +-
.../cdcclient/source/reader/SourceReader.java | 6 +-
.../reader/mysql/MySqlBinlogLagCalculator.java | 77 +++++++
.../source/reader/mysql/MySqlSourceReader.java | 63 +++++-
.../reader/postgres/PostgresSourceReader.java | 89 ++++++--
.../cdcclient/itcase/CdcClientWriteHarness.java | 11 +
.../cdcclient/itcase/MySqlVersionSmokeITCase.java | 1 +
.../itcase/PostgresVersionSmokeITCase.java | 1 +
.../reader/mysql/MySqlBinlogLagCalculatorTest.java | 165 ++++++++++++++
.../cdc/test_streaming_mysql_job_lag.groovy | 24 +-
.../cdc/test_streaming_mysql_job_metrics.groovy | 33 ++-
.../cdc/test_streaming_oceanbase_job.groovy | 12 +
.../cdc/test_streaming_postgres_job_lag.groovy | 18 +-
23 files changed, 1031 insertions(+), 130 deletions(-)
copy
fe/fe-common/src/main/java/org/apache/doris/job/cdc/request/{WriteRecordRequest.java
=> FetchEndOffsetRequest.java} (59%)
copy fe/{fe-core/src/main/java/org/apache/doris/datasource/es/EsUrls.java =>
fe-common/src/main/java/org/apache/doris/job/cdc/response/FetchEndOffsetResult.java}
(83%)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/job/extensions/insert/streaming/StreamingInsertJobLagTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/job/offset/jdbc/JdbcSourceOffsetProviderLagTest.java
create mode 100644
fs_brokers/cdc_client/src/main/java/org/apache/doris/cdcclient/source/reader/mysql/MySqlBinlogLagCalculator.java
create mode 100644
fs_brokers/cdc_client/src/test/java/org/apache/doris/cdcclient/source/reader/mysql/MySqlBinlogLagCalculatorTest.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
