This is an automated email from the ASF dual-hosted git repository.
spetz pushed a change to branch server_perf_cut_extra_work
in repository https://gitbox.apache.org/repos/asf/iggy.git
from 142606d2d Merge branch 'master' into server_perf_cut_extra_work
add f239fca1e fix(connectors): defer source checkpoints and surface sink
failures (#4153)
add 4730a1a5b Merge branch 'master' into server_perf_cut_extra_work
No new revisions were added by this update.
Summary of changes:
Cargo.lock | 2 +
.../connectors/sinks/clickhouse_sink/src/binary.rs | 161 +++++++--
.../connectors/sinks/clickhouse_sink/src/client.rs | 4 +-
core/connectors/sinks/doris_sink/src/lib.rs | 1 +
core/connectors/sinks/elasticsearch_sink/README.md | 7 +-
.../sinks/elasticsearch_sink/config.toml | 4 +-
.../connectors/sinks/elasticsearch_sink/src/lib.rs | 391 ++++++++++++++++-----
core/connectors/sinks/iceberg_sink/README.md | 4 +-
core/connectors/sinks/iceberg_sink/src/lib.rs | 41 +++
core/connectors/sinks/iceberg_sink/src/sink.rs | 10 +
core/connectors/sinks/influxdb_sink/src/lib.rs | 20 +-
core/connectors/sinks/postgres_sink/README.md | 21 +-
core/connectors/sinks/postgres_sink/src/lib.rs | 130 +++++--
core/connectors/sinks/quickwit_sink/README.md | 7 +-
core/connectors/sinks/quickwit_sink/config.toml | 2 +-
core/connectors/sinks/quickwit_sink/src/lib.rs | 60 +++-
core/connectors/sinks/s3_sink/README.md | 8 +-
core/connectors/sinks/s3_sink/src/buffer.rs | 10 +
core/connectors/sinks/s3_sink/src/client.rs | 55 ---
core/connectors/sinks/s3_sink/src/formatter.rs | 56 ++-
core/connectors/sinks/s3_sink/src/sink.rs | 391 ++++++++++++++++++++-
core/connectors/sinks/surrealdb_sink/README.md | 2 +-
.../sources/elasticsearch_source/Cargo.toml | 4 +
.../sources/elasticsearch_source/README.md | 335 ++++++------------
.../sources/elasticsearch_source/config.toml | 2 +-
.../sources/elasticsearch_source/src/lib.rs | 337 ++++++++++++++++--
.../elasticsearch_source/src/state_manager.rs | 40 ++-
core/connectors/sources/influxdb_source/README.md | 106 +++---
.../connectors/sources/influxdb_source/config.toml | 10 +-
.../sources/influxdb_source/src/common.rs | 22 +-
core/connectors/sources/influxdb_source/src/lib.rs | 300 +++++++++++++---
core/connectors/sources/influxdb_source/src/row.rs | 112 ++++--
core/connectors/sources/influxdb_source/src/v2.rs | 16 +-
core/connectors/sources/influxdb_source/src/v3.rs | 114 ++++--
core/connectors/sources/postgres_source/README.md | 233 ++++++++----
.../connectors/sources/postgres_source/config.toml | 4 +-
core/connectors/sources/postgres_source/src/lib.rs | 26 +-
.../connectors/elasticsearch/elasticsearch_sink.rs | 2 +-
core/integration/tests/connectors/fixtures/mod.rs | 11 +-
.../tests/connectors/fixtures/postgres/mod.rs | 7 +-
.../tests/connectors/fixtures/postgres/sink.rs | 36 ++
.../tests/connectors/fixtures/postgres/source.rs | 48 +++
.../tests/connectors/mongodb/mongodb_sink.rs | 8 +-
.../tests/connectors/postgres/postgres_sink.rs | 136 ++++++-
.../tests/connectors/postgres/postgres_source.rs | 349 +++++++++++++++++-
core/integration/tests/connectors/s3/s3_sink.rs | 18 +-
.../tests/connectors/surrealdb/surrealdb_sink.rs | 4 +-
47 files changed, 2828 insertions(+), 839 deletions(-)
