This is an automated email from the ASF dual-hosted git repository.
krishvishal pushed a change to branch kafka-offset-expiry
in repository https://gitbox.apache.org/repos/asf/iggy.git
from 9360a4a4f feat(gateways): delete expired Kafka group offsets in Iggy
add ac27a023e chore(deps): Bump the cpp group across 1 directory with 2
updates (#4770)
add fdec51376 chore(deps): Bump the node group across 1 directory with 2
updates (#4769)
add a4a9a79a7 chore(deps): Bump the web group across 1 directory with 7
updates (#4768)
add 3c493f2f6 feat(connectors): deliver Iceberg sink messages at least
once (#4759)
add 51924ed31 Merge branch 'master' into kafka-offset-expiry
No new revisions were added by this update.
Summary of changes:
.claude/skills/connector-sink/SKILL.md | 2 +-
core/connectors/runtime/README.md | 2 +-
.../example_config/connectors/iceberg_sink.toml | 4 +
core/connectors/sdk/README.md | 3 +-
core/connectors/sdk/src/lib.rs | 6 +-
core/connectors/sinks/iceberg_sink/Cargo.toml | 3 -
core/connectors/sinks/iceberg_sink/README.md | 90 +++-
.../sinks/iceberg_sink/src/router/commit.rs | 558 +++++++++++++++++++--
.../iceberg_sink/src/router/dynamic_router.rs | 303 ++++++++++-
.../sinks/iceberg_sink/src/router/mod.rs | 314 ++++++++----
.../sinks/iceberg_sink/src/router/redelivery.rs | 385 ++++++++++++++
.../sinks/iceberg_sink/src/router/static_router.rs | 254 +++++++++-
core/connectors/sinks/iceberg_sink/src/sink.rs | 9 +
.../src/harness/handle/connectors_runtime.rs | 20 +-
.../tests/connectors/fixtures/iceberg/container.rs | 139 ++++-
.../tests/connectors/fixtures/iceberg/mod.rs | 3 +-
core/integration/tests/connectors/fixtures/mod.rs | 3 +-
.../connectors/iceberg/iceberg_sink_delivery.rs | 229 +++++++++
core/integration/tests/connectors/iceberg/mod.rs | 1 +
foreign/cpp/MODULE.bazel | 4 +-
foreign/cpp/MODULE.bazel.lock | 9 +-
foreign/node/package-lock.json | 149 +++---
foreign/node/package.json | 2 +-
web/package-lock.json | 178 +++----
web/package.json | 14 +-
25 files changed, 2302 insertions(+), 382 deletions(-)
create mode 100644 core/connectors/sinks/iceberg_sink/src/router/redelivery.rs
create mode 100644
core/integration/tests/connectors/iceberg/iceberg_sink_delivery.rs
