raman20 opened a new pull request, #3784:
URL: https://github.com/apache/iggy/pull/3784
## Which issue does this PR address?
Relates to #3764
## Rationale
The Apache Iggy connectors subsystem needed a native `iggy_sink` plugin to
enable streaming message
replication and forwarding between Iggy topics and external Iggy clusters.
## What changed?
The connectors runtime lacked a plugin to sink consumed messages into
another Iggy stream or cluster.
This PR implements `iggy_sink` as a `cdylib` plugin loaded dynamically by
the connectors runtime. It forwards
messages to a target Iggy endpoint, supports optional stream and topic
overrides (`stream_id`, `topic_id`),
preserves message IDs for idempotent retries, and maintains partition-aware
routing.
## Local Execution
- Passed
- Pre-commit hooks ran
Verified locally inside devcontainer:
- `cargo fmt --all --check`
- `cargo sort --no-format --workspace`
- `cargo clippy -p iggy_connector_iggy_sink --all-targets -- -D warnings`
- `cargo test -p iggy_connector_iggy_sink`
- Live end-to-end message replication test in devcontainer with
`iggy-server` and `iggy-connectors`.
## AI Usage
1. Which tools? Google Antigravity
2. Scope of usage? Learning data-flow and implementation of `iggy_sink`
crate, unit tests, integration test suite, and
plugin documentation.
3. How did you verify the generated code works correctly? Verified with
`cargo test`, zero-warning clippy
check, and live end-to-end message streaming replication inside devcontainer.
4. Can you explain every line of the code if asked? Yes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
