mfyuce opened a new pull request, #3516:
URL: https://github.com/apache/iggy/pull/3516
## Summary
Adds an OTLP (OpenTelemetry Protocol) gRPC source connector that receives
metrics, traces, and logs from any OpenTelemetry-compatible SDK or collector
and writes them into iggy streams.
- New `iggy_connector_otlp_source` plugin crate under
`core/connectors/sources/`
- Listens on a configurable gRPC endpoint; separate instances per data type
(metrics / logs / traces / flows) map to separate iggy topics
- Accepts gzip-compressed gRPC requests (`tonic` `gzip` feature +
`accept_compressed(CompressionEncoding::Gzip)`) — required for OTel SDKs
that compress by default
- Configurable `batch_length`, `linger_time`, `channel_capacity`,
`batch_size`
- Adds `Dockerfile.connectors` for building the iggy-connectors image
- Adds optional `transport` field to connector runtime config (`tcp` default,
`quic`, `http`) so connectors can reach iggy-server over QUIC on nodes
where the TCP io_uring listener is not available
## Test plan
- [ ] `cargo clippy -p iggy_connector_otlp_source -- -D warnings` passes
- [ ] `cargo test -p iggy_connector_otlp_source` passes
- [ ] End-to-end: OTel collector → otlp_source connector → iggy topic
receives messages
- [ ] gzip: set `compression: gzip` on OTel exporter, verify connector still
receives
- [ ] Dockerfile.connectors builds without error
🤖 Generated with [Claude Code](https://claude.com/claude-code)
https://claude.ai/code/session_018duZYBkbguQ2pn8RJ82PUw
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
