hubcio opened a new issue, #2595: URL: https://github.com/apache/iggy/issues/2595
The Iceberg sink connector needs integration tests. This one is more complex due to the catalog/storage setup, but we should have at least basic coverage. ## What needs testing - Basic flow: Iggy messages → Iceberg table records - REST catalog integration - At least one storage backend (S3/MinIO is probably easiest for CI) - Schema handling - Router logic (if non-trivial) ## Implementation notes - Can use MinIO + REST catalog (like Apache Polaris or Tabular) - Or use the simpler FS backend for initial tests - The connector has multiple modules (catalog, props, router, sink) - focus on happy path first ## Files to reference - `core/integration/tests/connectors/postgres/postgres_sink.rs` - `core/connectors/sinks/iceberg_sink/src/` ## Acceptance criteria - [ ] At least one e2e test proving data lands in Iceberg - [ ] Test can run in CI (document required containers) - [ ] Clear setup/teardown ## Notes This might be the hardest connector to test due to the Iceberg ecosystem complexity. Starting with FS backend might be pragmatic. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
