jomin7 opened a new pull request, #8684:
URL: https://github.com/apache/camel-quarkus/pull/8684
Fixes #8621 Add KafkaOffsetBackingStore native support and integration tests
Body:
Summary
Add native compilation support for KafkaOffsetBackingStore and integration
tests for MongoDB and PostgreSQL Debezium connectors.
In production/containerized deployments, storing Debezium offsets in a
local file is impractical. KafkaOffsetBackingStore provides a distributed,
fault-tolerant alternative by persisting offsets to a Kafka topic. This
was not working in native mode due to missing GraalVM reflection registrations.
Changes
Native support (DebeziumSupportProcessor):
- Register KafkaOffsetBackingStore for reflection
- Register Kafka Connect converter classes (ByteArrayConverter,
BooleanConverter, etc.)
- Register Kafka serializer/deserializer classes needed at runtime
- Register Kafka client infrastructure classes (JmxReporter,
RangeAssignor, SASL classes) instantiated reflectively by KafkaBasedLog
- Register JSON converter classes with constructors/methods access (used
by KafkaOffsetBackingStore for offset serialization)
Shared test support (AbstractDebeziumResource):
- Add kafkaBootstrapServers(), receiveViaKafkaOffset(), and
getKafkaOffsetEndpointUrl() endpoints to the base class for reuse across
connectors
Integration tests (MongoDB & PostgreSQL):
- Add testKafkaOffsetBackingStore() test for each connector
- Start a Strimzi Kafka cluster alongside the database container in test
resources
- Override getKafkaOffsetEndpointUrl() with connector-specific Debezium
endpoint configuration
Grouped module (debezium-grouped):
- Add strimzi-test-container test dependency (sources are copied from
individual modules at build time)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
