Shekharrajak opened a new issue, #108: URL: https://github.com/apache/doris-kafka-connector/issues/108
Share groups allow multiple workers to process records from the same partition, enabling concurrency beyond partition count and improving handling of hot partitions. How: - Keep the existing Kafka Connect behavior as the default. - Add a configurable share-aware worker in this repository. - Flush records to Doris before explicitly acknowledging them to Kafka. (start with at least once and then EoS) - Support out-of-order delivery without highest-offset suppression. - Add recovery tests and document at-least-once semantics: failures between Doris commit and Kafka ACK can produce duplicates. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
