[
https://issues.apache.org/jira/browse/FLINK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Martijn Visser closed FLINK-11319.
----------------------------------
Resolution: Won't Fix
[~allenxwang] With the Kafka Source moved to the new Source API, I'm wondering
if this issue has now been resolved in your use case as well.The old Kafka
Source connector is deprecated so we won't add new features to it. Could you
let us know if this issue is now resolved for you or re-open the ticket?
> Allow usage of custom implementation of Kafka Producer and Consumer in source
> and sink
> --------------------------------------------------------------------------------------
>
> Key: FLINK-11319
> URL: https://issues.apache.org/jira/browse/FLINK-11319
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / Kafka
> Reporter: Allen Wang
> Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> We use our own implementation of Kafka producer and consumer in our cloud
> environment for better integration with our infrastructure. The {{Consumer}}
> and {{Producer}} interfaces are properly implemented, but the implementation
> does not extend {{KafkaConsumer}} or {{KafkaProducer}}. Instead, it wraps and
> decorates the instance of the default Kafka implementation.
> I propose the following changes to make it easy to hook up our own
> implementation with Flink.
> * Refer to {{Consumer}} and {{Producer}} interface, not {{KafkaConsumer}} or
> {{KafkaProducer}} in {{FlinkKafkaInternalProducer}} and
> {{KafkaConsumerThread}}
> * Add {{ConsumerBuilder}} and {{ProducerBuilder}} interface with the
> following definition
> {code:java}
> // ProducerBuilder
> Producer<K, V> build(Properties properties)
> // ConsumerBuilder
> Consumer<byte[], byte[]> build(Properties properties){code}
> * Add new constructors in {{FlinkKafkaProducer}} and {{FlinkKafkaConsumer}}
> to pass in the {{ProducerBuilder}} and {{ConsumerBuilder}}.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
