The KafkaSource, and KafkaSourceBuilder appear to prevent users from
providing their own KafkaSubscriber. Am I overlooking something?

In my case I have an external system that controls which topics we should
be ingesting, and it can change over time. I need to add, and remove topics
as we refresh configuration from this external system without having to
stop and start our Flink job. Initially it appeared I could accomplish this
by providing my own implementation of the `KafkaSubscriber` interface,
which would be invoked periodically as configured by the `
partition.discovery.interval.ms` property. However there is no way to
provide my implementation to the KafkaSource since the constructor for
KafkaSource is package protected, and the KafkaSourceBuilder does not
supply a way to provide the `KafkaSubscriber`.

How can I accomplish a period refresh of the topics to ingest?

Thanks

Reply via email to