[
https://issues.apache.org/jira/browse/FLINK-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Juho Autio updated FLINK-9334:
------------------------------
Description:
Tzu-Li (Gordon) said:
{quote}Yes, it might be helpful to have a code snippet to demonstrate the
configuration for partition discovery.
{quote}
----
*Background*
The docs correctly say:
{quote}To enable it, set a non-negative value for
+flink.partition-discovery.interval-millis+ in the _provided properties config_
{quote}
So it should be set in the Properties that are passed in the constructor of
FlinkKafkaConsumer.
I had somehow assumed that this should go to flink-conf.yaml (maybe because it
starts with "flink."?), and obviously the FlinkKafkaConsumer doesn't read that.
A piece of example code might've helped me avoid this mistake.
This was discussed on the user mailing list:
[http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Kafka-Consumers-Partition-Discovery-doesn-t-work-tp19129p19484.html]
was:
Tzu-Li (Gordon) said:
{quote}
Yes, it might be helpful to have a code snippet to demonstrate the
configuration for partition discovery.
{quote}
The docs correctly say:
{quote}
To enable it, set a non-negative value for
+flink.partition-discovery.interval-millis+ in the _provided properties config_
{quote}
So it should be set in the Properties that are passed in the constructor of
FlinkKafkaConsumer.
I had somehow assumed that this should go to flink-conf.yaml (maybe because it
starts with "flink."?), and obviously the FlinkKafkaConsumer doesn't read that.
A piece of example code might've helped me avoid this mistake.
This was discussed on the user mailing list:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Kafka-Consumers-Partition-Discovery-doesn-t-work-tp19129p19484.html
> Docs to have a code snippet of Kafka partition discovery
> --------------------------------------------------------
>
> Key: FLINK-9334
> URL: https://issues.apache.org/jira/browse/FLINK-9334
> Project: Flink
> Issue Type: Improvement
> Reporter: Juho Autio
> Priority: Major
>
> Tzu-Li (Gordon) said:
> {quote}Yes, it might be helpful to have a code snippet to demonstrate the
> configuration for partition discovery.
> {quote}
>
> ----
> *Background*
>
> The docs correctly say:
>
> {quote}To enable it, set a non-negative value for
> +flink.partition-discovery.interval-millis+ in the _provided properties
> config_
> {quote}
>
> So it should be set in the Properties that are passed in the constructor of
> FlinkKafkaConsumer.
>
> I had somehow assumed that this should go to flink-conf.yaml (maybe because
> it starts with "flink."?), and obviously the FlinkKafkaConsumer doesn't read
> that.
>
> A piece of example code might've helped me avoid this mistake.
>
> This was discussed on the user mailing list:
>
> [http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Kafka-Consumers-Partition-Discovery-doesn-t-work-tp19129p19484.html]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)