[
https://issues.apache.org/jira/browse/FLINK-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michal Harish updated FLINK-4023:
---------------------------------
Description:
Currently, Flink queries Kafka for partition information when creating the
Kafka consumer. This is done on the client when submitting the Flink job, which
requires the client to be able to fetch the partition data from Kafka which may
only be accessible from the cluster environment where the tasks will be
running. Moving the partition discovery to the open() method should solve this
problem.
was:
Currently, Flink queries Kafka for partition information when creating the
Kafka consumer. This is done on the client when submitting the Flink job, which
requires the client to be able to fetch the partition data from Kafka which may
only be accessible from the cluster environment where the tasks will be
running. Moving the partition discovery to the open task should solve this
problem.
> Move Kafka consumer partition discovery from constructor to open()
> ------------------------------------------------------------------
>
> Key: FLINK-4023
> URL: https://issues.apache.org/jira/browse/FLINK-4023
> Project: Flink
> Issue Type: Improvement
> Components: Kafka Connector
> Reporter: Michal Harish
> Priority: Minor
> Labels: kafka, kafka-0.8
>
> Currently, Flink queries Kafka for partition information when creating the
> Kafka consumer. This is done on the client when submitting the Flink job,
> which requires the client to be able to fetch the partition data from Kafka
> which may only be accessible from the cluster environment where the tasks
> will be running. Moving the partition discovery to the open() method should
> solve this problem.
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
