[
https://issues.apache.org/jira/browse/FLINK-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15045127#comment-15045127
]
ASF GitHub Bot commented on FLINK-3102:
---------------------------------------
Github user StephanEwen commented on a diff in the pull request:
https://github.com/apache/flink/pull/1437#discussion_r46837302
--- Diff:
flink-streaming-connectors/flink-connector-kafka/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumer.java
---
@@ -222,18 +219,18 @@
/** The committer that persists the committed offsets */
private transient OffsetHandler offsetHandler;
- /** The partitions actually handled by this consumer */
- private transient List<TopicPartition> subscribedPartitions;
+ /** The partitions actually handled by this consumer at runtime */
+ private transient List<KafkaTopicPartitionLeader> subscribedPartitions;
/** The offsets of the last returned elements */
- private transient long[] lastOffsets;
+ private transient HashMap<KafkaTopicPartition, Long> lastOffsets;
/** The latest offsets that have been committed to Kafka or ZooKeeper.
These are never
* newer then the last offsets (Flink's internal view is fresher) */
- private transient long[] commitedOffsets;
+ private transient HashMap<KafkaTopicPartition, Long> commitedOffsets;
--- End diff --
Type in the variable name: "committed"
> Allow reading from multiple topics with one FlinkKafkaConsumer
> --------------------------------------------------------------
>
> Key: FLINK-3102
> URL: https://issues.apache.org/jira/browse/FLINK-3102
> Project: Flink
> Issue Type: New Feature
> Components: Kafka Connector
> Reporter: Robert Metzger
> Assignee: Robert Metzger
>
> Currently, a Kafka consumer allows to read from only one topic.
> For cases where multiple topics contain messages with the same schema, it is
> useful to allow to subscribe to many topics using one FlinkKafkaConsumer
> instance.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
