syhily commented on pull request #17119: URL: https://github.com/apache/flink/pull/17119#issuecomment-913198448
> I'm assuming that we need to have some messages between the readers and the enumerator: > > * The enumerator is not seeking at all. > * Readers seek for exclusive subscriptions. > * For non-exclusive subscriptions, a reader signals to enumerator that the topic partition needs initialization and the reader does not consume from that subscription initially. > * Enumerator sends to all readers with the same topic partition some pause message (this is needed in case of regional failover). > * Enumerator passes some initialization token to one of the readers that all want to seek the same topic partition. > * That one reader seeks and informs enumerator. > * Enumerator unpauses all readers of that TopicPartition. > * Readers that have been paused need to ignore all message ids < pause message id (in case of regional failover) This design is awesome. Move all the seek action in one place is better than the current solution. I have read the code. I think we need to implement the `SourceEvent`. But I may need some time to learn how to use it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
