mas-chen commented on PR #52: URL: https://github.com/apache/flink-connector-kafka/pull/52#issuecomment-1758213954
I think this bug requires a bit more thought--for example, this can happen with any offset initializer strategy (Flink provided ones, custom implementations). For example, I've helped fix this same issue for the TimestampInitializer. Have we considered that perhaps the enumerator should not assign "empty" splits? We mostly see this case when Kafka adds new partitions, which is supposed to be handled by the partition discovery feature in the connector. If the enumerator can check splits are empty then it can also assign the splits when they have data, with partition discovery. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
