tzulitai commented on PR #52: URL: https://github.com/apache/flink-connector-kafka/pull/52#issuecomment-1755980007
@Tan-JiaLiang you are right, that's why it's taking me a while to open the new PR. The problem with my approach is that it can potentially read more records when restoring. Essentially what we need to do, is that at _some_ point before the first snapshot is taken, we need to actually look up the offsets for empty partitions and replace any kind of marker. Your PR does this very early on the JMs, and I'm trying to figure out if there's any way to postpone this as much as possible to the TMs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
