MartijnVisser commented on PR #291: URL: https://github.com/apache/flink-connector-kafka/pull/291#issuecomment-5598953943
@Efrat19 It is deterministic, not an RPC race: a subtask registers before its reader asks for metadata, so a subtask that registers after the bounded sub-enumerators finished discovery always gets `NoMoreSplitsEvent` before its first `MetadataUpdateEvent`. With splits that is fine, idle it hangs unless a later registration re-broadcasts. It needs an idle subtask, which is rare, and the reader-side shortcut that used to finish an idle reader on the signal alone went away in cdfa328b (kafka-3.1.0). Reproduced in `testIdleReader`: CI jobs 99324744080 and 102185118941 on the #289 branch, and 2 of 8 local runs with main's reader, exactly the runs with an idle subtask. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
