lnbest0707 opened a new pull request, #245:
URL: https://github.com/apache/flink-connector-kafka/pull/245

   ## Summary
   
   - Release Dynamic Kafka Source split-local outputs when metadata refresh 
removes assigned splits.
   - Defer releases until the runtime `ReaderOutput` exists for 
restored/pending splits filtered during startup.
   - Add reader tests for both assigned split removal and restored pending 
split cleanup.
   
   ## Root Cause
   
   DynamicKafkaSourceReader filtered removed cluster/topic splits out of reader 
state and closed sub-readers, but did not call 
`ReaderOutput.releaseOutputForSplit(...)`. Flink keeps split-local outputs 
registered for watermark aggregation until they are explicitly released, so 
removed Kafka splits could continue holding back the source watermark 
indefinitely. ([Flink code 
link](https://github.com/apache/flink/blob/master/flink-core/src/main/java/org/apache/flink/api/connector/source/ReaderOutput.java#L103))
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to