Tzu-Li (Gordon) Tai closed FLINK-8001.
       Resolution: Fixed
    Fix Version/s:     (was: 1.3.3)

> Mark Kafka Consumer as idle if it doesn't have partitions
> ---------------------------------------------------------
>                 Key: FLINK-8001
>                 URL: https://issues.apache.org/jira/browse/FLINK-8001
>             Project: Flink
>          Issue Type: Bug
>            Reporter: Aljoscha Krettek
>            Assignee: Tzu-Li (Gordon) Tai
>            Priority: Blocker
>             Fix For: 1.3.4, 1.4.0
> In Flink 1.3.x the Kafka Consumer will emit a {{Long.MAX_VALUE}} watermark if 
> it has zero partitions assigned. If this happens and other parallel instances 
> of the Kafka Consumer are marked as idle (which currently never happens by 
> default but does happen in custom forks of our Kafka code) this means that 
> the watermark jumps to {{Long.MAX_VALUE}} downstream.
> In Flink 1.4.x this happens implicitly in the {{PeriodicWatermarkEmitter}} in 
> {{AbstractFetcher}} where the watermark is {{Long.MAX_VALUE}} if we don't 
> have any partitions. This should be changed to mark the source as idle 
> instead, if we don't have any partitions.

This message was sent by Atlassian JIRA

Reply via email to