[ 
https://issues.apache.org/jira/browse/BEAM-2534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ismaël Mejía updated BEAM-2534:
-------------------------------
    Component/s:     (was: z-do-not-use-sdk-java-extensions)
                 io-java-kafka

> KafkaIO should allow gaps in message offsets
> --------------------------------------------
>
>                 Key: BEAM-2534
>                 URL: https://issues.apache.org/jira/browse/BEAM-2534
>             Project: Beam
>          Issue Type: Bug
>          Components: io-java-kafka
>    Affects Versions: 2.0.0
>            Reporter: Raghu Angadi
>            Assignee: Raghu Angadi
>            Priority: Minor
>             Fix For: 2.1.0
>
>
> KafkaIO reader logs a warning when it notices gaps in offsets for messages. 
> While such gaps are not expected for normal Kafka topics, there could be gaps 
> when log compaction is enabled (which deletes older messages for a key). 
> This warning log is not very useful. Also we should take such gaps while 
> estimating backlog.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to