[ 
https://issues.apache.org/jira/browse/BEAM-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17324128#comment-17324128
 ] 

Brian Hulette commented on BEAM-6466:
-------------------------------------

withMaxReadTime and withMaxNumRecords 
[state|https://github.com/apache/beam/blob/3d4db26cfa4ace0a0f2fbb602f422fe30670c35f/sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka/KafkaIO.java#L960]
 "Mainly used for tests and demo applications."

Does that mean we don't really support KafkaIO as a bounded source? (which 
would explain why BEAM-2185 is still open)

> KafkaIO doesn't commit offsets while being used as bounded source
> -----------------------------------------------------------------
>
>                 Key: BEAM-6466
>                 URL: https://issues.apache.org/jira/browse/BEAM-6466
>             Project: Beam
>          Issue Type: Bug
>          Components: io-java-kafka
>    Affects Versions: 2.9.0
>            Reporter: Alexey Romanenko
>            Priority: P1
>
> While using KafkaIO as bounded source (with {{withMaxReadTime()}} or 
> {{withMaxNumRecords()}}) it seems doesn't commit offsets all the time.
> See the details in [the 
> discussion|https://lists.apache.org/thread.html/bcec8a1fb166029a4adf3f3491c407d49843406020b20f203ec3c2d2@%3Cuser.beam.apache.org%3E]
>  on user@list.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to