[
https://issues.apache.org/jira/browse/BEAM-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17125415#comment-17125415
]
Chai Nadig commented on BEAM-6466:
----------------------------------
Hi, I'm running into this problem when using KafkaIO with fixed windows. I see
that the offsets don't get committed or advanced. The pipeline reads a few
records on start and then stops consuming any more records after that. We're
unable to scale our pipelines as we're restricted to using KafkaIO without
windows. Can we bump the priority to p1? Thanks.
> KafkaIO doesn't commit offsets while being used as bounded source
> -----------------------------------------------------------------
>
> Key: BEAM-6466
> URL: https://issues.apache.org/jira/browse/BEAM-6466
> Project: Beam
> Issue Type: Bug
> Components: io-java-kafka
> Affects Versions: 2.9.0
> Reporter: Alexey Romanenko
> Priority: P2
> Labels: stale-P2
>
> While using KafkaIO as bounded source (with {{withMaxReadTime()}} or
> {{withMaxNumRecords()}}) it seems doesn't commit offsets all the time.
> See the details in [the
> discussion|https://lists.apache.org/thread.html/bcec8a1fb166029a4adf3f3491c407d49843406020b20f203ec3c2d2@%3Cuser.beam.apache.org%3E]
> on user@list.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
