[
https://issues.apache.org/jira/browse/BEAM-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17142823#comment-17142823
]
Alexey Romanenko edited comment on BEAM-6466 at 6/23/20, 10:29 AM:
-------------------------------------------------------------------
[~chai.nadig] Could you provide more details about your environment, like:
- which Beam version and runner do you use?
- what is a configuration of your Kafka.Read?
- do you use {{withMaxReadTime()}} or {{withMaxNumRecords()}} ?
It would be great if you could share a code of a pipeline that reproduces this
issue.
was (Author: aromanenko):
[~chai.nadig] Could you provide more details about your environment, like:
- which Beam version and runner do you use?
- what is a configuration of your Kafka.Read?
- do you use {{withMaxReadTime()}} or {{withMaxNumRecords()}} ?
It would be great if you could share a code of a pipeline that reproduces this
issue.
> KafkaIO doesn't commit offsets while being used as bounded source
> -----------------------------------------------------------------
>
> Key: BEAM-6466
> URL: https://issues.apache.org/jira/browse/BEAM-6466
> Project: Beam
> Issue Type: Bug
> Components: io-java-kafka
> Affects Versions: 2.9.0
> Reporter: Alexey Romanenko
> Priority: P3
>
> While using KafkaIO as bounded source (with {{withMaxReadTime()}} or
> {{withMaxNumRecords()}}) it seems doesn't commit offsets all the time.
> See the details in [the
> discussion|https://lists.apache.org/thread.html/bcec8a1fb166029a4adf3f3491c407d49843406020b20f203ec3c2d2@%3Cuser.beam.apache.org%3E]
> on user@list.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)