[
https://issues.apache.org/jira/browse/HUDI-918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liujinhui updated HUDI-918:
---------------------------
Description:
When the sourcelimit is less than the number of Kafka partitions, Hudi cannot
get the data
Steps to reproduce：
1、Use deltastreamer to consume data from kafka
2、Set the value of sourceLimit to be less than the value of kafka partition
3、INFO DeltaSync:313 - No new data, source checkpoint has not changed. Nothing
to commit. Old checkpoint
was:When the sourcelimit is less than the number of Kafka partitions, Hudi
cannot get the data
> Fix kafkaOffsetGen can not read kafka data bug
> ----------------------------------------------
>
> Key: HUDI-918
> URL: https://issues.apache.org/jira/browse/HUDI-918
> Project: Apache Hudi (incubating)
> Issue Type: Bug
> Components: DeltaStreamer
> Reporter: liujinhui
> Assignee: liujinhui
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.6.0
>
>
> When the sourcelimit is less than the number of Kafka partitions, Hudi cannot
> get the data
> Steps to reproduce：
> 1、Use deltastreamer to consume data from kafka
> 2、Set the value of sourceLimit to be less than the value of kafka partition
> 3、INFO DeltaSync:313 - No new data, source checkpoint has not changed.
> Nothing to commit. Old checkpoint
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
