[
https://issues.apache.org/jira/browse/KYLIN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
GuKe updated KYLIN-4743:
------------------------
Summary: NPE when some kafka partition's offset is not exists in checkpoint
(was: When the checkpoint of streming cube contains invalid offset (ex null)
of Kafka partition,kafka connector will can't to open.)
> NPE when some kafka partition's offset is not exists in checkpoint
> ------------------------------------------------------------------
>
> Key: KYLIN-4743
> URL: https://issues.apache.org/jira/browse/KYLIN-4743
> Project: Kylin
> Issue Type: Improvement
> Components: Real-time Streaming
> Affects Versions: v3.0.0, v3.1.0
> Environment: Centos 7.4.1
> hbase 1.2.4
> hive 2.0.1
> hadoop 2.7.2
> Reporter: GuKe
> Assignee: GuKe
> Priority: Major
> Fix For: Future
>
> Attachments: WX20200903-153117.png
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> We have used streaming cube to statistics data from Kafka.
> If the data partitions of kafka topic is imbalanced (one or more partition is
> empty),it will cause the cube's checkpoint contains one or more partition's
> offset is empty.
> For some reason the receiver node be restarted,it will fail to initialization
> kafka connector because offset is null.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
