作业反压的话,barrier一直都流不到下游,容易造成checkpoint超时。
建议分享一下作业webUI上的checkpoint 信息。
祝好
唐云
From: Wesley Peng
Sent: Tuesday, September 3, 2019 15:44
To: user-zh@flink.apache.org
Subject: Re: 回复: flink使用StateBackend问题
on 2019/9/3 15:38, 守护 wrote
on 2019/9/3 15:38, 守护 wrote:
org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received late
message for now expired checkpoint attempt 3 from
24674987621178ed1a363901acc5b128 of job fd5010cbf20501339f1136600f0709c3.
请问这个是什么问题呢?
Hi
on 2019/9/3 12:14, 々守护々 wrote:
现象:我是在代码中配置StateBackend的,代码是这样写的env.setStateBackend(new
RocksDBStateBackend("hdfs://host51:9000/flink/checkpoints",true)),但是我发现在下面的SQLwindow中始终在checkpoint那就过不去,总是报n/a,
下面我就把代码中的这句给注释掉了,在flink-conf.xml文件中配置
state.checkpoints.dir: