I'm forwarding my comment from the Jira Issue [1]:
In
https://github.com/appleyuchi/wrongcheckpoint/blob/master/src/main/scala/wordcount_increstate.scala
you set the RocksDBStateBackend, in
https://github.com/appleyuchi/wrongcheckpoint/blob/master/src/main/scala/StateWordCount.scala
you set
I don't know where I did change the state backends.
There are two meaning of "restarting":
??Restarting automatically(success in my experiment)
??Restarting manually(failure in my experiment)
The whole experiment(just a wordcount case) and steps are listed in my github:
.
Best,
David
On Mon, Oct 5, 2020 at 2:38 PM 大森林 wrote:
> Could you give more details?
> Thanks
>
>
> -- 原始邮件 --
> *发件人:* "大森林" ;
> *发送时间:* 2020年10月3日(星期六) 上午9:30
> *收件人:* "David Anderson";
> *抄送:* "user";
&g
Could you give more details?
Thanks
----
??:
"??"
untime/src/main/java/org/apache/flink/runtime/state/filesystem/AbstractFsCheckpointStorage.java#L60
Best
Yun Tang
From: 大森林
Sent: Saturday, October 3, 2020 9:30
To: David Anderson
Cc: user
Subject: 回复： need help about "incremental checkpoint",Thanks
where's the actual path?
I can only get one path from the WEB UI
Is it possible that this error happened in step 5 is due to my code's
fault?
-- --
??:
kEnd)?
>
> Much Thanks~!
>
>
> -- 原始邮件 ------
> 发件人: "大森林" ;
> 发送时间: 2020年10月2日(星期五) 晚上11:41
> 收件人: "David Anderson";
> 抄送: "user";
> 主题: 回复： need help about "incremental checkpoint",Thanks
&g
Thanks for your replies~!
Could you tell me what the right command is to recover from checkpoint
manually using Rocksdb file?
I understand that checkpoint is for automatically recovery,
but in this experiment I stop it by force(input 4 error in nc -lk ),
Is there a way to recover from
eBackend.*
> *It's NOT a match.*
> So I'm wrong in step 5?
> Is my above understanding right?
>
> Thanks for your help.
>
> -- 原始邮件 --
> *发件人:* "David Anderson" ;
> *发送时间:* 2020年10月2日(星期五) 晚上10:35
> *收件人:* "大森林";
> *抄送
Thanks for your replies~!
My English is poor ,I have an understanding of your replies:
Write in RocksDbStateBackend.
Read in FsStateBackend.
It's NOT a match.
So I'm wrong in step 5?
Is my above understanding right?
Thanks for your help.
----
??:
It looks like you were trying to resume from a checkpoint taken with the
FsStateBackend into a revised version of the job that uses the
RocksDbStateBackend. Switching state backends in this way is not supported:
checkpoints and savepoints are written in a state-backend-specific format,
and can
I want to do an experiment of"incremental checkpoint"
my code is:
https://paste.ubuntu.com/p/DpTyQKq6Vk/
pom.xml is:
http://maven.apache.org/POM/4.0.0;
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
12 matches
Mail list logo
