[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581598#comment-17581598
]
Echo Lee commented on FLINK-25360:
--
[~liufangqi] Thank you very much for coming up with this idea. We
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470369#comment-17470369
]
刘方奇 commented on FLINK-25360:
-
[~yunta] OK, THX, I will put the design doc link in this issue comment later.
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470355#comment-17470355
]
Yun Tang commented on FLINK-25360:
--
[~liufangqi] I suggest to create a design doc via google doc first.
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469754#comment-17469754
]
刘方奇 commented on FLINK-25360:
-
[~yunta] THX for your reply, do you mean that I should write a proposal in
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469693#comment-17469693
]
Yun Tang commented on FLINK-25360:
--
[~liufangqi] I think we could at least to write a discuss email for
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469633#comment-17469633
]
刘方奇 commented on FLINK-25360:
-
[~yunta] Hi, could you help to push the thread that we metioned before?
1.
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464302#comment-17464302
]
Yue Ma commented on FLINK-25360:
> Could we write meta state info in savepoint meta?
[~yunta]
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464259#comment-17464259
]
刘方奇 commented on FLINK-25360:
-
[~yunta] THX for your reply, actually I don't understand why RocksDB
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464242#comment-17464242
]
Yun Tang commented on FLINK-25360:
--
[~liufangqi] Since RocksDB incremenatl checkpoints already have
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464232#comment-17464232
]
刘方奇 commented on FLINK-25360:
-
[~sjwiesman] THX for your reply, so should we add enough info to checkpoint
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17464028#comment-17464028
]
Seth Wiesman commented on FLINK-25360:
--
[~yunta] there isn't any way to do this with the state
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463708#comment-17463708
]
刘方奇 commented on FLINK-25360:
-
[~yunta] As I see, exactly, raw state are used little. But there are still
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463703#comment-17463703
]
Yun Tang commented on FLINK-25360:
--
Raw state is not recomended to use anymore, and flink would only
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463684#comment-17463684
]
刘方奇 commented on FLINK-25360:
-
[~yunta] Yeah, your understand is right, but changing the max paralleilsm
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463660#comment-17463660
]
Yun Tang commented on FLINK-25360:
--
It seems you're trying to read checkpoint to modify previous
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463632#comment-17463632
]
刘方奇 commented on FLINK-25360:
-
[~yunta] Hi, THX, in my case, we want to read the checkpoint, change the
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463622#comment-17463622
]
Yun Tang commented on FLINK-25360:
--
[~liufangqi], I think your concerns have two different problems:
#
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463562#comment-17463562
]
刘方奇 commented on FLINK-25360:
-
Exactly, it can improve state-processor-api. I think it can also help the
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463561#comment-17463561
]
刘方奇 commented on FLINK-25360:
-
[~yunta] THX for your reply. We use state-processor-api to transform state
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463557#comment-17463557
]
Yun Tang commented on FLINK-25360:
--
[~liufangqi] Any changes to checkpoint persistent content requires
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462480#comment-17462480
]
刘方奇 commented on FLINK-25360:
-
[~yunta] , Actually, we can restore StateMetaInfoSnapshot in the state file,
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461526#comment-17461526
]
刘方奇 commented on FLINK-25360:
-
[~mayuehappy] surely, when flink job start or recovery, the info is not
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461392#comment-17461392
]
Yue Ma commented on FLINK-25360:
[~liufangqi] i think adding this information to the metadata still
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461309#comment-17461309
]
刘方奇 commented on FLINK-25360:
-
[~mayuehappy] THX for your reply, you are right. If the info is store in the
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461304#comment-17461304
]
Yue Ma commented on FLINK-25360:
[~yunta] The StateSerializer would be persisted in the
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461281#comment-17461281
]
刘方奇 commented on FLINK-25360:
-
[~yunta] Hi, do you mean that CheckpointMetadata.class contain these info, I
[
https://issues.apache.org/jira/browse/FLINK-25360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461276#comment-17461276
]
Yun Tang commented on FLINK-25360:
--
The state name and state serializer have been persisted, what else
27 matches
Mail list logo
