[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834603#comment-17834603 ] Zakelly Lan commented on FLINK-33734: - I'd +1 for this optimization. > Merge unaligned checkpoint

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830472#comment-17830472 ] Feifan Wang commented on FLINK-33734: - Kindly ping [~Zakelly] , [~roman] . > Merge unaligned

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818283#comment-17818283 ] Feifan Wang commented on FLINK-33734: - [~roman] : {quote}Do I understand correctly, that the

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818255#comment-17818255 ] Zakelly Lan commented on FLINK-33734: - [~Feifan Wang] Sorry for the late reply as I was on vacation

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818251#comment-17818251 ] Roman Khachatryan commented on FLINK-33734: --- As for {quote}IIUC, ByteStreamStateHandle in each

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818249#comment-17818249 ] Roman Khachatryan commented on FLINK-33734: --- Thanks for the PR [~Feifan Wang]  Do I

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818246#comment-17818246 ] Feifan Wang commented on FLINK-33734: - Hi [~fanrui] , I rerun the test job , and find some long

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17818227#comment-17818227 ] Feifan Wang commented on FLINK-33734: - Sorry to keep you waiting [~fanrui] . Checkpoint production

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813874#comment-17813874 ] Rui Fan commented on FLINK-33734: - Thanks [~Feifan Wang] for the effort. IIUC, the checkpoint avg time

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813646#comment-17813646 ] Feifan Wang commented on FLINK-33734: - I found that only merging handles was not enough. Although

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17796391#comment-17796391 ] Piotr Nowojski commented on FLINK-33734: {quote} Yes, since multiple subtasks will reuse

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17795222#comment-17795222 ] Feifan Wang commented on FLINK-33734: - Thanks [~roman] , merge handle in JM in MetadataSerializer

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794682#comment-17794682 ] Roman Khachatryan commented on FLINK-33734: --- Thanks for the proposal! You're right [~Feifan

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794146#comment-17794146 ] Feifan Wang commented on FLINK-33734: - We do also want to improve the speed of recovery, but

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794090#comment-17794090 ] Piotr Nowojski commented on FLINK-33734: Recovery times are very often important. But yes,

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793998#comment-17793998 ] Feifan Wang commented on FLINK-33734: - Thanks to [~Zakelly] , [~pnowojski] and [~fanrui]  for

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793770#comment-17793770 ] Rui Fan commented on FLINK-33734: - Thanks [~Feifan Wang]  creating this  Jira, and thanks  [~pnowojski] 

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793706#comment-17793706 ] Piotr Nowojski commented on FLINK-33734: That's a good question [~Zakelly]. Apart of that:

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793505#comment-17793505 ] Zakelly Lan commented on FLINK-33734: - hi [~Feifan Wang] ,   I'm wondering if this proposal aims