[jira] [Resolved] (FLINK-35379) File merging manager is not properly notified about checkpoint

2024-05-30 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-35379. - Fix Version/s: 1.20.0 Resolution: Fixed > File merging manager is not properly notified

[jira] [Commented] (FLINK-35379) File merging manager is not properly notified about checkpoint

2024-05-30 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850592#comment-17850592 ] Zakelly Lan commented on FLINK-35379: - Merged into master via

[jira] [Commented] (FLINK-35400) Rebuild FileMergingSnapshotManager in failover

2024-05-30 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850590#comment-17850590 ] Zakelly Lan commented on FLINK-35400: - Merged into master via

[jira] [Resolved] (FLINK-35400) Rebuild FileMergingSnapshotManager in failover

2024-05-30 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-35400. - Fix Version/s: 1.20.0 Resolution: Fixed > Rebuild FileMergingSnapshotManager in failover

[jira] [Commented] (FLINK-32088) Re-uploading in state file-merging for space amplification control

2024-05-30 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850589#comment-17850589 ] Zakelly Lan commented on FLINK-32088: - Merged into master via

[jira] [Resolved] (FLINK-32088) Re-uploading in state file-merging for space amplification control

2024-05-30 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-32088. - Fix Version/s: 1.20.0 Resolution: Fixed > Re-uploading in state file-merging for space

[jira] [Resolved] (FLINK-34456) Move all checkpoint-related options into CheckpointingOptions

2024-05-29 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-34456. - Resolution: Fixed > Move all checkpoint-related options into CheckpointingOptions >

[jira] [Commented] (FLINK-34456) Move all checkpoint-related options into CheckpointingOptions

2024-05-29 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850401#comment-17850401 ] Zakelly Lan commented on FLINK-34456: - Merged into master via 89c89d85 > Move all

[jira] [Commented] (FLINK-34510) Flink 2.0: Rename RestoreMode to RecoveryClaimMode

2024-05-29 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17850354#comment-17850354 ] Zakelly Lan commented on FLINK-34510: - [~spoon-lz] Yes, we should wait until 1.20 release (when we

[jira] [Commented] (FLINK-35446) FileMergingSnapshotManagerBase throws a NullPointerException

2024-05-28 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17849894#comment-17849894 ] Zakelly Lan commented on FLINK-35446: - Thanks for the reminder [~rskraba] , actually I do miss

[jira] [Resolved] (FLINK-35446) FileMergingSnapshotManagerBase throws a NullPointerException

2024-05-26 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-35446. - Fix Version/s: 1.20.0 Assignee: Zakelly Lan Resolution: Fixed >

[jira] [Commented] (FLINK-35446) FileMergingSnapshotManagerBase throws a NullPointerException

2024-05-26 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17849563#comment-17849563 ] Zakelly Lan commented on FLINK-35446: - Merged into master via

[jira] [Commented] (FLINK-35411) Optimize wait logic in draining of async state requests

2024-05-24 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17849336#comment-17849336 ] Zakelly Lan commented on FLINK-35411: - [~spoon-lz] sure, will do. Thanks for your volunteering. >

[jira] [Commented] (FLINK-35355) Async aggregating state

2024-05-24 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17849335#comment-17849335 ] Zakelly Lan commented on FLINK-35355: - Merged into master via

[jira] [Resolved] (FLINK-35355) Async aggregating state

2024-05-24 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-35355. - Fix Version/s: 2.0.0 Assignee: Jie Pu Resolution: Fixed > Async aggregating

[jira] [Commented] (FLINK-35446) FileMergingSnapshotManagerBase throws a NullPointerException

2024-05-24 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17849323#comment-17849323 ] Zakelly Lan commented on FLINK-35446: - [~rskraba] Thanks for letting me know! I'll fix this. >

[jira] [Resolved] (FLINK-35410) Avoid sync waiting in coordinator thread of ForSt executor

2024-05-23 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-35410. - Resolution: Fixed > Avoid sync waiting in coordinator thread of ForSt executor >

[jira] [Commented] (FLINK-35410) Avoid sync waiting in coordinator thread of ForSt executor

2024-05-23 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848840#comment-17848840 ] Zakelly Lan commented on FLINK-35410: - Merged into master via

[jira] [Assigned] (FLINK-35411) Optimize wait logic in draining of async state requests

2024-05-22 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-35411: --- Assignee: Yanfei Lei (was: Zakelly Lan) > Optimize wait logic in draining of async state

[jira] [Assigned] (FLINK-35412) Batch execution of async state request callback

2024-05-22 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-35412: --- Assignee: Zakelly Lan > Batch execution of async state request callback >

[jira] [Commented] (FLINK-35411) Optimize wait logic in draining of async state requests

2024-05-22 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848812#comment-17848812 ] Zakelly Lan commented on FLINK-35411: - [~spoon-lz] Actually this is found by some our internal

[jira] [Assigned] (FLINK-35411) Optimize wait logic in draining of async state requests

2024-05-22 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-35411: --- Assignee: Zakelly Lan > Optimize wait logic in draining of async state requests >

[jira] [Created] (FLINK-35412) Batch execution of async state request callback

2024-05-21 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35412: --- Summary: Batch execution of async state request callback Key: FLINK-35412 URL: https://issues.apache.org/jira/browse/FLINK-35412 Project: Flink Issue Type:

[jira] [Created] (FLINK-35411) Optimize wait logic in draining of async state requests

2024-05-21 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35411: --- Summary: Optimize wait logic in draining of async state requests Key: FLINK-35411 URL: https://issues.apache.org/jira/browse/FLINK-35411 Project: Flink Issue

[jira] [Created] (FLINK-35410) Avoid sync waiting in coordinator thread of ForSt executor

2024-05-21 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35410: --- Summary: Avoid sync waiting in coordinator thread of ForSt executor Key: FLINK-35410 URL: https://issues.apache.org/jira/browse/FLINK-35410 Project: Flink

[jira] [Assigned] (FLINK-35400) Rebuild FileMergingSnapshotManager in failover

2024-05-21 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-35400: --- Assignee: Zakelly Lan > Rebuild FileMergingSnapshotManager in failover >

[jira] [Updated] (FLINK-35400) Rebuild FileMergingSnapshotManager in failover

2024-05-20 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-35400: Description: Currently, the {{FileMergingSnapshotManager}} is released within

[jira] [Created] (FLINK-35400) Rebuild FileMergingSnapshotManager in failover

2024-05-20 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35400: --- Summary: Rebuild FileMergingSnapshotManager in failover Key: FLINK-35400 URL: https://issues.apache.org/jira/browse/FLINK-35400 Project: Flink Issue Type:

[jira] [Resolved] (FLINK-34615) Move ExternalizedCheckpointCleanup to flink-core

2024-05-17 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-34615. - Fix Version/s: 1.20.0 Resolution: Fixed > Move ExternalizedCheckpointCleanup to

[jira] [Commented] (FLINK-34615) Move ExternalizedCheckpointCleanup to flink-core

2024-05-17 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847190#comment-17847190 ] Zakelly Lan commented on FLINK-34615: - Merged into master via

[jira] [Commented] (FLINK-35356) Async reducing state

2024-05-16 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847126#comment-17847126 ] Zakelly Lan commented on FLINK-35356: - Merged into master via

[jira] [Resolved] (FLINK-35356) Async reducing state

2024-05-16 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-35356. - Resolution: Fixed > Async reducing state > > > Key:

[jira] [Created] (FLINK-35379) File merging manager is not properly notified about checkpoint

2024-05-16 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35379: --- Summary: File merging manager is not properly notified about checkpoint Key: FLINK-35379 URL: https://issues.apache.org/jira/browse/FLINK-35379 Project: Flink

[jira] [Assigned] (FLINK-35356) Async reducing state

2024-05-15 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-35356: --- Assignee: Zakelly Lan > Async reducing state > > >

[jira] [Assigned] (FLINK-32088) Re-uploading in state file-merging for space amplification control

2024-05-15 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-32088: --- Assignee: Zakelly Lan (was: Han Yin) > Re-uploading in state file-merging for space

[jira] [Closed] (FLINK-32083) Chinese translation of documentation of checkpoint file-merging

2024-05-15 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan closed FLINK-32083. --- Resolution: Duplicate > Chinese translation of documentation of checkpoint file-merging >

[jira] [Resolved] (FLINK-35153) Internal Async State Implementation and StateDescriptor for Map/List State

2024-05-15 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-35153. - Resolution: Fixed > Internal Async State Implementation and StateDescriptor for Map/List State

[jira] [Commented] (FLINK-35153) Internal Async State Implementation and StateDescriptor for Map/List State

2024-05-15 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846563#comment-17846563 ] Zakelly Lan commented on FLINK-35153: - Merged into master via 73a7e1cc > Internal Async State

[jira] [Created] (FLINK-35356) Async reducing state

2024-05-14 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35356: --- Summary: Async reducing state Key: FLINK-35356 URL: https://issues.apache.org/jira/browse/FLINK-35356 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35355) Async aggregating state

2024-05-14 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35355: --- Summary: Async aggregating state Key: FLINK-35355 URL: https://issues.apache.org/jira/browse/FLINK-35355 Project: Flink Issue Type: Sub-task

[jira] [Assigned] (FLINK-35153) Internal Async State Implementation and StateDescriptor for Map/List State

2024-05-14 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-35153: --- Assignee: Zakelly Lan > Internal Async State Implementation and StateDescriptor for

[jira] [Commented] (FLINK-35168) Basic State Iterator for async processing

2024-05-13 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845908#comment-17845908 ] Zakelly Lan commented on FLINK-35168: - Merged into master via 01586780 > Basic State Iterator for

[jira] [Resolved] (FLINK-35168) Basic State Iterator for async processing

2024-05-13 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-35168. - Resolution: Fixed > Basic State Iterator for async processing >

[jira] [Commented] (FLINK-35025) Wire AsyncExecutionController to AbstractStreamOperator

2024-05-09 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845190#comment-17845190 ] Zakelly Lan commented on FLINK-35025: - [~yunfengzhou] I think you are right. Thanks for the

[jira] [Assigned] (FLINK-32087) Space amplification statistics of file merging

2024-05-07 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-32087: --- Assignee: Yanfei Lei (was: Rui Xia) > Space amplification statistics of file merging >

[jira] [Created] (FLINK-35307) Add Compile CI check on jdk17

2024-05-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35307: --- Summary: Add Compile CI check on jdk17 Key: FLINK-35307 URL: https://issues.apache.org/jira/browse/FLINK-35307 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-35306) Flink cannot compile with jdk17

2024-05-07 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844519#comment-17844519 ] Zakelly Lan commented on FLINK-35306: - How about also adding compilation CI check on java11/17 >

[jira] [Comment Edited] (FLINK-35306) Flink cannot compile with jdk17

2024-05-07 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844519#comment-17844519 ] Zakelly Lan edited comment on FLINK-35306 at 5/8/24 4:25 AM: - How about also

[jira] [Resolved] (FLINK-35161) Implement StateExecutor for ForStStateBackend

2024-05-07 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-35161. - Resolution: Fixed > Implement StateExecutor for ForStStateBackend >

[jira] [Commented] (FLINK-35161) Implement StateExecutor for ForStStateBackend

2024-05-07 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844232#comment-17844232 ] Zakelly Lan commented on FLINK-35161: - Merged via ea4112aefa72e9d15525a72157ced3e3da3650ff >

[jira] [Resolved] (FLINK-32080) Restoration of FileMergingSnapshotManager

2024-05-07 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-32080. - Resolution: Fixed > Restoration of FileMergingSnapshotManager >

[jira] [Commented] (FLINK-32080) Restoration of FileMergingSnapshotManager

2024-05-07 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844223#comment-17844223 ] Zakelly Lan commented on FLINK-32080: - Merged via afe4c79efa15902369d41ef5a6e73d79a2e7d525 >

[jira] [Assigned] (FLINK-32086) Cleanup non-reported managed directory on exit of TM

2024-04-22 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-32086: --- Assignee: Feifan Wang (was: Zakelly Lan) > Cleanup non-reported managed directory on exit

[jira] [Commented] (FLINK-32086) Cleanup non-reported managed directory on exit of TM

2024-04-22 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839916#comment-17839916 ] Zakelly Lan commented on FLINK-32086: - [~Feifan Wang] I'm not working on this. And [~zhoujira86] are

[jira] [Created] (FLINK-35186) Create State V2 from new StateDescriptor

2024-04-22 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35186: --- Summary: Create State V2 from new StateDescriptor Key: FLINK-35186 URL: https://issues.apache.org/jira/browse/FLINK-35186 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-35168) Basic State Iterator for async processing

2024-04-18 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-35168: Component/s: Runtime / State Backends > Basic State Iterator for async processing >

[jira] [Created] (FLINK-35168) Basic State Iterator for async processing

2024-04-18 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35168: --- Summary: Basic State Iterator for async processing Key: FLINK-35168 URL: https://issues.apache.org/jira/browse/FLINK-35168 Project: Flink Issue Type: Sub-task

[jira] [Assigned] (FLINK-35156) Wire new operators for async state with DataStream V2

2024-04-18 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-35156: --- Assignee: Zakelly Lan > Wire new operators for async state with DataStream V2 >

[jira] [Created] (FLINK-35156) Wire new operators for async state with DataStream V2

2024-04-18 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35156: --- Summary: Wire new operators for async state with DataStream V2 Key: FLINK-35156 URL: https://issues.apache.org/jira/browse/FLINK-35156 Project: Flink Issue

[jira] [Updated] (FLINK-35153) Internal Async State Implementation and StateDescriptor for Map/List State

2024-04-18 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-35153: Component/s: Runtime / State Backends > Internal Async State Implementation and StateDescriptor

[jira] [Created] (FLINK-35153) Internal Async State Implementation and StateDescriptor for Map/List State

2024-04-18 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35153: --- Summary: Internal Async State Implementation and StateDescriptor for Map/List State Key: FLINK-35153 URL: https://issues.apache.org/jira/browse/FLINK-35153 Project:

[jira] [Updated] (FLINK-35153) Internal Async State Implementation and StateDescriptor for Map/List State

2024-04-18 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-35153: Parent: FLINK-34974 Issue Type: Sub-task (was: Bug) > Internal Async State

[jira] [Resolved] (FLINK-35025) Wire AsyncExecutionController to AbstractStreamOperator

2024-04-17 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-35025. - Resolution: Fixed > Wire AsyncExecutionController to AbstractStreamOperator >

[jira] [Commented] (FLINK-34936) Register reused state handles to FileMergingSnapshotManager

2024-04-17 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838092#comment-17838092 ] Zakelly Lan commented on FLINK-34936: - Merged into master via 31ea1a93 > Register reused state

[jira] [Commented] (FLINK-35025) Wire AsyncExecutionController to AbstractStreamOperator

2024-04-17 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838093#comment-17838093 ] Zakelly Lan commented on FLINK-35025: - Merged into master via c7be45d0...fe8dde4e > Wire

[jira] [Resolved] (FLINK-34936) Register reused state handles to FileMergingSnapshotManager

2024-04-17 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-34936. - Resolution: Fixed > Register reused state handles to FileMergingSnapshotManager >

[jira] [Commented] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

2024-04-11 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836142#comment-17836142 ] Zakelly Lan commented on FLINK-34704: - Thanks for your detailed explanation! Now I see your point.

[jira] [Commented] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

2024-04-11 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836063#comment-17836063 ] Zakelly Lan commented on FLINK-34704: - Actually, even if we don't checkpoint while it is calling

[jira] [Commented] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

2024-04-10 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835975#comment-17835975 ] Zakelly Lan commented on FLINK-34704: - [~pnowojski] IIUC, the {{AsyncWaitOperator}} is a special one

[jira] [Updated] (FLINK-34936) Register reused state handles to FileMergingSnapshotManager

2024-04-09 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-34936: Summary: Register reused state handles to FileMergingSnapshotManager (was: Register shared state

[jira] [Assigned] (FLINK-34936) Register shared state files to FileMergingSnapshotManager

2024-04-09 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-34936: --- Assignee: Zakelly Lan (was: Jinzhong Li) > Register shared state files to

[jira] [Commented] (FLINK-34936) Register shared state files to FileMergingSnapshotManager

2024-04-09 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835375#comment-17835375 ] Zakelly Lan commented on FLINK-34936: - Since [~lijinzhong] is kind of busy recently, I'll take over

[jira] [Commented] (FLINK-34516) Move CheckpointingMode to flink-core

2024-04-09 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835180#comment-17835180 ] Zakelly Lan commented on FLINK-34516: - Created FLINK-35060 to address this. > Move

[jira] [Created] (FLINK-35060) Provide compatibility of old CheckpointMode for connector testing framework

2024-04-09 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35060: --- Summary: Provide compatibility of old CheckpointMode for connector testing framework Key: FLINK-35060 URL: https://issues.apache.org/jira/browse/FLINK-35060 Project:

[jira] [Commented] (FLINK-34516) Move CheckpointingMode to flink-core

2024-04-08 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834911#comment-17834911 ] Zakelly Lan commented on FLINK-34516: - [~martijnvisser] It shouldn't be a breaking change in 1.20. I

[jira] [Commented] (FLINK-32070) FLIP-306 Unified File Merging Mechanism for Checkpoints

2024-04-07 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834620#comment-17834620 ] Zakelly Lan commented on FLINK-32070: - [~zhoujira86] The checkpointing part (without restoration

[jira] [Commented] (FLINK-33734) Merge unaligned checkpoint state handle

2024-04-06 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834603#comment-17834603 ] Zakelly Lan commented on FLINK-33734: - I'd +1 for this optimization. > Merge unaligned checkpoint

[jira] [Commented] (FLINK-32070) FLIP-306 Unified File Merging Mechanism for Checkpoints

2024-04-06 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834595#comment-17834595 ] Zakelly Lan commented on FLINK-32070: - [~zhoujira86] Yes, this helps the scenario where too many

[jira] [Updated] (FLINK-34973) FLIP-425: Asynchronous Execution Model

2024-04-02 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-34973: Component/s: Runtime / Checkpointing Runtime / State Backends

[jira] [Updated] (FLINK-34986) Basic framework of async execution for state

2024-04-01 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-34986: Summary: Basic framework of async execution for state (was: Basic framework for async execution

[jira] [Created] (FLINK-34986) Basic framework for async execution of state

2024-04-01 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-34986: --- Summary: Basic framework for async execution of state Key: FLINK-34986 URL: https://issues.apache.org/jira/browse/FLINK-34986 Project: Flink Issue Type:

[jira] [Updated] (FLINK-34973) FLIP-425: Asynchronous Execution Model

2024-04-01 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-34973: Description: This is a sub-FLIP for the disaggregated state management and its related work,

[jira] [Updated] (FLINK-34973) FLIP-425: Asynchronous Execution Model

2024-04-01 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-34973: Summary: FLIP-425: Asynchronous Execution Model (was: FLIP-423: Disaggregated State Storage and

[jira] [Updated] (FLINK-34984) FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-34984: Summary: FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP) (was:

[jira] [Updated] (FLINK-34984) Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-34984: Description: The past decade has witnessed a dramatic shift in Flink's deployment mode, workload

[jira] [Updated] (FLINK-34979) Implement State Future and related utilities

2024-04-01 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-34979: Description: Implement the StateFuture. In the very first version, we leverage the

[jira] [Created] (FLINK-34979) Implement State Future and related utilities

2024-03-31 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-34979: --- Summary: Implement State Future and related utilities Key: FLINK-34979 URL: https://issues.apache.org/jira/browse/FLINK-34979 Project: Flink Issue Type:

[jira] [Created] (FLINK-34978) Introduce Asynchronous State APIs

2024-03-31 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-34978: --- Summary: Introduce Asynchronous State APIs Key: FLINK-34978 URL: https://issues.apache.org/jira/browse/FLINK-34978 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34974) FLIP-424: Asynchronous State APIs

2024-03-31 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-34974: --- Summary: FLIP-424: Asynchronous State APIs Key: FLINK-34974 URL: https://issues.apache.org/jira/browse/FLINK-34974 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-34973) FLIP-423: Disaggregated State Storage and Management

2024-03-31 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-34973: --- Summary: FLIP-423: Disaggregated State Storage and Management Key: FLINK-34973 URL: https://issues.apache.org/jira/browse/FLINK-34973 Project: Flink Issue

[jira] [Comment Edited] (FLINK-34936) Register shared state files to FileMergingSnapshotManager

2024-03-26 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830807#comment-17830807 ] Zakelly Lan edited comment on FLINK-34936 at 3/26/24 6:57 AM: -- Thanks for

[jira] [Assigned] (FLINK-34936) Register shared state files to FileMergingSnapshotManager

2024-03-26 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-34936: --- Assignee: Jinzhong Li > Register shared state files to FileMergingSnapshotManager >

[jira] [Commented] (FLINK-34936) Register shared state files to FileMergingSnapshotManager

2024-03-26 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830807#comment-17830807 ] Zakelly Lan commented on FLINK-34936: - Thanks for reporting this! Assigned to you > Register shared

[jira] [Commented] (FLINK-30535) Introduce TTL state based benchmarks

2024-03-19 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828329#comment-17828329 ] Zakelly Lan commented on FLINK-30535: - [~rovboyko] Actually this has been resolved. Closing... >

[jira] [Resolved] (FLINK-30535) Introduce TTL state based benchmarks

2024-03-19 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-30535. - Resolution: Fixed > Introduce TTL state based benchmarks >

[jira] [Created] (FLINK-34704) Process checkpoint barrier in AsyncWaitOperator when the element queue is full

2024-03-17 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-34704: --- Summary: Process checkpoint barrier in AsyncWaitOperator when the element queue is full Key: FLINK-34704 URL: https://issues.apache.org/jira/browse/FLINK-34704

[jira] [Assigned] (FLINK-34615) Move ExternalizedCheckpointCleanup to flink-core

2024-03-14 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-34615: --- Assignee: liuzhuo > Move ExternalizedCheckpointCleanup to flink-core >

[jira] [Resolved] (FLINK-34484) Split 'state.backend.local-recovery' into two options for checkpointing and recovery

2024-03-14 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan resolved FLINK-34484. - Resolution: Fixed > Split 'state.backend.local-recovery' into two options for checkpointing and

[jira] [Assigned] (FLINK-34516) Move CheckpointingMode to flink-core

2024-03-14 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan reassigned FLINK-34516: --- Assignee: Zakelly Lan > Move CheckpointingMode to flink-core >

[jira] [Created] (FLINK-34668) Report State handle of file merging directory to JM

2024-03-14 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-34668: --- Summary: Report State handle of file merging directory to JM Key: FLINK-34668 URL: https://issues.apache.org/jira/browse/FLINK-34668 Project: Flink Issue

  1   2   3   4   >