[
https://issues.apache.org/jira/browse/FLINK-26284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Pohl updated FLINK-26284:
----------------------------------
Description: Cleanup of job state does not work properly in an HA setup.
{{releaseAndTryRemove}} deletes the meta data stored in the store before
cleaning up the {{StateHandle}}. If the {{StateHandle}} cleanup fails after the
reference is already deleted in the {{StateHandleStore}}, a cleanup retry will
constantly fail because it cannot deserialize the {{StateHandle}} anymore.
(was: Cleanup of job state does not work properly in an HA set with ZooKeeper.
[ZooKeeperStateHandleStore.releaseAndTryRemove:410|https://github.com/apache/flink/blob/0cf7c3dedd3575cdfed57727e9712c28c013d7ca/flink-runtime/src/main/java/org/apache/flink/runtime/zookeeper/ZooKeeperStateHandleStore.java#L410]
deletes the data stored in ZooKeeper before cleaning up the {{StateHandle}}.
If the {{StateHandle}} cleanup fails after the reference is already deleted in
ZK, a cleanup retry will constantly because it cannot deserialize the
{{StateHandle}} anymore.)
> The HA StateHandleStore implementations clean the metdata before cleaning the
> StateHandle
> -----------------------------------------------------------------------------------------
>
> Key: FLINK-26284
> URL: https://issues.apache.org/jira/browse/FLINK-26284
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Coordination
> Affects Versions: 1.15.0
> Reporter: Matthias Pohl
> Assignee: Matthias Pohl
> Priority: Blocker
>
> Cleanup of job state does not work properly in an HA setup.
> {{releaseAndTryRemove}} deletes the meta data stored in the store before
> cleaning up the {{StateHandle}}. If the {{StateHandle}} cleanup fails after
> the reference is already deleted in the {{StateHandleStore}}, a cleanup retry
> will constantly fail because it cannot deserialize the {{StateHandle}}
> anymore.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
