Matthias Pohl created FLINK-40553:
-------------------------------------
Summary: Corrupted job-local HA data causes cluster-wide failover
Key: FLINK-40553
URL: https://issues.apache.org/jira/browse/FLINK-40553
Project: Flink
Issue Type: Bug
Components: Runtime / Coordination
Affects Versions: 2.2.1, 2.3.0, 2.4.0
Reporter: Matthias Pohl
There are two code paths that can cause a cluster-wide failover if the HA data
for a single job is corrupted in some way.
One example was where the ExecutionPlan files got deleted causing a
{{FileNotFoundException}} when recovering the job. That triggered a JobManager
failover.
A similar issue can appear when reading the JobResultStore entry files. The
parsing happens in a single command for all files. One file failing to be
retrieved results in the entire JobManager to fail over.
The two issues are covered in separate subtasks and hidden behind a
configuration parameter.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
