[
https://issues.apache.org/jira/browse/FLINK-5193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15708557#comment-15708557
]
ASF GitHub Bot commented on FLINK-5193:
---------------------------------------
GitHub user tillrohrmann opened a pull request:
https://github.com/apache/flink/pull/2910
[backport] [FLINK-5193] [jm] Harden job recovery in case of recovery
failures
This is a backport of #2909 to the release 1.1 branch.
When recovering multiple jobs a single recovery failure caused all jobs to
be not recovered.
This PR changes this behaviour to make the recovery of jobs independent so
that a single
failure won't stall the complete recovery. Furthermore, this PR improves
the error reporting
for failures originating in the ZooKeeperSubmittedJobGraphStore.
cc @uce
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tillrohrmann/flink
backportFixJobRecoveryFailure
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/2910.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2910
----
commit 01620e88ca5a963941ced979c143ab95777249d8
Author: Till Rohrmann <[email protected]>
Date: 2016-11-29T16:31:08Z
[FLINK-5193] [jm] Harden job recovery in case of recovery failures
When recovering multiple jobs a single recovery failure caused all jobs to
be not recovered.
This PR changes this behaviour to make the recovery of jobs independent so
that a single
failure won't stall the complete recovery. Furthermore, this PR improves
the error reporting
for failures originating in the ZooKeeperSubmittedJobGraphStore.
Add test case
Fix failing JobManagerHACheckpointRecoveryITCase
----
> Recovering all jobs fails completely if a single recovery fails
> ---------------------------------------------------------------
>
> Key: FLINK-5193
> URL: https://issues.apache.org/jira/browse/FLINK-5193
> Project: Flink
> Issue Type: Bug
> Components: JobManager
> Affects Versions: 1.2.0, 1.1.3
> Reporter: Till Rohrmann
> Assignee: Till Rohrmann
> Fix For: 1.2.0, 1.1.4
>
>
> In HA case where the {{JobManager}} tries to recover all submitted job
> graphs, e.g. when regaining leadership, it can happen that none of the
> submitted jobs are recovered if a single recovery fails. Instead of failing
> the complete recovery procedure, the {{JobManager}} should still try to
> recover the remaining (non-failing) jobs and print a proper error message for
> the failed recoveries.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
