GitHub user Clarkkkkk opened a pull request:
https://github.com/apache/flink/pull/6192
[FLINK-9567][runtime][yarn] Fix the bug that Flink does not release Yarn
container in some cases
## What is the purpose of the change
- This pull request responds to [JIRA issue
FLINK-9567](https://issues.apache.org/jira/browse/FLINK-9567).
- This pull request is to avoid flink system does not release taskmanager
container in some specific case.
## Bried change log
- Modify the onContainerCompleted method in YarnResourceManager.
- Add a checkWorkerRegistrationWithResourceId method in ResourceManager
that check the status of task executor with specific resourceId
- Add a triggerTaskManagerHeartbeatTimeout method in ResouceManager which
is only visibleForTesting, which emulate the timeout of task manager leads to
the problem.
## Verifying this change
This change is covered by testOnContainerCompleted added in
YarnResourceManagerTest
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): (no)
- The public API, i.e., is any changed class annotated withÂ
@Public(Evolving): (no)
- The serializers: (no)
- The runtime per-record code paths (performance sensitive): (no)
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes)
- The S3 file system connector: (no)
## Documentation
- Does this pull request introduce a new feature? (No)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Clarkkkkk/flink master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/6192.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6192
----
commit 6eaac2b5bc06ef6dffef5eb489668b0d81ac179b
Author: yangshimin <yangshimin@...>
Date: 2018-06-21T03:36:01Z
[FLINK-9567][runtime][yarn]Fix the bug that Flink does not release Yarn
container in some cases
----
---
