[
https://issues.apache.org/jira/browse/FLINK-5856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15880121#comment-15880121
]
ASF GitHub Bot commented on FLINK-5856:
---------------------------------------
GitHub user shuai-xu opened a pull request:
https://github.com/apache/flink/pull/3398
[FLINK-5856] return redundant containers to yarn for yarn mode
This pr is for
jira-#[5856](https://issues.apache.org/jira/browse/FLINK-5856)
The yarn AMRMClient used for requesting containers from yarn in flink has
its own defects:
It need to remove container requests after container returned, or else the
requests will be sent again.
Even so, it doesn't guarantee that the number of containers return is
exactly equal to the number requested.
So need to release the redundant containers returned for yarn mode as we
ask for containers according to the need of a job.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/shuai-xu/flink jira-5856
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/3398.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3398
----
commit 28d0c1b843520ffda3124cdb96dfd7826ae64db5
Author: shuai.xus <[email protected]>
Date: 2017-02-23T08:12:24Z
[FLINK-5856] return redundant containers to yarn for yarn mode
----
> Need return redundant containers to yarn for yarn mode
> ------------------------------------------------------
>
> Key: FLINK-5856
> URL: https://issues.apache.org/jira/browse/FLINK-5856
> Project: Flink
> Issue Type: Bug
> Components: YARN
> Reporter: shuai.xu
> Assignee: shuai.xu
> Labels: flip-6
>
> For flink on yarn mode, RM requests container from yarn according to the
> requirement of the JM. But the AMRMClientAsync used in yarn doesn't guarantee
> that the number of containers returned exactly equal to the number requested.
> So it need to record the number request by flink rm and return the redundant
> ones to yarn.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
