[
https://issues.apache.org/jira/browse/FLINK-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14385412#comment-14385412
]
ASF GitHub Bot commented on FLINK-1771:
---------------------------------------
GitHub user rmetzger opened a pull request:
https://github.com/apache/flink/pull/542
[FLINK-1771] Add support for submitting single jobs to a detached YARN
session
With this change, users can submit a Flink job to a YARN cluster without
having a local client monitoring the Application Master or job status. You can
basically fire and forget a Flink job to YARN.
For supporting this, the ApplicationMaster can now monitor the status of a
job and shutdown itself once it is in a terminal state.
The change also verifies that various ways of setting the parallelism on
YARN are passed through the system correctly (per job, session).
There was a bug in YARN container creation which made the configuration
values for the heap offset useless. This change fixes this error.
All mentioned features and bugs are covered by the flink-yarn-tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/rmetzger/flink yarn-slots-test-rebased
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/542.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #542
----
commit afdc9ac52287f35bdc1413c64f8abbc06efbb3ec
Author: Robert Metzger <[email protected]>
Date: 2015-03-13T14:53:51Z
[FLINK-1771] Add support for submitting single jobs to a detached YARN
session
With this change, users can submit a Flink job to a YARN cluster without
having a local client monitoring the Application Master or job. You can
basically fire and forget a Flink job to YARN.
For supporting this, the ApplicationMaster can now monitor the status of a
job and shutdown itself once it is in a terminal state.
The change also verifies that various ways of setting the parallelism on
YARN are passed through the system correctly (per job, session).
There was a bug in YARN container creation which made the configuration
values for the heap offset useless. This change fixes this error.
All mentioned features and bugs are covered by the flink-yarn-tests.
----
> Add support for submitting single jobs to a detached YARN session
> -----------------------------------------------------------------
>
> Key: FLINK-1771
> URL: https://issues.apache.org/jira/browse/FLINK-1771
> Project: Flink
> Issue Type: Improvement
> Components: YARN Client
> Affects Versions: 0.9
> Reporter: Robert Metzger
> Assignee: Robert Metzger
>
> We need tests ensuring that the processing slots are set properly when
> starting Flink on YARN, in particular with the per job YARN session feature.
> Also, the YARN tests for detached YARN sessions / per job yarn clusters are
> polluting the local home-directory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
