GitHub user tillrohrmann opened a pull request:
https://github.com/apache/flink/pull/4281
[FLINK-7108] [yarn] Add YARN entry points based on the generic entry point
This PR is based on #4259, #4260, #4261 and #4272.
Add the YarnSesssionClusterEntrypoint and the YarnJobClusterEntrypoint
which extend
SessionClusterEntrypoint and JobClusterEntrypoint, respectively.
Add new Yarn session and per-job cluster entry points
Remove old Flip-6 Yarn per job entry point
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tillrohrmann/flink yarnEntrypoints
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/4281.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4281
----
commit 6c313e0ecc8ff84aee9403acbc60efa31d49f69e
Author: Till Rohrmann <[email protected]>
Date: 2017-07-04T21:15:52Z
[FLINK-7103] [dispatcher] Add skeletal structure of Dispatcher component
The Dispatcher is responsible for receiving job submissions, persisting the
JobGraphs,
spawning JobManager to execute the jobs and recovering the jobs in case of
a master
failure. This commit adds the basic skeleton including the RPC call for job
submission.
Add cleanup logic for finished jobs
Pass BlobService to JobManagerRunner
commit 44abd04f328a60d3d25f74454ad04bd5c79fc258
Author: Till Rohrmann <[email protected]>
Date: 2017-07-05T11:38:35Z
[FLINK-7105] Make ActorSystems non daemonic
In order to not having to explicitly wait on the termination of an
ActorSystem
in the main thread, we now create the ActorSystems in non-daemonic mode.
That
way the process won't terminate if there is still an active actor.
commit 4a2b08645a2e7d80c7404b6af6f396178de19e33
Author: Till Rohrmann <[email protected]>
Date: 2017-07-06T15:16:18Z
[FLINK-7082] Add generic entry point for session and per-job clusters
commit 3768ca597e40230da4edc75fa6b6f3203e4ee313
Author: Till Rohrmann <[email protected]>
Date: 2017-07-06T15:16:54Z
[FLINK-7086] Add Flip-6 standalone session cluster entry point
commit cb52bb4ea730529125556de6dc1201b90472eee7
Author: Till Rohrmann <[email protected]>
Date: 2017-07-05T15:16:52Z
[FLINK-7108] [yarn] Add YARN entry points based on the generic entry point
Add the YarnSesssionClusterEntrypoint and the YarnJobClusterEntrypoint
which extend
SessionClusterEntrypoint and JobClusterEntrypoint, respectively.
Add new Yarn session and per-job cluster entry points
Remove old Flip-6 Yarn per job entry point
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
