GitHub user yew1eb opened a pull request:
https://github.com/apache/flink/pull/4768
[Flink-7704][flip6] Add JobPlanHandler for new RestServerEndpoint
## What is the purpose of the change
Add `JobPlanHandler` for the new `RestServerEndpoint`.
## Verifying this change
This change added tests and can be verified as follows:
- JSON marshalling is tested via `JobPlanInfoTest`.
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): (no)
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`: (no)
- The serializers: (no)
- The runtime per-record code paths (performance sensitive): (no)
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Yarn/Mesos, ZooKeeper: (no)
## Documentation
- Does this pull request introduce a new feature? (no)
- If yes, how is the feature documented? (not applicable)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/yew1eb/flink FLINK-7704
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/4768.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4768
----
commit 6edb0151e9206d024f1b9437324d38988a762da5
Author: Till Rohrmann <[email protected]>
Date: 2017-09-22T11:31:12Z
[FLINK-7667] [flip6] Use ArchivedExecutionGraph as serializable
AccessExecutionGraph
This commit removes AccessExecutionGraph#getCheckpointCoordinator and
changes the
AccessExecutionGraph#getJobCheckpointSettings into
#getJobCheckpointConfiguration.
The JobCheckpointConfiguration only contains the CheckpointCoordinator
relevant
configuration settings and excludes the serialized state backend and the
serialized master hooks. That way we don't send unnecessary information when
the ArchivedExecutionGraph is requested.
This closes #4727.
commit 33144cb4cd7c9a15fa8dde3a14ba2c66ffbf8559
Author: Till Rohrmann <[email protected]>
Date: 2017-09-25T13:29:59Z
[FLINK-7668] Add ExecutionGraphCache for ExecutionGraph based REST handlers
The ExecutionGraphCache replaces the ExecutionGraphHolder. Unlike the
latter, the former
does not expect the AccessExecutionGraph to be the true ExecutionGraph.
Instead it assumes
it to be the ArchivedExecutionGraph. Therefore, it invalidates the cache
entries after
a given time to live period. This will trigger requesting the
AccessExecutionGraph again
and, thus, updating the ExecutionGraph information for the ExecutionGraph
based REST
handlers.
In order to avoid memory leaks, the WebRuntimeMonitor starts now a periodic
cleanup task
which triggers ExecutionGraphCache.cleanup. This methods releases all cache
entries which
have exceeded their time to live. Currently it is set to 20 *
refreshInterval of the
web gui.
This closes #4728.
commit 0b8b89ba9c0979bb4cad1b52ba7e6ecbbd67cb92
Author: Till Rohrmann <[email protected]>
Date: 2017-09-26T16:39:15Z
[FLINK-7695] [flip6] Add JobConfigHandler for new RestServerEndpoint
commit 5d745691e379988dd6a5daaacb3341cb72fdc7da
Author: Hai Zhou UTC+8 <[email protected]>
Date: 2017-09-28T08:31:35Z
Merge pull request #2 from tillrohrmann/portJobConfigHandler
Port job config handler
commit 942d9e6d469fa2b0a91fe91c594d5348d06d3013
Author: yew1eb <[email protected]>
Date: 2017-10-03T17:07:49Z
Add JobPlanHandler for new RestServerEndpoint
commit 50043e088214c65e75628b6f58bc768bf6d73abf
Author: yew1eb <[email protected]>
Date: 2017-10-04T06:02:26Z
Merge remote-tracking branch 'upstream/master' into FLINK-7704
commit 3bd690e57fa1d0a6afb9ca1bac75547bb6e762c7
Author: yew1eb <[email protected]>
Date: 2017-10-04T06:11:04Z
remove unused code
----
---
