GitHub user tillrohrmann opened a pull request:
https://github.com/apache/flink/pull/4884
[FLINK-7705] Add JobDetailsHandler
## What is the purpose of the change
Adds the `JobDetailsHandler` which serves `JobDetailsInfo` instances for
the new `DispatcherRestEndpoint`.
## Verifying this change
- Added `JobDetailsInfoTest` which tests (un)marshalling of `JobDetailsInfo`
- Tested the `JobDetailsInfo` manually
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): (no)
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`: (no)
- The serializers: (no)
- The runtime per-record code paths (performance sensitive): (no)
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Yarn/Mesos, ZooKeeper: (no)
## Documentation
- Does this pull request introduce a new feature? (no)
- If yes, how is the feature documented? (not applicable)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tillrohrmann/flink addJobDetailsHandler
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/4884.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4884
----
commit 00af8d5ec08e3d6b26f69a9fec8bbe5d1f2f23a4
Author: Till Rohrmann <[email protected]>
Date: 2017-10-11T22:40:17Z
[FLINK-7648] [flip6] Add TaskManagersHandler
Send dataPort and HardwareDescription to RM
Instantiate RM leader retriever
commit 7bfe6ba9d85809ca946bfeb8411af77dfb33f7d7
Author: Till <[email protected]>
Date: 2017-10-13T14:32:56Z
[FLINK-7648] [flip6] Write HardwareDescription in sub object of
legacy.TaskManagersHandler
commit fa708ec8996b2aac37fe273ff080d75f0fcfc488
Author: Till <[email protected]>
Date: 2017-10-18T11:50:06Z
[FLINK-7863] Generalize MetricFetcher to work with a RestfulGateway
Add more logging to MetricFetcher
commit 050c8c8e04aa34c7b0fa2759c0aa4bf3872b4daf
Author: Till <[email protected]>
Date: 2017-10-19T12:51:07Z
Fix MetricFetcherTest
commit 102f4243d82691dca5b610331ac6187c5cbc37fd
Author: Till <[email protected]>
Date: 2017-10-19T09:06:41Z
[FLINK-7872] Allow to pass in additional HTTP headers
HandlerUtils#sendResponse now accepts a map of additional http response
headers
and their values. This allows to set additional headers such as the
ACCESS_CONTROL_ALLOW_ORIGIN header and its value.
commit 77942cde55a72754c9d68b06526d96d198835ee3
Author: Till <[email protected]>
Date: 2017-10-17T13:03:41Z
Move TaskManagersHandler to rest.handler.taskmanager
commit 5c54f79acd5e8fc585d914cb7a0ea941b81b6e34
Author: Till <[email protected]>
Date: 2017-10-18T14:54:44Z
[FLINK-7867] Start MetricQueryService in TaskManagerRunner
commit a6d6b1d435bb3673a5f196887169b15af801f1df
Author: Till <[email protected]>
Date: 2017-10-17T13:06:01Z
Move TaskManager messages to rest.messages.taskmanager
commit fb111322bd77e42f503be3d6e8361fa60835b479
Author: Till <[email protected]>
Date: 2017-10-17T13:06:45Z
Move TaskManager message tests to rest.messages.taskmanager
commit f0f7e7f7e0eeec7647815ba941f43fec3dcc72f9
Author: Till <[email protected]>
Date: 2017-10-17T15:02:30Z
[FLINK-7862] [flip6] Add TaskManagerDetailsHandler
Pass MetricQueryServiceRetriever to DispatcherRestEndpoint
commit c3b9a1ef01f564f7ba79c0b0bfe8fc780dda38b6
Author: Till <[email protected]>
Date: 2017-10-18T17:03:28Z
[FLINK-7862] No longer send inidividual TaskManager information in an array
commit 3d4eb3eb48818b0a1e8925c9a9de2c3def79a82f
Author: Till <[email protected]>
Date: 2017-10-19T12:00:07Z
[FLINK-7862] Change web ui to calculate total memory from heap and non-heap
data
commit 3d45e9b791bba916080d36d9f42d93204d52269d
Author: Till Rohrmann <[email protected]>
Date: 2017-10-21T09:35:53Z
Fix checkstyle violation
commit 8be8693d21e03885760a98423831c88c90fb33bb
Author: Till Rohrmann <[email protected]>
Date: 2017-10-21T16:31:39Z
Fix failing WebFrontendITCase
commit 1c96c9bfd630cc0592382fb71b20cf4d410b7483
Author: Nico Kruber <[email protected]>
Date: 2017-07-25T12:49:58Z
[FLINK-7262][blob] remove the unused FallbackLibraryCacheManager
This class was basically only used in unit tests and not really needed there
either. The code path inside TaskManager was also dead.
This closes #4403.
commit 33e3d487be509252e78a34ad823b5b7c539e2623
Author: Nico Kruber <[email protected]>
Date: 2017-10-05T13:18:58Z
[FLINK-7196][blob] add a TTL to all transient BLOBs
Transient BLOB files should not exist for long and are only deleted manually
from the caches and after access on the server. This uses the BLOB storage's
cleanup interval to set a TTL on all transient BLOB files as a backup
cleanup
path. The cleanup task itself runs every cleanupInterval seconds and
removes all
transient BLOBs for which the TTL is older than the current time. This way,
a
transient BLOB stays at most 2*cleanupInterval seconds before getting
deleted
automatically.
This closes #4381.
commit 899b978211a4bd9391c431cbcf18392b3fd062cc
Author: Till Rohrmann <[email protected]>
Date: 2017-10-10T16:39:40Z
[FLINK-7793] [flip6] Defer slot release to ResourceManager
This commit changes the SlotManager behaviour such that upon a TaskManager
timeout
the ResourceManager is only notified about it without removing the slots.
The
ResourceManager can then decide whether it stops the TaskManager and
removes the slots
from the SlotManager or to keep the TaskManager still around.
Add test case
This closes #4795.
commit bd33fec2d2da71057cef7c925dbd2bff12c785a6
Author: Till Rohrmann <[email protected]>
Date: 2017-10-10T22:16:31Z
[hotfix] Remove redundant job status logging
commit 149d15594fbe3d1440a1794c635f2c8bd1a82106
Author: Till Rohrmann <[email protected]>
Date: 2017-10-20T14:25:00Z
[hotfix] Harden SlotManagerTest#testTaskManagerTimeoutDoesNotRemoveSlots
commit 69cefd84b35b8ce0032908977500465f77c9ad2d
Author: Till Rohrmann <[email protected]>
Date: 2017-10-21T16:14:47Z
[FLINK-7705] Add JobDetailsHandler
Add JobID(De)Serializer and JobVertexID(De)Serializer for jackson
----
---