GitHub user StefanRRichter opened a pull request:
https://github.com/apache/flink/pull/4353
[FLINK-7213] Introduce state management by OperatorID in TaskManager
Flink-5892 introduced the job manager / checkpoint coordinator part of
managing state on the operator level instead of the task level by introducing
explicit operator_id -> state mappings.
However, this explicit mapping was not introduced in the task manager side,
so the explicit mapping is still converted into a mapping that suits the
implicit operator chain order.
This PR introduces this part and offers explicit state management by
operator_id in the task manager.
Furthermore, this PR also introduces `TaskStateSnapshot` as unify
abstraction to replace `TaskStateHandles` and `SubtaskState`which were always
very similar, except that one offered collections of state handles (to support
scaling in on restore) while the other only contained single objects (because
each state is snapshotted into one state handle).
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/StefanRRichter/flink tmpBU
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/4353.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4353
----
commit d68dd39b343595120f62fc8280b2f3c5f0ee7503
Author: Stefan Richter <[email protected]>
Date: 2017-06-26T16:07:59Z
[FLINK-7213] Introduce state management by OperatorID in TaskManager
commit 11cdd85668aa18f8e5bab0e6cac9ba082bfea95c
Author: Stefan Richter <[email protected]>
Date: 2017-07-11T15:10:03Z
[FLINK-7213] Introduce TaskStateSnapshot to unify TaskStateHandles and
SubtaskState
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---