GitHub user gyfora opened a pull request:
https://github.com/apache/flink/pull/747
New operator state interfaces
This PR contains the proposed changes for the streaming operator state
interfaces as described in
https://docs.google.com/document/d/1nTn4Tpafsnt-TCT6L1vlHtGGgRevU90yRsUQEmkRMjk/edit?usp=sharing
Highlights:
- Added OperatorState interface accessible from RuntimeContext
- System managed checkpointing/restore of the states (no required
implementations for Serializable states)
- confirmCheckpoint(..) method in the CheckpointCommitter interface has
been changed to return the StateHandle for the checkpointed state
- Removed Checkpointed/AsynchronouslyCheckpointed interfaces
- Updated Persistent Kafka source to work on the new interfaces (does not
work properly yet :/ )
- Updated Tests and IT cases
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gyfora/flink new_state
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/747.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #747
----
commit 9fe6bd39df4cc74c1708ba3f108339979497c5fb
Author: Gyula Fora <[email protected]>
Date: 2015-05-17T18:33:38Z
[streaming] Initial rework of the operator state interfaces
commit 7eba5200fbad93af2bf28e9289864ded76091ef9
Author: Gyula Fora <[email protected]>
Date: 2015-05-28T09:07:42Z
[streaming] Modified kafka source to use the new state interfaces
commit f5f32d95e41bc8da2f76656d0331965c2dfb06f0
Author: Gyula Fora <[email protected]>
Date: 2015-05-28T11:31:07Z
[streaming] Allow multiple operator states + stateful function test rework
commit 9956d58eba92bd0c340bbd2e8a058d4adf57baa6
Author: Paris Carbone <[email protected]>
Date: 2015-05-28T13:07:49Z
[streaming] Add stateHandle to checkpointed message
commit 1ae3faaad7ad6f5c65a7f69dc114c2b4535cacef
Author: Gyula Fora <[email protected]>
Date: 2015-05-29T09:47:44Z
[streaming] Return null for empty state instead of empty hashmap
commit ac2f638a93b9b67be5e485b9d9e3a0c7a7644eee
Author: Paris Carbone <[email protected]>
Date: 2015-05-29T09:57:34Z
[streaming] fix for null state in ConfirmCheckpoint messages
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
