[
https://issues.apache.org/jira/browse/STORM-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050606#comment-15050606
]
ASF GitHub Bot commented on STORM-1175:
---------------------------------------
GitHub user arunmahadevan opened a pull request:
https://github.com/apache/storm/pull/939
[STORM-1175] State store for windowing operations
Added IStatefulBolt abstraction that can be implemented by bolts which
requires
its state to be checkpointed periodically. State implementations based on
key-value mapping store are added. There is a default in-memory based
implementation
and optional redis based implementation that provides state persistence. An
internal
CheckpointSpout periodically emits checkpoint tuples which flows through the
topology DAG to take a consistent snapshot of the state across all
components.
There is still pending work to capture the evaluated/expired state of the
tuples
in the Window and use it to prune duplicate window evaluations during
restart. This can
be built on top of the stateful bolt abstractions and will be done as part
of STORM-1176
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/arunmahadevan/storm windowing-state
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/storm/pull/939.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #939
----
commit f541f3f91aa2d287f56af4655d98ad0be4ba45dc
Author: Arun Mahadevan <[email protected]>
Date: 2015-11-30T11:06:10Z
[STORM-1175] State store for windowing operations
Added IStatefulBolt abstraction that can be implemented by bolts which
requires
its state to be checkpointed periodically. State implementations based on
key-value mapping store are added. There is a default in-memory based
implementation
and optional redis based implementation that provides state persistence. An
internal
CheckpointSpout periodically emits checkpoint tuples which flows through the
topology DAG to take a consistent snapshot of the state across all
components.
There is still pending work to capture the evaluated/expired state of the
tuples
in the Window and use it to prune duplicate window evaluations during
restart. This can
be built on top of the stateful bolt abstractions and will be done as part
of STORM-1176
----
> State store for windowing operations
> ------------------------------------
>
> Key: STORM-1175
> URL: https://issues.apache.org/jira/browse/STORM-1175
> Project: Apache Storm
> Issue Type: Sub-task
> Reporter: Arun Mahadevan
> Assignee: Arun Mahadevan
>
> Windowing operations should be able to save the results of partial
> computations in a state store. This should persist across restarts and bolts
> should be able to look up the values from the store.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
