[
https://issues.apache.org/jira/browse/STORM-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991162#comment-14991162
]
ASF GitHub Bot commented on STORM-1167:
---------------------------------------
Github user arunmahadevan commented on the pull request:
https://github.com/apache/storm/pull/855#issuecomment-153961998
@harshach Right now the behavior is such that in case of failures the
events will get replayed and the results will be recomputed and there will be
potentially many duplicates. I assume you mean providing apis to save the
partial results of computation in some persistent storage and support for
retrieving the state. Along with this we also need to checkpoint the evaluated
state of the window in the background and use this info to avoid re-evaluating
window when events get replayed. This will help in reducing the duplicates.
Since its more involved work, I will raise separate jiras to track this and
will add it incrementally.
> Add sliding & tumbling window support for core storm
> ----------------------------------------------------
>
> Key: STORM-1167
> URL: https://issues.apache.org/jira/browse/STORM-1167
> Project: Apache Storm
> Issue Type: Improvement
> Reporter: Arun Mahadevan
> Assignee: Arun Mahadevan
>
> Currently, topologies that needs windowing support requires writing custom
> logic inside bolts making it tedious to handle the windowing and acking logic
> with custom logic.
> We can add framework level support to core storm bolts to process tuples in a
> time or a count based window. Sliding and tumbling windows can be supported.
> Later this can be extended to trident apis as well.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)