[
https://issues.apache.org/jira/browse/S4-40?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthieu Morel closed S4-40.
----------------------------
Resolution: Fixed
merged into dev branch
http://git-wip-us.apache.org/repos/asf/incubator-s4/commit/29a22ef0
> Checkpointing: offload serialization of PEs from the event processing thread
> ----------------------------------------------------------------------------
>
> Key: S4-40
> URL: https://issues.apache.org/jira/browse/S4-40
> Project: Apache S4
> Issue Type: Improvement
> Affects Versions: 0.4
> Reporter: Matthieu Morel
> Assignee: Matthieu Morel
> Fix For: 0.4
>
>
> Checkpointing preserves PE state by serializing PE data then storing the
> serialized data on stable storage.
> Currently, the storage operation is asynchronous, but the serialization of
> PEs is performed by the event processing thread. Some PEs have complex data
> structures that take time to serialize, adding latency to event processing.
> This affects the overall response time and can also lead to queues overflows
> and event loss.
> Therefore, we must perform the serialization asynchronously, and make sure to
> prevent any race condition (PE data updated by normal event processing while
> PE being serialized on another thread).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
