[
https://issues.apache.org/jira/browse/FLINK-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14365819#comment-14365819
]
ASF GitHub Bot commented on FLINK-1706:
---------------------------------------
GitHub user gyfora opened a pull request:
https://github.com/apache/flink/pull/493
[FLINK-1706] Spilling BarrierBuffer added + basic tests
This commit introduces disk spilling for the BarrierBuffers based on the
availability of the buffers in the buffer pools of the input gates.
This is a first version, with proper resource cleanup still missing.
I am putting it up here for review as this is a critical part of the ft
logic.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mbalassi/flink FLINK-1706
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/493.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #493
----
commit 7b0cc330a9717110f53fe24535a59b830f420eb3
Author: Gyula Fora <[email protected]>
Date: 2015-03-17T16:39:27Z
[FLINK-1706] Spilling BarrierBuffer added + basic tests
----
> Add disk spilling to BarrierBuffer
> ----------------------------------
>
> Key: FLINK-1706
> URL: https://issues.apache.org/jira/browse/FLINK-1706
> Project: Flink
> Issue Type: Improvement
> Components: Distributed Runtime, Streaming
> Reporter: Gyula Fora
> Assignee: Gyula Fora
> Fix For: 0.9
>
>
> The barrier buffers, used for streaming fault tolerance to sync on superstep
> barriers, currently dont spill to disk which can cause out of memory
> exceptions when some input task is delayed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
