Github user uce commented on the pull request:
https://github.com/apache/flink/pull/471#issuecomment-79017193
I've rebased this on the latest master and set the default I/O mode to
synchronous, i.e. we currently use the simpler synchronous spilled subpartition
view when consuming intermediate results.
As Stephan pointed out, it makes sense to have the simple version in place
as long as it is not clear what the benefits of the tricky asynchronous version
is.
The memory configuration has not been changed in this PR, because I don't
think that it makes too much sense to give more memory to the network stack to
(maybe) keep blocking results in-memory as long as we don't have any
functionality in place to leverage these cached partitions.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---