Github user StephanEwen commented on the pull request:
https://github.com/apache/flink/pull/1527#issuecomment-177599020
Concerning the data management: @aljoscha and me are currently heavily
reworking that.
All window operations need to go onto the "state" interfaces. Before we
merge this one, we should also do that, so please do not spend much time on
optimizing how the buffers for the two inputs are implemented.
The interfaces for that will go into the code in a few days (they are in
this pull request: https://github.com/apache/flink/pull/1562)
For now, I would focus on the API and we look into the buffers in a few
days.
BTW: how exactly the buffered data is held (managed memory, external
databases, etc) depends on the "state backend" of the job. Memory behavior can
be changed that way and the operators need not worry about that.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---