GitHub user gyfora opened a pull request:
https://github.com/apache/flink/pull/465
Windowing features / fixes
This PR introduces several key optimization features and some fixes for
different windowing JIRA-s
- Parallel count window discretization in case of parallel inputs
- PreReducers for sliding count and time based policies
- Detection of tumbling policies (for example count of 5 every 5 etc.)
- New tests and refactoring of the windowed datastream with an added
utility class for windowing checks
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mbalassi/flink FLINK-1620
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/465.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #465
----
commit 98746485c3f8a4dda6efb551cfdb85edb08b6e0e
Author: Gyula Fora <[email protected]>
Date: 2015-03-04T17:22:13Z
[FLINK-1619] [FLINK-1620] Basic sliding prereducers added for Time and Count
commit efc05ee986443b5c713b4579eab1ae828095eb81
Author: Gyula Fora <[email protected]>
Date: 2015-03-07T19:07:46Z
[FLINK-1657] [streaming] Count window parallel discretization
commit 70a4fee3bee619d1809e2a6b5008f47ea6bab7e0
Author: Gyula Fora <[email protected]>
Date: 2015-03-08T13:29:30Z
[FLINK-1643] [streaming] Auto detection of tumbling policies added +
WindowedDataStream refactor
commit 89364e1f2130ad027c6ccfebe3144106d7fe6424
Author: Gyula Fora <[email protected]>
Date: 2015-03-09T12:43:32Z
[FLINK-1619] [FLINK-1620] Grouped sliding prereducers added for Time and
Count
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
