Hi All,
Are certain considerations when using these functions on windowed streams?
>From reading the code, it looks using reduce (or another aggregation
function) on a windowed stream will pre-aggregate the result value as
elements are added to the window, keeping the size of window constant. On
Thanks Stephan, that helps quite a bit. Looks like another one of those API
changes that I'll be struggling with for a little bit.
On Thu, Nov 19, 2015 at 10:40 AM, Stephan Ewen wrote:
> Hi Ron!
>
> You are right, there is a copy/paste error in the docs, it should be a
>
Hi Ron!
Yes, we had to change a few things in the API between 0.9 and 0.10. The API
in 0.9 had quite a few problems. This one now looks good, we are confident
that it will stay.
Greetings,
Stephan
On Thu, Nov 19, 2015 at 8:15 PM, Ron Crocker wrote:
> Thanks Stephan,
Hi Ron!
You are right, there is a copy/paste error in the docs, it should be a
FoldFunction that is passed to fold(), not a ReduceFunction.
In Flink-0.10, the FoldFunction is only available on
- KeyedStream (
Hi Fabian -
Thanks Fabian, that is a helpful description.
That document WAS my source of information and it seems to also be the
source of my confusion. Further, it appears to be wrong - there is a
FoldFunction (
Is there a succinct description of the distinction between these transforms?
Ron
—
Ron Crocker
Principal Engineer & Architect
( ( •)) New Relic
rcroc...@newrelic.com
M: +1 630 363 8835
Hi Ron,
Have you checked:
https://ci.apache.org/projects/flink/flink-docs-release-0.10/apis/streaming_guide.html#transformations
?
Fold is like reduce, except that you define a start element (of a different
type than the input type) and the result type is the type of the initial
value. In
Granted, both are presented with the same example in the docs. They are
modeled after reduce and fold in functional programming. Perhaps we should
have a bit more enlightening examples.
On Wed, Nov 18, 2015 at 6:39 PM, Fabian Hueske wrote:
> Hi Ron,
>
> Have you checked:
>