GitHub user tillrohrmann opened a pull request:
https://github.com/apache/flink/pull/1101
[FLINK-2631] [streaming] Fixes the StreamFold operator and adds output type
configurable stream operators
Adds support for non-serializable initial fold values by storing the value
in a byte array before shipping it. The shipped initial fold value is
deserialized on the TM while calling the `open` method.
Furthermore, this PR introduces the `OutputTypeConfigurable` interface
which allows stream operators to get to know their output type. The
`OutputTypeConfigurable` interface offers the method `setOutputType` which is
called by the `StreamGraph` when the `StreamOperator` is added in the
`addOperator` method. At the latest at this moment, the concrete output type,
whether inferred from the UDF or set manually with `returns`, should be know to
the system, because also the input and output type serializers for the vertex
are created in the `addOperator` method. All stream operators which need to
know their output type should implement the `OutputTypeConfigurable` interface.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tillrohrmann/flink fixStreamingFold
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/1101.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1101
----
commit 63951adca0e8bfefd1d81b933017e9fadc5f556f
Author: Till Rohrmann <[email protected]>
Date: 2015-09-07T09:34:48Z
[FLINK-2631] [streaming] Fixes the StreamFold operator. Adds
OutputTypeConfigurable interface to support type injection at StreamGraph
creation.
Adds test for non serializable fold type. Adds test to verify proper output
type forwarding for OutputTypeConfigurable implementations.
Adds comments
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
