Gyula Fora created FLINK-1345:
---------------------------------

             Summary: Add operator chaining to the streaming runtime 
                 Key: FLINK-1345
                 URL: https://issues.apache.org/jira/browse/FLINK-1345
             Project: Flink
          Issue Type: Improvement
          Components: Streaming
            Reporter: Gyula Fora
            Priority: Minor


Operator chaining should be added as a runtime optimisation to the streaming 
system as well.

A straightforward way to implement this is to add a new 
ChainableStreamInvokable class which also implements the collector interface. 
Operators like map, filter ... should extend this class.

After this the jobgraphbuilder should analyze the invokables to determine if 
chaining should be used: check if the invokable is a ChainableInvokable and all 
connections are forward with the same parallelism.

The chained invokables should then be passed as collectors to the previous ones 
as in the batch runtime.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to