Re: Serialization in Operator Chaining

2017-11-09 Thread Aljoscha Krettek
Hi, If you use the DataSet API, there will be no serialisation between operations in a chain. If you use the DataStream API, there will be serialisation by default but you can disable that using executionEnv.getConfig().enableObjectReuse(). Hope that helps, Aljoscha > On 9. Nov 2017, at 13:57

Serialization in Operator Chaining

2017-11-09 Thread Hicken, Jan
Hi folks, I have a question regarding the serialization in Flink's operator chaining: Consider these two map functions: Map1 and Map2 As I haven't disabled operator chaining in the environment, these two functions will be chained into one operator when executing my job. The thing is, that the s