Re: Application log on Yarn FlinkCluster

2016-06-11 Thread Theofilos Kakantousis
Hi Robert, Thanks for the prompt reply. I'm using the IterateExample from Flink examples. In the yarn log I get entries for the YarnJobManager and ExecutionGraph, but I was wondering if there is a way to push all the logging that the client produces into the yarn log. Including the

Re: Strange behavior of DataStream.countWindow

2016-06-11 Thread Yukun Guo
Thx, now I use element.hashCode() % nPartitions and it works as expected. But I'm afraid it's not a best practice for just turning a plain (already paralellized) DataStream into a KeyedStream? Because it introduces some overhead due to physical repartitioning by key, which is unnecessary since I