The implementation of the CoGroupFunction is not serializable

2017-04-30 Thread Kaepke, Marc
Hi guys, I have no errors if I run a Graph.groupReduceOnEdges() in main(String[ ] args). But the same function in its own class throws an exception. DataSet>> vertexDataSet = graph.groupReduceOnEdges(new

Re: Periodic flush sink?

2017-04-30 Thread Kamil Dziublinski
Hi Niels, This sounds to me like a great use case for using window functions. You could partition your data (use keyby) based on website and then hold your window for certain amount of time. After that you could give your sink already batched object and store it directly. On top of that if you