disable console output

2016-07-05 Thread Andres R. Masegosa
Hi, I'm having problems when working with flink (local mode) and travis-ci. The console output gives raises to big logs files (>4MB). How can I disable from my Java code (through the Configuration object) the progress messages displayed in console? Thanks, Andres

How to create a stream of data batches

2015-09-04 Thread Andres R. Masegosa
Hi, I'm trying to code some machine learning algorithms on top of flink such as a variational Bayes learning algorithms. Instead of working at a data element level (i.e. using map transformations), it would be far more efficient to work at a "batch of elements" levels (i.e. I get a batch of

Convergence Criterion in IterativeDataSet

2015-09-04 Thread Andres R. Masegosa
Hi, I trying to implement some machine learning algorithms that involve several iterations until convergence (to a fixed point). My idea is to use a IterativeDataSet with an Aggregator which produces the result (i.e. a set of parameters defining the model). >From the interface

Re: Bug broadcasting objects (serialization issue)

2015-09-03 Thread Andres R. Masegosa
onUID = -2932037991574118651L; List integerList; public TestClass(List integerList){ this.integerList=integerList; } } } Thanks for your support, Andres On 2/9/15 11:17, Andres R. Masegosa wrote: > Hi, > > I get a bug when trying to broadcast a l

Bug broadcasting objects (serialization issue)

2015-09-02 Thread Andres R. Masegosa
Hi, I get a bug when trying to broadcast a list of integers created with the primitive "Arrays.asList(...)". For example, if you try to run this "wordcount" example, you can reproduce the bug. public class WordCountExample { public static void main(String[] args) throws Exception {