RE: Multiple keys in reduceGroup ?

2015-10-22 Thread LINZ, Arnaud
Rohrmann [mailto:trohrm...@apache.org] Envoyé : jeudi 22 octobre 2015 13:45 À : user@flink.apache.org Objet : Re: Multiple keys in reduceGroup ? You don’t modify the objects, however, the ReusingKeyGroupedIterator, which is the iterator you have in your reduce function, does. Internally it uses

Re: Multiple keys in reduceGroup ?

2015-10-22 Thread Till Rohrmann
modify my objects, why object reuse isn’t working ? > > > > Best regards, > > Arnaud > > > > > > *De :* Till Rohrmann [mailto:trohrm...@apache.org] > *Envoyé :* jeudi 22 octobre 2015 12:36 > *À :* user@flink.apache.org > *Objet :* Re: Multiple keys

Re: Multiple keys in reduceGroup ?

2015-10-22 Thread Stephan Ewen
roup > algorithm once it get the right data. > > > > Since I never modify my objects, why object reuse isn’t working ? > > > > Best regards, > > Arnaud > > > > > > *De :* Till Rohrmann [mailto:trohrm...@apache.org] > *Envoyé :* jeudi 22 octobre

RE: Multiple keys in reduceGroup ?

2015-10-22 Thread LINZ, Arnaud
once it get the right data. Since I never modify my objects, why object reuse isn’t working ? Best regards, Arnaud De : Till Rohrmann [mailto:trohrm...@apache.org] Envoyé : jeudi 22 octobre 2015 12:36 À : user@flink.apache.org Objet : Re: Multiple keys in reduceGroup ? If not, could you provide us

Re: Multiple keys in reduceGroup ?

2015-10-22 Thread Till Rohrmann
If not, could you provide us with the program and test data to reproduce the error? Cheers, Till On Thu, Oct 22, 2015 at 12:34 PM, Aljoscha Krettek wrote: > Hi, > but he’s comparing it to a primitive long, so shouldn’t the Long key be > unboxed and the comparison still be valid? > > My question

Re: Multiple keys in reduceGroup ?

2015-10-22 Thread Aljoscha Krettek
Hi, but he’s comparing it to a primitive long, so shouldn’t the Long key be unboxed and the comparison still be valid? My question is whether you enabled object-reuse-mode on the ExecutionEnvironment? Cheers, Aljoscha > On 22 Oct 2015, at 12:31, Stephan Ewen wrote: > > Hi! > > You are checki

Re: Multiple keys in reduceGroup ?

2015-10-22 Thread Stephan Ewen
Hi! You are checking for equality / inequality with "!=" - can you check with "equals()" ? The key objects will most certainly be different in each record (as they are deserialized individually), but they should be equal. Stephan On Thu, Oct 22, 2015 at 12:20 PM, LINZ, Arnaud wrote: > Hello,

Multiple keys in reduceGroup ?

2015-10-22 Thread LINZ, Arnaud
Hello, Trying to understand why my code was giving strange results, I’ve ended up adding “useless” controls in my code and came with what seems to me a bug. I group my dataset according to a key, but in the reduceGroup function I am passed values with different keys. My code has the following