Re: Sharing object/state accross transformations

2015-12-10 Thread JayKay
I solved the problem by passing the HLL object to the function, updating it and returning it as new state. This was obviously a thinking barrier... ;-) -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Sharing-object-state-accross-transformations

Re: Sharing object/state accross transformations

2015-12-06 Thread Julian Keppel
>> purposes... >>> >>> So how can I achive to use one global defined HLL-object in a spark >>> stream >>> transformation? I also tried to implement a custom Accumulator but this >>> also >>> failed because I don't get how to use the Accumulabl

Sharing object/state accross transformations

2015-12-02 Thread JayKay
addAccumulator, addInPlace and zero? Thanks in advance for your help and your advice! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Sharing-object-state-accross-transformations-tp25544.html Sent from the Ap

Re: Sharing object/state accross transformations

2015-12-02 Thread Ted Yu
he AccumulableParam interface. I > implemented the Accumulator and overwrote the add and value methods. But > what do I have to do in the AccumulableParam with addAccumulator, > addInPlace > and zero? > > Thanks in advance for your help and your advice! > > >