Have a look at mapWithState if you are using 1.6+
On Sat, 9 Apr 2016, 08:04 Daniela S, wrote:
> Hi,
>
> I would like to cache values and to use only the latest "valid" values to
> build a sum.
> In more detail, I receive values from devices periodically. I would like
> to add up all the valid va
I don't see this happening without a store. You can try parquet on top of
hdfs. This will at least avoid third party systems burden.
On 09 Apr 2016 9:04 AM, "Daniela S" wrote:
> Hi,
>
> I would like to cache values and to use only the latest "valid" values to
> build a sum.
> In more detail, I r