Have a look at mapWithState if you are using 1.6+
On Sat, 9 Apr 2016, 08:04 Daniela S, wrote:
> Hi,
>
> I would like to cache values and to use only the latest "valid" values to
> build a sum.
> In more detail, I receive values from devices periodically. I would like
> to add up all the valid va
I don't see this happening without a store. You can try parquet on top of
hdfs. This will at least avoid third party systems burden.
On 09 Apr 2016 9:04 AM, "Daniela S" wrote:
> Hi,
>
> I would like to cache values and to use only the latest "valid" values to
> build a sum.
> In more detail, I r
Hi,
I would like to cache values and to use only the latest "valid" values to build
a sum.
In more detail, I receive values from devices periodically. I would like to add
up all the valid values each minute. But not every device sends a new value
every minute. And as long as there is no new val
