te:
>
>>
>>
>> On Wed, Dec 7, 2016 at 7:42 PM, Anty Rao <ant@gmail.com> wrote:
>>
>>> Hi
>>> I'm new to Spark. I'm doing some research to see if spark streaming can
>>> solve my problem. I don't want to keep per-key state,b/c my data
e research to see if spark streaming can
>> solve my problem. I don't want to keep per-key state,b/c my data set is
>> very huge and keep a little longer time, it not viable to keep all per key
>> state in memory.Instead, i want to have a bloom filter based state.
On Wed, Dec 7, 2016 at 7:42 PM, Anty Rao <ant@gmail.com> wrote:
> Hi
> I'm new to Spark. I'm doing some research to see if spark streaming can
> solve my problem. I don't want to keep per-key state,b/c my data set is
> very huge and keep a little longer time, it not viable t
e HDFS or HBASE.
>
> Daniel
>
> On Wed, Dec 7, 2016 at 1:42 PM, Anty Rao <ant@gmail.com> wrote:
>
>> Hi
>> I'm new to Spark. I'm doing some research to see if spark streaming can
>> solve my problem. I don't want to keep per-key state,b/c my data set is
>
see if spark streaming can
> solve my problem. I don't want to keep per-key state,b/c my data set is
> very huge and keep a little longer time, it not viable to keep all per key
> state in memory.Instead, i want to have a bloom filter based state. Does it
> possible to achieve this in Spark
Hi
I'm new to Spark. I'm doing some research to see if spark streaming can
solve my problem. I don't want to keep per-key state,b/c my data set is
very huge and keep a little longer time, it not viable to keep all per key
state in memory.Instead, i want to have a bloom filter based state. Does
Hi ALL
I'm new to Spark. I'm doing some research to see if spark streaming can
solve my problem. I don't want to keep per-key state,b/c my data set is
very huge, it not viable to keep all per key state in memory.Instead, i
want to have a bloom filter based state. Does it possible to achieve
.1001560.n3.nabble.com/Accessing-the-per-key-state-maintained-by-updateStateByKey-for-transformation-of-JavaPairDStream-tp7680.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.