Hi,
On Thu, Jan 29, 2015 at 9:52 AM, Tobias Pfeiffer wrote:
> Hi,
>
> On Thu, Jan 29, 2015 at 1:54 AM, YaoPau wrote:
>>
>> My thinking is to maintain state in an RDD and update it an persist it
>> with
>> each 2-second pass, but this also seems like it could get messy. Any
>> thoughts or examp
w this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/reduceByKeyAndWindow-but-using-log-timestamps-instead-of-clock-seconds-tp21405p22795.html
Sent from the Apache Spark User List mailing list archive at Nabb
inal Message-
> From: Tathagata Das [mailto:tathagata.das1...@gmail.com]
> Sent: Thursday, January 29, 2015 10:33 AM
> To: Tobias Pfeiffer
> Cc: YaoPau; user
> Subject: Re: reduceByKeyAndWindow, but using log timestamps instead of
> clock seconds
>
> Ohhh nice! Would be great if you
2015 10:33 AM
To: Tobias Pfeiffer
Cc: YaoPau; user
Subject: Re: reduceByKeyAndWindow, but using log timestamps instead of clock
seconds
Ohhh nice! Would be great if you can share us some code soon. It is indeed a
very complicated problem and there is probably no single solution that fits all
us
Ohhh nice! Would be great if you can share us some code soon. It is
indeed a very complicated problem and there is probably no single
solution that fits all usecases. So having one way of doing things
would be a great reference. Looking forward to that!
On Wed, Jan 28, 2015 at 4:52 PM, Tobias Pfei
Hi,
On Thu, Jan 29, 2015 at 1:54 AM, YaoPau wrote:
>
> My thinking is to maintain state in an RDD and update it an persist it with
> each 2-second pass, but this also seems like it could get messy. Any
> thoughts or examples that might help me?
>
I have just implemented some timestamp-based win
t;
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/reduceByKeyAndWindow-but-using-log-timestamps-instead-of-clock-seconds-tp21405.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> --
f the
> current time.
>
> My thinking is to maintain state in an RDD and update it an persist it with
> each 2-second pass, but this also seems like it could get messy. Any
> thoughts or examples that might help me?
>
>
>
> --
> View this message in context:
> http
.com/reduceByKeyAndWindow-but-using-log-timestamps-instead-of-clock-seconds-tp21405.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For
