he-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-getOrCreate-tc18060.html
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Streaming-window-operations-not-producing-output-tp17504p18169.html
> Sent from the Apache Spark User
.nabble.com/Streaming-window-operations-not-producing-output-tp17504p18169.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional
Didnt oyu get any errors in the log4j logs, saying that you have to enable
checkpointing?
TD
On Tue, Nov 4, 2014 at 7:20 AM, diogo wrote:
> So, to answer my own n00b question, if case anyone ever needs it. You have
> to enable checkpointing (by ssc.checkpoint(hdfsPath)). Windowed
> operations n
So, to answer my own n00b question, if case anyone ever needs it. You have
to enable checkpointing (by ssc.checkpoint(hdfsPath)). Windowed operations
need to be *checkpointed*, otherwise windows just won't work (and how could
they).
On Tue, Oct 28, 2014 at 10:24 AM, diogo wrote:
> Hi there, I'm
Hi there, I'm trying to use Window operations on streaming, but everything
I perform a windowed computation, I stop getting results.
For example:
val wordCounts = pairs.reduceByKey(_ + _)
wordCounts.print()
Will print the output to the stdout on 'batch duration' interval. Now if I
replace it wit
