Re: When will multiple aggregations be supported in Structured Streaming?

2016-12-15 Thread Mattz
I had the same question too. My use case is to take a streaming source and perform few steps (some aggregations and transformations) and send it to multiple output sources. On Fri, Dec 16, 2016 at 3:58 AM, Michael Armbrust wrote: > What is your use case? > > On Thu, Dec

"remember" vs "window" in Spark Streaming

2016-12-15 Thread Mattz
Hello, Can someone please help me understand the different scenarios when I could use "remember" vs "window" in Spark streaming? Thanks!

Re: sbt "org.apache.spark#spark-streaming-kafka_2.11;2.0.0: not found"

2016-12-12 Thread Mattz
I use this in my SBT and it works on 2.0.1: "org.apache.spark" %% "spark-streaming-kafka-0-8" % "2.0.1" On Tue, Dec 13, 2016 at 1:00 PM, Luke Adolph wrote: > Hi all, > My project uses spark-streaming-kafka module.When I migrate spark from > 1.6.0 to 2.0.0 and rebuild