You call awaitTermination() in the main thread, and indeed it blocks there forever. From there Spark Streaming takes over, and is invoking the operations you set up. Your operations have access to the data of course. That's the model; you don't make external threads that reach in to Spark Streaming's objects, but can easily create operations that take whatever actions you want and invoke them in Streaming.
On Fri, Feb 13, 2015 at 10:04 AM, jamborta <jambo...@gmail.com> wrote: > Hi all, > > I am trying to come up with a workflow where I can query streams > asynchronously. The problem I have is a ssc.awaitTermination() line blocks > the whole thread, so it is not straightforward to me whether it is possible > to get hold of objects from streams once they are started. any suggestion on > what is the best way to implement this? > > thanks, > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Interact-with-streams-in-a-non-blocking-way-tp21640.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
