Re: Akka with Spark

Do you mind sharing your use case ? It may be possible to use a different approach than Akka. Cheers On Sat, Dec 26, 2015 at 10:08 AM, Disha Shrivastava wrote: > Hi, > > I wanted to know how to use Akka framework with Spark starting from > basics. I saw online that Spark

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 On 12/23/15 12:39 PM, Yin Huai wrote: +1 On Tue, Dec 22, 2015 at 8:10 PM, Denny Lee > wrote: +1 On Tue, Dec 22, 2015 at 7:05 PM Aaron Davidson > wrote: +1 On

Akka with Spark

Hi, I wanted to know how to use Akka framework with Spark starting from basics. I saw online that Spark uses Akka framework but I am not really sure if I can define Actors and use it in Spark. Also, how to integrate Akka with Spark as in how will I know how many Akka actors are running on each

Re: Akka with Spark

Note that Akka is being removed from Spark. Even if it weren't, I would consider keeping Akka processes separate from Spark processes, so you can monitor, debug, and scale them independently. So consider streaming data from Akka to Spark Streaming or go the other way, from Spark to Akka Streams.

Re: Akka with Spark

We are just removing Spark's dependency on Akka. It has nothing to do with whether user applications can use Akka or not. As a matter of fact, by removing the Akka dependency from Spark, it becomes easier for user applications to use Akka, because there is no more dependency conflict. For more

Re: Akka with Spark

Any rationale for removing Akka from Spark ? Also, what is the replacement ? Thanks > On Dec 27, 2015, at 8:31 AM, Dean Wampler wrote: > > Note that Akka is being removed from Spark. Even if it weren't, I would > consider keeping Akka processes separate from Spark