Re: Noob Spark questions

2013-12-31 Thread Ognen Duzlevski
Yes, this helps! I see it uses akka. Thanks! On Tue, Dec 31, 2013 at 12:34 AM, Aaron Davidson wrote: > Not sure if it helps, but there is a ZeroMQ Spark Streaming example: > https://github.com/apache/incubator-spark/blob/master/examples/src/main/scala/org/apache/spark/streaming/examples/ZeroMQ

Re: Noob Spark questions

2013-12-30 Thread Aaron Davidson
Not sure if it helps, but there is a ZeroMQ Spark Streaming example: https://github.com/apache/incubator-spark/blob/master/examples/src/main/scala/org/apache/spark/streaming/examples/ZeroMQWordCount.scala . On Mon, Dec 30, 2013 at 9:41 PM, Ognen Duzlevski wrote: > Can anyone provide any code exa

Re: Noob Spark questions

2013-12-30 Thread Ognen Duzlevski
Can anyone provide any code examples of connecting Spark to zeromq data producers for purposes of simple real-time analytics? Even the most basic example would be nice :) Thanks! On Mon, Dec 23, 2013 at 2:42 PM, Ognen Duzlevski wrote: > Hello, I am new to Spark and have installed it, played wit

Re: Noob Spark questions

2013-12-24 Thread Jie Deng
@Mark Hamstra: Thanks, good to know. @Ognen Duzlevski: 2013/12/24 Ognen Duzlevski > Hello, > > On Mon, Dec 23, 2013 at 3:23 PM, Jie Deng wrote: > >> I am using Java, and Spark has APIs for Java as well. Though there is a >> saying that Java in Spark is slower than Scala shell, well, depends o

Re: Noob Spark questions

2013-12-23 Thread Ognen Duzlevski
Hello, On Mon, Dec 23, 2013 at 3:23 PM, Jie Deng wrote: > I am using Java, and Spark has APIs for Java as well. Though there is a > saying that Java in Spark is slower than Scala shell, well, depends on your > requirement. > I am not an expert in Spark, but as far as I know, Spark provide differ

Re: Noob Spark questions

2013-12-23 Thread Mark Hamstra
> > Though there is a saying that Java in Spark is slower than Scala shell That shouldn't be said. The Java API is mostly a thin wrapper of the Scala implementation, and the performance of the Java API is intended to be equivalent to that of the Scala API. If you're finding that not to be true,

Re: Noob Spark questions

2013-12-23 Thread Jie Deng
I am using Java, and Spark has APIs for Java as well. Though there is a saying that Java in Spark is slower than Scala shell, well, depends on your requirement. I am not an expert in Spark, but as far as I know, Spark provide different level of storage including memory or disk. And for the disk par

Noob Spark questions

2013-12-23 Thread Ognen Duzlevski
Hello, I am new to Spark and have installed it, played with it a bit, mostly I am reading through the "Fast data processing with Spark" book. One of the first things I realized is that I have to learn Scala, the real-time data analytics part is not supported by the Python API, correct? I don't min