Re: Spark on Raspberry Pi?

We've found that Raspberry Pi is not enough for Hadoop/Spark mainly because the memory consumption. What we've built is a cluster form with 22 Cubieboards, each contains 1 GB RAM. Best regards, -chanwit -- Chanwit Kaewkasi linkedin.com/in/chanwit On Thu, Sep 11, 2014 at 8:04 PM, San

Re: Akka disassociation on Java SE Embedded

our ARM cluster to 2.8 times faster than our first report. Best regards, -chanwit -- Chanwit Kaewkasi linkedin.com/in/chanwit On Wed, May 28, 2014 at 1:13 AM, Chanwit Kaewkasi wrote: > May be that's explaining mine too. > Thank you very much, Aaron !! > > Best regards, &g

Re: Announcing Spark 1.0.0

Congratulations !! -chanwit -- Chanwit Kaewkasi linkedin.com/in/chanwit On Fri, May 30, 2014 at 5:12 PM, Patrick Wendell wrote: > I'm thrilled to announce the availability of Spark 1.0.0! Spark 1.0.0 > is a milestone release as the first in the 1.0 line of releases, > providing

Re: Akka disassociation on Java SE Embedded

May be that's explaining mine too. Thank you very much, Aaron !! Best regards, -chanwit -- Chanwit Kaewkasi linkedin.com/in/chanwit On Wed, May 28, 2014 at 12:47 AM, Aaron Davidson wrote: > Spark should effectively turn Akka's failure detector off, because we > historically h

Akka disassociation on Java SE Embedded

blem? (If my guess about GC is wrong). Best regards, -chanwit -- Chanwit Kaewkasi linkedin.com/in/chanwit

Spark to utilize HDFS's mmap caching

Hi all, Can Spark (0.9.x) utilize the caching feature in HDFS 2.3 via sc.textFile() and other HDFS-related APIs? http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html Best regards, -chanwit -- Chanwit Kaewkasi linkedin.com/in/chanwit

Re: Spark to utilize HDFS's mmap caching

Great to know that! Thank you, Matei. Best regards, -chanwit -- Chanwit Kaewkasi linkedin.com/in/chanwit On Tue, May 13, 2014 at 2:14 AM, Matei Zaharia wrote: > That API is something the HDFS administrator uses outside of any application > to tell HDFS to cache certain files or direc

Re: Spark enables us to process Big Data on an ARM cluster !!

Thanks, Eustache. There's the link in the second reply to an article I wrote for DZone. Best regards, -chanwit -- Chanwit Kaewkasi linkedin.com/in/chanwit On Thu, Mar 20, 2014 at 9:39 PM, Eustache DIEMERT wrote: > Hey, do you have a blog post or url I can share ? > > This i

Re: Spark enables us to process Big Data on an ARM cluster !!

Hi Chester, It is on our todo-list but it doesn't work at the moment. The Parallela cores can not be utilized by the JVM. So, Spark will just use its ARM cores. We'll be looking at Parallela again when the JVM supports it. Best regards, -chanwit -- Chanwit Kaewkasi linkedin.com/in/ch

Re: Spark enables us to process Big Data on an ARM cluster !!

-- Chanwit Kaewkasi linkedin.com/in/chanwit On Wed, Mar 19, 2014 at 9:43 PM, Koert Kuipers wrote: > i dont know anything about arm clusters but it looks great. what are the > specs? the nodes have no local disk at all? > > > On Tue, Mar 18, 2014 at 10:36 PM, Chanwit Kaewka

Spark enables us to process Big Data on an ARM cluster !!

ossible !! Best regards, -chanwit -- Chanwit Kaewkasi linkedin.com/in/chanwit