Re: is there a way to interact with Spark clusters remotely?

2014-12-15 Thread François Le Lay
Have you seen the recent announcement around Spark Kernel using IPython/0MQ protocol ? https://github.com/ibm-et/spark-kernel On Mon, Dec 15, 2014 at 12:06 PM, Akhil Das wrote: > > Hi Xiaoyong, > > You could refer this post if you are looking on how to run spark jobs > remotely > http://apache-

Re: Packaging a spark job using maven

2014-05-14 Thread François Le Lay
I have a similar objective to use maven as our build tool and ran into the same issue. The idea is that your config file is actually not found, your fat jar assembly does not contain the reference.conf resource. I added the following the section of my pom to make it work : src/main/resources

Re: Spark GCE Script

2014-05-05 Thread François Le lay
Has anyone considered using jclouds tooling to support multiple cloud providers? Maybe using Pallet? François > On May 5, 2014, at 3:22 PM, Nicholas Chammas > wrote: > > I second this motion. :) > > A unified "cloud deployment" tool would be absolutely great. > > > On Mon, May 5, 2014 at 1

[ann] Spark-NYC Meetup

2014-04-21 Thread François Le Lay
Hi everyone, This is a quick email to announce the creation of a Spark-NYC Meetup. We have 2 upcoming events, one at PlaceIQ, another at Spotify where Reynold Xin (Databricks) and Christopher Johnson (Spotify) have talks scheduled. More info : http://www.meetup.com/Spark-NYC/ -- François Le

Re: Calling Spark enthusiasts in NYC

2014-03-31 Thread François Le Lay
Hi Andy, NYC speaking! Pretty sure we can come up with something here. Let's discuss offline! François On Mon, Mar 31, 2014 at 1:52 PM, Chris Gore wrote: > We'd love to see a Spark user group in Los Angeles and connect with others > working with it here. > > Ping me if you're in the LA area