If one were to put together a short but comprehensive guide to setting up
Spark to run locally on OS X, would it look like this?
# Install Maven. On OS X, we suggest using Homebrew.
brew install maven
# Set some important Java and Maven environment variables.export
I usually use SBT on Mac and that one doesn't require any setup ...
On Mon, Oct 20, 2014 at 4:43 PM, Nicholas Chammas
nicholas.cham...@gmail.com wrote:
If one were to put together a short but comprehensive guide to setting up
Spark to run locally on OS X, would it look like this?
# Install
Yeah, I would use sbt too, but I thought if I wanted to publish a little
reference page for OS X users then I probably should use the “official
https://github.com/apache/spark#building-spark“ build instructions.
Nick
On Mon, Oct 20, 2014 at 8:00 PM, Reynold Xin r...@databricks.com wrote:
I
+1
huge fan of sbt with OSX
On Oct 20, 2014, at 17:00, Reynold Xin r...@databricks.com wrote:
I usually use SBT on Mac and that one doesn't require any setup ...
On Mon, Oct 20, 2014 at 4:43 PM, Nicholas Chammas
nicholas.cham...@gmail.com wrote:
If one were to put together a short
Maven is at least built in to OS X (well, with dev tools). You don't
even have to brew install it. Surely SBT isn't in the dev tools even?
I recall I had to install it. I'd be surprised to hear it required
zero setup.
On Mon, Oct 20, 2014 at 8:04 PM, Nicholas Chammas
nicholas.cham...@gmail.com
I think starting in Mavericks, Maven is no longer included by default
http://stackoverflow.com/questions/19678594/maven-not-found-in-mac-osx-mavericks
.
On Mon, Oct 20, 2014 at 8:15 PM, Sean Owen so...@cloudera.com wrote:
Maven is at least built in to OS X (well, with dev tools). You don't
The sbt executable that is in the spark repo can be used to build sbt without
any other set up (it will download the sbt jars etc).
Thanks,
Hari
On Mon, Oct 20, 2014 at 5:16 PM, Sean Owen so...@cloudera.com wrote:
Maven is at least built in to OS X (well, with dev tools). You don't
even
Oh right, we're talking about the bundled sbt of course.
And I didn't know Maven wasn't installed anymore!
On Mon, Oct 20, 2014 at 8:20 PM, Hari Shreedharan
hshreedha...@cloudera.com wrote:
The sbt executable that is in the spark repo can be used to build sbt
without any other set up (it will
So back to my original question... :)
If we wanted to post this guide to the user list or to a gist for easy
reference, would we rather have Maven or SBT listed? And is there anything
else about the steps that should be modified?
Nick
On Mon, Oct 20, 2014 at 8:25 PM, Sean Owen
I also prefer sbt on Mac.
You might want to add checking for / getting Python 2.6+ (though most modern
Macs should have it), and maybe numpy as an optional dependency. I often just
point people to Anaconda.
— Jeremy
-
jeremyfreeman.net
@thefreemanlab
On Oct 20, 2014,
10 matches
Mail list logo
