On Wed, Jul 30, 2014 at 11:32 PM, Jeffrey Picard <jp3...@columbia.edu> wrote: > That worked! The entire thing ran in about an hour and a half, thanks!
Great! > Is there by chance an easy way to build spark apps using the master branch > build of spark? I’ve been having to use the spark-shell. The easiest way is probably to package Spark into a single JAR (`sbt/sbt assembly`), compile your application with the Spark assembly JAR on the classpath to produce another JAR, and then run the application by passing that JAR to spark-submit [1]. Alternatively, it may be a little cleaner to publish Spark to a local Maven repository, then build your application using Maven and point it at that repository. Ankur [1] http://spark.apache.org/docs/latest/submitting-applications.html
