THANKS, as I have not kept up on the spark lists.... James
On 08/25/2015 04:28 AM, Iulian Dragoș wrote:
On Mon, Aug 24, 2015 at 7:16 PM, CCAAT <[email protected] <mailto:[email protected]>> wrote: On 08/24/2015 05:33 AM, Iulian Dragoș wrote: Hello Iulian, Ok, so I eventually build spark from 100% sources, after some intermediate builds on gentoo. Gentoo is not the best platform for Java development, but those issues related to spark builds are slowly being fixed on gentoo. Where (how) do you download the spark-1.5.x complete source tree, as it does not seen available on this page:: http://spark.apache.org/downloads.html It's not yet a final release, but there's a preview: http://apache-spark-developers-list.1001551.n3.nabble.com/Fwd-ANNOUNCE-Spark-1-5-0-preview-package-td13683.html Building Spark from sources isn't too hard, there's a `make-distribution.sh` script in the root directory. There are a few parameters (like the dependency Hadoop version), but it should be fairly straight forward. More info here: http://spark.apache.org/docs/latest/building-spark.html iulian Any other related information or tips on building out spark from sources are keenly received. James Unfortunately I don't have access to the cluster anymore, but I think Chronos wasn't the culprit. After updating Spark to 1.5 and setting a framework role offers started to come (while still using Chronos). iulian Iulian Dragos ------ Reactive Apps on the JVM www.typesafe.com <http://www.typesafe.com> <http://www.typesafe.com> -- -- Iulian Dragos ------ Reactive Apps on the JVM www.typesafe.com <http://www.typesafe.com>
