Re: Can't build Spark 1.3

[Ritesh Kumar Singh]

It did hang for me too. High RAM consumption during build. Had to free a
lot of RAM and introduce swap memory just to get it build in my 3rd attempt.
Everything else looks fine. You can download the prebuilt versions from the
Spark homepage to save yourself from all this trouble.

Thanks,
Ritesh

Can't build Spark 1.3

[Yakubovich, Alexey]

\
I downloaded the latest Spark (1.3.) from github. Then I tried to build it.
First for scala 2.10 (and hadoop 2.4):

build/mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -DskipTests clean package

That resulted in hangup after printing bunch of line like

[INFO] Dependency-reduced POM written at ……
INFO] Dependency-reduced -
Then I tried for scala 2.11

mvn -Pyarn -Phadoop-2.4 -Dscala-2.11 -DskipTests clean package

That resulted in multiple compilation errors.

What I actually want is:
mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -Phive -Phive-0.12.0 
-Phive-thriftserver -DskipTests clean package

Is it only me, who can’t build Spark 1.3?
And, is there any site  to download Spark prebuilt for Hadoop 2.5 and Hive?

Thank you for any help.
Alexey

This message, including any attachments, is the property of Sears Holdings 
Corporation and/or one of its subsidiaries. It is confidential and may contain 
proprietary or legally privileged information. If you are not the intended 
recipient, please delete it without reading the contents. Thank you.

Re: Can't build Spark 1.3

[Ted Yu]

Have you run zinc during build ?

See build/mvn which installs zinc.

Cheers

On Tue, Jun 2, 2015 at 12:26 PM, Ritesh Kumar Singh 
riteshoneinamill...@gmail.com wrote:

 It did hang for me too. High RAM consumption during build. Had to free a
 lot of RAM and introduce swap memory just to get it build in my 3rd attempt.
 Everything else looks fine. You can download the prebuilt versions from
 the Spark homepage to save yourself from all this trouble.

 Thanks,
 Ritesh