[
https://issues.apache.org/jira/browse/SPARK-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220277#comment-14220277
]
hoelog commented on SPARK-4354:
-------------------------------
you can download spark's source code and edit the snappy-java version in the
pom.xml then compile it.
it works!
{panel}
<dependency>
<groupId>org.xerial.snappy</groupId>
<artifactId>snappy-java</artifactId>
<version>1.0.5.4</version>
</dependency>
{panel}
{panel:title=snappy-java's recent release note}
snappy-java-1.0.5.4 (12 September 2014)
Embedded libstdc++ for Linux/amd64 native library (hotfix to 1.0.5.x series)
{panel}
https://github.com/xerial/snappy-java/blob/develop/Milestone.md
> 14/11/12 09:39:00 WARN TaskSetManager: Lost task 5.0 in stage 0.0 (TID 5,
> HYD-RNDNW-VFRCO-RCORE2): java.lang.NoClassDefFoundError: Could not initialize
> class org.xerial.snappy.Snappy
> --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-4354
> URL: https://issues.apache.org/jira/browse/SPARK-4354
> Project: Spark
> Issue Type: Question
> Components: Examples
> Affects Versions: 1.1.0
> Environment: Linux
> Reporter: Shyam
> Labels: newbie
> Attachments: client-exception.txt
>
>
> Prebuilt Spark for Hadoop 2.4 installed in 4 redhat linux machines
> Standalone cluster mode.
> Machine 1(Master)
> Machine 2(Worker node 1)
> Machine 3(Worker node 2)
> Machine 4(Client for executing spark examples)
> I ran below mentioned command in Machine 4 then got exception mentioned in
> the summary of this issue.
> sh spark-submit --class org.apache.spark.examples.SparkPi --jars
> /FS/lib/spark-assembly-1.1.0-hadoop2.4.0.jar --master spark://MasterIP:7077
> --deploy-mode client /FS/lib/spark-examples-1.1.0-hadoop2.4.0.jar 10
> java.lang.NoClassDefFoundError: Could not initialize class
> org.xerial.snappy.Snappy
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
