[ 
https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14602693#comment-14602693
 ] 

Tao Li commented on SPARK-8332:
-------------------------------

Hi Olivier Girardot, you can see all the jars in your classpath at the web UI 
"Environment" tab. For this case, you can check if you have old version jackson 
related jars (under version 2.2).

If you want to custom your own classpath, you can edit conf/spark-env.sh file 
and change SPARK_CLASSPATH variable. 

For me, I have add 'hadoop classpath' in my SPARK_CLASSPATH. But hadoop 
classpath contains 2.2 version jackson jars. So I have to exclude the jars in 
the SPARK_CLASSPATH. It help me to overcome this NoSuchMethodError.

So I suggest you to check your SPARK_CLASSPATH carefully.

> NoSuchMethodError: 
> com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer
> ----------------------------------------------------------------------------------
>
>                 Key: SPARK-8332
>                 URL: https://issues.apache.org/jira/browse/SPARK-8332
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 1.4.0
>         Environment: spark 1.4 & hadoop 2.3.0-cdh5.0.0
>            Reporter: Tao Li
>            Priority: Critical
>              Labels: 1.4.0, NoSuchMethodError, com.fasterxml.jackson
>
> I complied new spark 1.4.0 version. 
> But when I run a simple WordCount demo, it throws NoSuchMethodError 
> {code}
> java.lang.NoSuchMethodError: 
> com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer
> {code}
> I found out that the default "fasterxml.jackson.version" is 2.4.4. 
> Is there any wrong or conflict with the jackson version? 
> Or is there possibly some project maven dependency containing the wrong 
> version of jackson?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to