Thanks Fengdong.
I still have the same exception.
Exception in thread "main" java.lang.NoSuchMethodError:
com.fasterxml.jackson.databind.ObjectMapper.enable([Lcom/fasterxml/jackson/core/JsonParser$Feature;)Lcom/fasterxml/jackson/databind/ObjectMapper;
at
com.amazonaws.internal.config.InternalConfig.<clinit>(InternalConfig.java:43)
at
com.amazonaws.internal.config.InternalConfig$Factory.<clinit>(InternalConfig.java:304)
at com.amazonaws.util.VersionInfoUtils.userAgent(VersionInfoUtils.java:139)
at
com.amazonaws.util.VersionInfoUtils.initializeUserAgent(VersionInfoUtils.java:134)
at
com.amazonaws.util.VersionInfoUtils.getUserAgent(VersionInfoUtils.java:95)
at com.amazonaws.ClientConfiguration.<clinit>(ClientConfiguration.java:61)
at
com.amazonaws.services.sqs.AmazonSQSClient.<init>(AmazonSQSClient.java:168)
at sparktest.JavaSqsReceiver.<init>(JavaSqsReceiver.scala:28)
at sparktest.StreamingTest.receiveMessage(StreamingTest.scala:18)
at sparktest.StreamingTest$.main(StreamingTest.scala:35)
at sparktest.StreamingTest.main(StreamingTest.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at
org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:674)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:120)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Will rebuilding spark help?
________________________________
From: Fengdong Yu <fengdo...@everstring.com>
Sent: Monday, December 7, 2015 10:31 PM
To: Sunil Tripathy
Cc: user@spark.apache.org
Subject: Re: NoSuchMethodError:
com.fasterxml.jackson.databind.ObjectMapper.enable
Can you try like this in your sbt:
val spark_version = "1.5.2"
val excludeServletApi = ExclusionRule(organization = "javax.servlet", artifact
= "servlet-api")
val excludeEclipseJetty = ExclusionRule(organization = "org.eclipse.jetty")
libraryDependencies ++= Seq(
"org.apache.spark" %% "spark-sql" % spark_version % "provided"
excludeAll(excludeServletApi, excludeEclipseJetty),
"org.apache.spark" %% "spark-hive" % spark_version % "provided"
excludeAll(excludeServletApi, excludeEclipseJetty)
)
On Dec 8, 2015, at 2:26 PM, Sunil Tripathy
<suni...@outlook.com<mailto:suni...@outlook.com>> wrote:
I am getting the following exception when I use spark-submit to submit a spark
streaming job.
Exception in thread "main" java.lang.NoSuchMethodError:
com.fasterxml.jackson.databind.ObjectMapper.enable([Lcom/fasterxml/jackson/core/JsonParser$Feature;)Lcom/fasterxml/jackson/databind/ObjectMapper;
at
com.amazonaws.internal.config.InternalConfig.<clinit>(InternalConfig.java:43)
I tried with diferent version of of jackson libraries but that does not seem to
help.
libraryDependencies += "com.fasterxml.jackson.core" % "jackson-databind" %
"2.6.3"
libraryDependencies += "com.fasterxml.jackson.core" % "jackson-core" % "2.6.3"
libraryDependencies += "com.fasterxml.jackson.core" % "jackson-annotations" %
"2.6.3"
Any pointers to resolve the issue?
Thanks
