This method is part of JsonFactory class which is part of jackson-core jar
See if you have some other jars on the classpath (different versions) that
precede jackson-core-2.5.1.jar
From: Bill Sparks <[email protected]>
To: "[email protected]" <[email protected]>
Sent: Wednesday, August 19, 2015 7:08 AM
Subject: myriad scheduler startup with HDP2.7
I'm sure this is been resolved, but I've been triaging why I'm getting the
following error on resourcemanager startup. Everything on the configuration
side looks correct, but I must have missed something.
2015-08-19 08:53:04,718 FATAL
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting
ResourceManager
java.lang.NoSuchMethodError:
com.fasterxml.jackson.dataformat.yaml.YAMLFactory._decorate(Ljava/io/InputStream;Lcom/fasterxml/jackson/core/io/IOContext;)Ljava/io/InputStream;
at
com.fasterxml.jackson.dataformat.yaml.YAMLFactory.createParser(YAMLFactory.java:299)
at
com.fasterxml.jackson.dataformat.yaml.YAMLFactory.createParser(YAMLFactory.java:14)
at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2011)
at com.ebay.myriad.Main.initialize(Main.java:70)
at
com.ebay.myriad.scheduler.yarn.interceptor.MyriadInitializationInterceptor.init(MyriadInitializationInterceptor.java:32)
at
com.ebay.myriad.scheduler.yarn.interceptor.CompositeInterceptor.init(CompositeInterceptor.java:76)
at
com.ebay.myriad.scheduler.yarn.MyriadFairScheduler.serviceInit(MyriadFairScheduler.java:50)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:572)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:972)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:259)
at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
at
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1202)
I have placed all the myriad jar in the hadoop-yarn/lib directory and the
classpath reflect that.
cp /tmp/myriad/myriad-scheduler/build/libs/*
/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib
cp /tmp/myriad/myriad-executor/build/libs/myriad-executor-runnable-0.0.1.jar
/usr/libexec/mesos/
[root@nid00037 myriad]# su - yarn
-bash-4.1$ yarn classpath
/usr/hdp/2.3.0.0-2557/hadoop/conf:/usr/hdp/2.3.0.0-2557/hadoop/conf:/usr/hdp/2.3.0.0-2557/hadoop/conf:/usr/hdp/2.3.0.0-2557/hadoop/lib/*:/usr/hdp/2.3.0.0-2557/hadoop/.//*:/usr/hdp/2.3.0.0-2557/hadoop-hdfs/./:/usr/hdp/2.3.0.0-2557/hadoop-hdfs/lib/*:/usr/hdp/2.3.0.0-2557/hadoop-hdfs/.//*:/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib/*:/usr/hdp/2.3.0.0-2557/hadoop-yarn/.//*:/usr/hdp/2.3.0.0-2557/hadoop-mapreduce/lib/*:/usr/hdp/2.3.0.0-2557/hadoop-mapreduce/.//*::/usr/share/java/mysql-connector-java-5.1.17.jar:/usr/share/java/mysql-connector-java.jar:/usr/hdp/current/hadoop-mapreduce-client/*:/usr/hdp/2.3.0.0-2557/tez/*:/usr/hdp/2.3.0.0-2557/tez/lib/*:/usr/hdp/2.3.0.0-2557/tez/conf:/usr/hdp/current/hadoop-yarn-client/.//*:/usr/hdp/current/hadoop-yarn-client/lib/*
ls /usr/hdp/current/hadoop-yarn-client/lib/* has all the libraries
-bash-4.1$ ls -l /usr/hdp/2.3.0.0-2557/hadoop-yarn/lib//myriad*
-rw-r--r-- 1 root root 3456 Aug 19 08:50
/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib//myriad-commons-0.0.1.jar
-rw-r--r-- 1 root root 950687 Aug 19 08:50
/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib//myriad-scheduler-0.0.1.jar
and
-bash-4.1$ ls -l /usr/hdp/2.3.0.0-2557/hadoop-yarn/lib/jackson*
-rw-r--r-- 1 root root 39817 Aug 17 18:32
/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib/jackson-annotations-2.5.1.jar
-rw-r--r-- 1 root root 192699 Jul 14 08:22
/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib/jackson-core-2.2.3.jar
-rw-r--r-- 1 root root 229860 Aug 17 18:32
/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib/jackson-core-2.5.1.jar
-rw-r--r-- 1 root root 232248 Jul 14 08:22
/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib/jackson-core-asl-1.9.13.jar
-rw-r--r-- 1 root root 1138921 Aug 17 18:32
/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib/jackson-databind-2.5.1.jar
-rw-r--r-- 1 root root 321751 Aug 17 18:32
/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib/jackson-dataformat-yaml-2.5.1.jar
-rw-r--r-- 1 root root 18336 Jul 14 08:22
/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib/jackson-jaxrs-1.9.13.jar
-rw-r--r-- 1 root root 780664 Jul 14 08:22
/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib/jackson-mapper-asl-1.9.13.jar
-rw-r--r-- 1 root root 27084 Jul 14 08:22
/usr/hdp/2.3.0.0-2557/hadoop-yarn/lib/jackson-xc-1.9.13.jar
-bash-4.1$ jar tf
/usr/hdp/current/hadoop-yarn-client/lib/jackson-dataformat-yaml-2.5.1.jar |
grep YAMLFactory
com/fasterxml/jackson/dataformat/yaml/YAMLFactory.class
