Thanks Roman for getting back to me so quickly. I checked with Cloudera and
they have a maven repository for CDH5 (version 2.2.0-cdh5.0.0-beta-2) as shown
below:
<repository>
<id>cloudera</id>
<url>https://repository.cloudera.com/artifactory/cloudera-repos/</url>
</repository>
I added that to the pom.xml file and ran a new build using the following
command:
mvn -Phadoop_yarn -Dhadoop.version=2.2.0-cdh5.0.0-beta-2 clean package
-DskipTests
The program now gets further, but throws the following exception:
Container: container_1392713839733_0017_01_000002 on el01cn04.unx.sas.com_8041
================================================================================
LogType: task-2-stderr.log
LogLength: 637
Log Contents:
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/giraph/yarn/GiraphYarnTask
Caused by: java.lang.ClassNotFoundException:
org.apache.giraph.yarn.GiraphYarnTask
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class: org.apache.giraph.yarn.GiraphYarnTask. Program
will exit.
Do you have any additional suggestions for what I should try?
Thanks for your help.
Stefan
-----Original Message-----
From: [email protected] [mailto:[email protected]] On Behalf Of Roman
Shaposhnik
Sent: Wednesday, February 19, 2014 4:43 PM
To: [email protected]
Subject: Re: Problem running SimpleShortestPathsComputation on CDH5 with Hadoop
2.2.0
On Wed, Feb 19, 2014 at 1:12 PM, Stefan Beskow <[email protected]> wrote:
> Hi.
>
> I checked out and built Giraph for Cloudera CDH5 with Hadoop 2.2.0
> using the
> following:
>
> git clone git://git.apache.org/giraph.git snapshot_from_git cd
> snapshot_from_git mvn -Phadoop_yarn -Dhadoop.version=2.2.0 clean
> package -DskipTests
It may help to build against CDH5 directly by:
* manually adding repository.cloudera.com to the set of repos
* specifying -Dhadoop.version=2.2.0-cdh5.0.0-beta-2
> When I run the sample application
> org.apache.giraph.examples.SimpleShortestPathsComputation I get the
> following exception:
You need to provide way more logs from the YARN side for us to make sense of it.
Thanks,
Roman.
