But you have a bunch of Hadoop 0.20 jars on your classpath! Definitely a problem. Those should not be there. On Mar 31, 2014 7:09 AM, "Phan, Truong Q" <[email protected]> wrote:
> Yes, I did rebuild it. > > oracle@bpdevdmsdbs01: ---- > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9 > ----- > $ mvn clean install -Dhadoop2.version=2.2.0-cdh5.0.0-beta-1 > -DskipTests=true > [INFO] Scanning for projects... > .... > [INFO] > ------------------------------------------------------------------------ > [INFO] Reactor Summary: > [INFO] > [INFO] Mahout Build Tools ................................ SUCCESS [ > 8.215 s] > [INFO] Apache Mahout ..................................... SUCCESS [ > 1.158 s] > [INFO] Mahout Math ....................................... SUCCESS [16:21 > min] > [INFO] Mahout Core ....................................... SUCCESS [26:21 > min] > [INFO] Mahout Integration ................................ SUCCESS [03:55 > min] > [INFO] Mahout Examples ................................... SUCCESS [02:54 > min] > [INFO] Mahout Release Package ............................ SUCCESS [ > 0.084 s] > [INFO] Mahout Math/Scala wrappers ........................ SUCCESS [01:16 > min] > [INFO] > ------------------------------------------------------------------------ > [INFO] BUILD SUCCESS > [INFO] > ------------------------------------------------------------------------ > [INFO] Total time: 50:59 min > [INFO] Finished at: 2014-03-31T14:25:27+10:00 > [INFO] Final Memory: 47M/250M > [INFO] > ------------------------------------------------------------------------ > > > Thanks and Regards, > Truong Phan > > > P + 61 2 8576 5771 > M + 61 4 1463 7424 > E [email protected] > W www.telstra.com > > > -----Original Message----- > From: Andrew Musselman [mailto:[email protected]] > Sent: Monday, 31 March 2014 2:44 PM > To: [email protected] > Subject: Re: Mahout v0.9 is not working with 2.2.0-cdh5.0.0-beta-1 > > Have you rebuilt Mahout for your version? We're not supporting Hadoop > version two yet. > > See here for some direction: > http://mail-archives.us.apache.org/mod_mbox/mahout-user/201403.mbox/%3CCANg8BGD8Cm_=ESecQQ5mDL+6ybbNrR1Ce7i=pkuimxmcktw...@mail.gmail.com%3E > > > On Mar 30, 2014, at 7:28 PM, "Phan, Truong Q" < > [email protected]> wrote: > > > > Hi > > > > Does Mahout v0.9 supports Cloudera Hadoop v5 (2.2.0-cdh5.0.0-beta-1)? > > I have managed to installed and run all test cases under the Mahout v0.9 > without any issue. > > Please see below for the evident of the test cases. > > However I have no success to run the example from > http://girlincomputerscience.blogspot.com.au/2010/11/apache-mahout.htmland > got the following errors. > > Note: I have set the CLASSPATH to point to all of Mahout’s jar files. > > > > <snip> > > $ env | grep CLASS > > CLASSPATH=:/usr/lib/hadoop-0.20-mapreduce/lib:/usr/lib/hadoop-0.20-map > > reduce/lib:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mah > > out-distribution-0.9/core/target/mahout-core-0.9.jar:/ora/db002/stg001 > > /BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/core/ta > > rget/mahout-core-0.9-job.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/ > > devices/mahout/mahout-distribution-0.9/core/target/mahout-core-0.9-sou > > rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahou > > t-distribution-0.9/core/target/mahout-core-0.9-tests.jar:/ora/db002/st > > g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/mat > > h/target/mahout-math-0.9.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/ > > devices/mahout/mahout-distribution-0.9/math/target/mahout-math-0.9-sou > > rces.jar:/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahou > > t-distribution-0.9/math/target/mahout-math-0.9-tests.jar:/ora/db002/st > > g001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distribution-0.9/int > > egration/target/mahout-integration-0.9.jar:/ora/db002/stg001/BDMSL1D/h > > adoop/nem-dms/devices/mahout/mahout-distribution-0.9/integration/targe > > t/mahout-integration-0.9-sources.jar > > > > $ export > > MAHOUT_HOME=/ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/ma > > hout-distribution-0.9 > > $ export PATH=$MAHOUT_HOME/bin:$PATH > > > > oracle@bpdevdmsdbs01:BDMSSI1D1 ---- > > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib > > ution-0.9/nem-dms ----- $ mahout recommenditembased --input mydata.dat > > --usersFile user.dat --numRecommendations 2 --output output/ > > --similarityClassname SIMILARITY_PEARSON_CORRELATION Running on > > hadoop, using /usr/lib/hadoop-0.20-mapreduce/bin/hadoop and > > HADOOP_CONF_DIR= > > MAHOUT-JOB: > > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib > > ution-0.9/examples/target/mahout-examples-0.9-job.jar > > Exception in thread "main" java.lang.NoClassDefFoundError: > > org/apache/hadoop/util/PlatformName > > Caused by: java.lang.ClassNotFoundException: > org.apache.hadoop.util.PlatformName > > at java.net.URLClassLoader$1.run(URLClassLoader.java:202) > > at java.security.AccessController.doPrivileged(Native Method) > > at java.net.URLClassLoader.findClass(URLClassLoader.java:190) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:306) > > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:247) > > Could not find the main class: org.apache.hadoop.util.PlatformName. > Program will exit. > > Exception in thread "main" java.lang.NoClassDefFoundError: > > org/apache/hadoop/util/RunJar Caused by: > java.lang.ClassNotFoundException: org.apache.hadoop.util.RunJar > > at java.net.URLClassLoader$1.run(URLClassLoader.java:202) > > at java.security.AccessController.doPrivileged(Native Method) > > at java.net.URLClassLoader.findClass(URLClassLoader.java:190) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:306) > > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) > > at java.lang.ClassLoader.loadClass(ClassLoader.java:247) > > Could not find the main class: org.apache.hadoop.util.RunJar. Program > will exit. > > </snip> > > > > <snip> > > [INFO] --- maven-install-plugin:2.5.1:install (default-install) @ > > mahout-math-scala --- [INFO] Installing > > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib > > ution-0.9/math-scala/target/mahout-math-scala-0.9.jar to > > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/ma > > hout-math-scala-0.9.jar [INFO] Installing > > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib > > ution-0.9/math-scala/pom.xml to > > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/ma > > hout-math-scala-0.9.pom [INFO] Installing > > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib > > ution-0.9/math-scala/target/mahout-math-scala-0.9-tests.jar to > > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/ma > > hout-math-scala-0.9-tests.jar [INFO] Installing > > /ora/db002/stg001/BDMSL1D/hadoop/nem-dms/devices/mahout/mahout-distrib > > ution-0.9/math-scala/target/mahout-math-scala-0.9-sources.jar to > > /home/oracle/.m2/repository/org/apache/mahout/mahout-math-scala/0.9/ma > > hout-math-scala-0.9-sources.jar [INFO] > > ---------------------------------------------------------------------- > > -- > > [INFO] Reactor Summary: > > [INFO] > > [INFO] Mahout Build Tools ................................ SUCCESS > > [01:21 min] [INFO] Apache Mahout ..................................... > > SUCCESS [ 6.898 s] [INFO] Mahout Math > > ....................................... SUCCESS [17:39 min] [INFO] > > Mahout Core ....................................... SUCCESS [ 01:01 > > h] [INFO] Mahout Integration ................................ SUCCESS > > [06:59 min] [INFO] Mahout Examples ................................... > > SUCCESS [03:15 min] [INFO] Mahout Release Package > > ............................ SUCCESS [ 0.026 s] [INFO] Mahout > > Math/Scala wrappers ........................ SUCCESS [03:39 min] > > [INFO] > > ---------------------------------------------------------------------- > > -- > > [INFO] BUILD SUCCESS > > [INFO] > > ---------------------------------------------------------------------- > > -- > > [INFO] Total time: 01:34 h > > [INFO] Finished at: 2014-03-28T13:10:48+10:00 [INFO] Final Memory: > > 49M/276M [INFO] > > ---------------------------------------------------------------------- > > -- > > </snip> > > > > Thanks and Regards, > > Truong Phan > > Senior Technology Specialist > > Database Engineering > > Transport & Routing Engineering | Networks | Telstra Operations > > > > P + 61 2 8576 5771 > > M + 61 4 1463 7424 > > E [email protected] > > W www.telstra.com > > Love the movies? Telstra takes you there with $10 movie tickets, just > > to say thanks. Available now at telstra.com/movies This communication > may contain confidential or copyright information of Telstra Corporation > Limited (ABN 33 051 775 556). If you are not an intended recipient, you > must not keep, forward, copy, use, save or rely on this communication, and > any such action is unauthorised and prohibited. If you have received this > communication in error, please reply to this email to notify the sender of > its incorrect delivery, and then delete both it and your reply. > > > > >
