On Aug 5, 2014, at 5:59 PM, François Bossière <[email protected]>
wrote:
Hi,
I am discovering Mahout which I installed on a mapr cluster using the
mapr-mahout package.
I try some very little test on recommenders:
My input is the following $MAHOUT_HOME/input/test.txt:
0,1,4
0,4,2
5,1,2
5,4,3
5,7,5
8,1,2
8,7,1
I go in $MAHOUT_HOME and I run:
mahout recommenditembased -s SIMILARITY_PEARSON_CORRELATION -i input/test.txt
-o output --numRecommendations 5
I get the following error message:
No MAHOUT_CONF_DIR found
Running on hadoop, using /opt/mapr/hadoop/hadoop-0.20.2/bin/hadoop and
HADOOP_CONF_DIR=
MAHOUT-JOB: /opt/mapr/mahout/mahout-0.9/mahout-examples-0.9-mapr-job.jar
14/08/05 09:53:53 WARN driver.MahoutDriver: No recommenditembased.props found
on classpath, will use command-line arguments only
14/08/05 09:53:54 INFO common.AbstractJob: Command line arguments:
{--booleanData=[false], --endPhase=[2147483647], --input=[input/test.txt],
--maxPrefsInItemSimilarity=[500], --maxPrefsPerUser=[10],
--maxSimilaritiesPerItem=[100], --minPrefsPerUser=[1],
--numRecommendations=[5], --output=[output],
--similarityClassname=[SIMILARITY_PEARSON_CORRELATION], --startPhase=[0],
--tempDir=[temp]}
14/08/05 09:53:54 INFO common.AbstractJob: Command line arguments:
{--booleanData=[false], --endPhase=[2147483647], --input=[input/test.txt],
--minPrefsPerUser=[1], --output=[temp/preparePreferenceMatrix],
--ratingShift=[0.0], --startPhase=[0], --tempDir=[temp]}
14/08/05 09:53:54 INFO fs.JobTrackerWatcher: Current running JobTracker is:
fb-mapr1.c.mindful-origin-252.internal/10.240.1.96:9001
14/08/05 09:53:54 INFO mapred.JobClient: Cleaning up the staging area
maprfs:/var/mapr/cluster/mapred/jobTracker/staging/mapr/.staging/job_201408041502_0035
Exception in thread "main"
org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist:
input/test.txt
at
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:248)
at
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:273)
at
org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:1033)
at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1050)
at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:173)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:934)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:885)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:885)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:573)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:603)
at
org.apache.mahout.cf.taste.hadoop.preparation.PreparePreferenceMatrixJob.run(PreparePreferenceMatrixJob.java:77)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at
org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:164)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at
org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:322)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
Precision: i set MAHOUT_CONF_DIR=/opt/mapr/mahout/mahout-0.9/conf.new because I
did not know how to set it.
Can you help me solve this very frustrating problem?
