Hi !! I am posting this exception to get some feedback about any obvious
error on my part, before spending time investigating in the code. Thanks for
your attention.
*Environment: *
Mahout 0.6 (today's build - 07/06/2011)
Hadoop - hadoop-0.20.2-cdh3u0
Pseudo-cluster (localbox)
*Job submission:*
bin/hadoop jar target/mahout-core-0.6-SNAPSHOT-job.jar *
org.apache.mahout.cf.taste.hadoop.als.ParallelALSFactorizationJob*-Dmapred.input.dir=hdfs://localhost/user/Kumar/als/input/mahout_ratings.dat
-Dmapred.output.dir=hdfs://localhost/user/Kumar/als/tmp/dataset --tempDir
hdfs://localhost/user/Kumar/als/tmp --numFeatures 20 --numIterations 10
--lambda 0.065
*Error:*
11/07/06 07:24:59 INFO mapred.JobClient: Cleaning up the staging area
hdfs://localhost/var/lib/hadoop-0.20/cache/Kumar/mapred/staging/Kumar/.staging/job_201107060705_0004
Exception in thread "main"
org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does
not exist:* hdfs:/localhost/user/Kumar/als/tmp/M--1*
at
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:231)
at
org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat.listStatus(SequenceFileInputFormat.java:55)
at
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:248)
at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:944)
at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:961)
at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:880)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1115)
at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:833)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:476)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:506)
at
org.apache.mahout.cf.taste.hadoop.als.ParallelALSFactorizationJob.joinAndSolve(ParallelALSFactorizationJob.java:174)
at
org.apache.mahout.cf.taste.hadoop.als.ParallelALSFactorizationJob.iterate(ParallelALSFactorizationJob.java:157)
at
org.apache.mahout.cf.taste.hadoop.als.ParallelALSFactorizationJob.run(ParallelALSFactorizationJob.java:128)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at
org.apache.mahout.cf.taste.hadoop.als.ParallelALSFactorizationJob.main(ParallelALSFactorizationJob.java:86)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
*HDFS File System:*
Kumar:hadoop-0.20.2-cdh3u0 Kumar$ bin/hadoop fs -lsr alsdrwxr-xr-x - Kumar
supergroup 0 2011-07-05 15:55 /user/Kumar/als/input
-rw-r--r-- 1 Kumar supergroup 11553456 2011-07-05 15:55
/user/Kumar/als/input/mahout_ratings.dat
drwxr-xr-x - Kumar supergroup 0 2011-07-05 15:52
/user/Kumar/als/output
drwxr-xr-x - Kumar supergroup 0 2011-07-06 07:24
/user/Kumar/als/tmp
drwxr-xr-x - Kumar supergroup 0 2011-07-06 07:24 *
/user/Kumar/als/tmp/M--1*
-rw-r--r-- 1 Kumar supergroup 0 2011-07-06 07:24
/user/Kumar/als/tmp/M--1/_SUCCESS
drwxr-xr-x - Kumar supergroup 0 2011-07-06 07:24
/user/Kumar/als/tmp/M--1/_logs
drwxr-xr-x - Kumar supergroup 0 2011-07-06 07:24
/user/Kumar/als/tmp/M--1/_logs/history
-rw-r--r-- 1 Kumar supergroup 9553 2011-07-06 07:24
/user/Kumar/als/tmp/M--1/_logs/history/localhost_1309953935546_job_201107060705_0003_Kumar_ParallelALSFactorizationJob-ItemIDRatingMapper-Ini
-rw-r--r-- 1 Kumar supergroup 45122 2011-07-06 07:24
/user/Kumar/als/tmp/M--1/_logs/history/localhost_1309953935546_job_201107060705_0003_conf.xml
-rw-r--r-- 1 Kumar supergroup 658365 2011-07-06 07:24
/user/Kumar/als/tmp/M--1/part-r-00000
drwxr-xr-x - Kumar supergroup 0 2011-07-06 07:23
/user/Kumar/als/tmp/itemsAsFeatureWithRatingWritable
-rw-r--r-- 1 Kumar supergroup 0 2011-07-06 07:23
/user/Kumar/als/tmp/itemsAsFeatureWithRatingWritable/_SUCCESS
drwxr-xr-x - Kumar supergroup 0 2011-07-06 07:22
/user/Kumar/als/tmp/itemsAsFeatureWithRatingWritable/_logs
drwxr-xr-x - Kumar supergroup 0 2011-07-06 07:22
/user/Kumar/als/tmp/itemsAsFeatureWithRatingWritable/_logs/history
-rw-r--r-- 1 Kumar supergroup 9553 2011-07-06 07:22
/user/Kumar/als/tmp/itemsAsFeatureWithRatingWritable/_logs/history/localhost_1309953935546_job_201107060705_0001_Kumar_ParallelALSFactorizationJob-PrefsToRatingsMapper-R
-rw-r--r-- 1 Kumar supergroup 44898 2011-07-06 07:22
/user/Kumar/als/tmp/itemsAsFeatureWithRatingWritable/_logs/history/localhost_1309953935546_job_201107060705_0001_conf.xml
-rw-r--r-- 1 Kumar supergroup 18138736 2011-07-06 07:23
/user/Kumar/als/tmp/itemsAsFeatureWithRatingWritable/part-r-00000
drwxr-xr-x - Kumar supergroup 0 2011-07-06 07:24
/user/Kumar/als/tmp/usersAsFeatureWithRatingWritable
-rw-r--r-- 1 Kumar supergroup 0 2011-07-06 07:24
/user/Kumar/als/tmp/usersAsFeatureWithRatingWritable/_SUCCESS
drwxr-xr-x - Kumar supergroup 0 2011-07-06 07:23
/user/Kumar/als/tmp/usersAsFeatureWithRatingWritable/_logs
drwxr-xr-x - Kumar supergroup 0 2011-07-06 07:23
/user/Kumar/als/tmp/usersAsFeatureWithRatingWritable/_logs/history
-rw-r--r-- 1 Kumar supergroup 9553 2011-07-06 07:23
/user/Kumar/als/tmp/usersAsFeatureWithRatingWritable/_logs/history/localhost_1309953935546_job_201107060705_0002_Kumar_ParallelALSFactorizationJob-PrefsToRatingsMapper-R
-rw-r--r-- 1 Kumar supergroup 45132 2011-07-06 07:23
/user/Kumar/als/tmp/usersAsFeatureWithRatingWritable/_logs/history/localhost_1309953935546_job_201107060705_0002_conf.xml
-rw-r--r-- 1 Kumar supergroup 18133404 2011-07-06 07:24
/user/Kumar/als/tmp/usersAsFeatureWithRatingWritable/part-r-00000
Kumar _/|\_
www.saisk.com
[email protected]
"making a profound difference with knowledge and creativity..."
