I’m running the code and keep getting arrayindexoutofboundsexceptions.
Please let me know if you know the problem or a way to find out.
Thanks the error is below,
Jonathan Nassau
[ec2-user mahout]$ hadoop jar mahout-core-0.7-job.jar
org.apache.mahou=output --usersFile input/users.txt --booleanData
--similarityClassname SIMILARITY_COOC
Warning: $HADOOP_HOME is deprecated.
12/06/28 15:52:48 INFO common.AbstractJob: Command line arguments:
{--booleanData=[fals], --maxSimilaritiesPerItem=[100],
--minPrefsPerUser=[1], --numRecommendations=[10], --le=[input/users.txt]}
12/06/28 15:52:48 INFO common.AbstractJob: Command line arguments:
{--booleanData=[falsPerUser=[1], --output=[temp/preparePreferenceMatrix],
--ratingShift=[0.0], --startPhase
12/06/28 15:52:52 INFO input.FileInputFormat: Total input paths to process
: 1
12/06/28 15:52:52 INFO util.NativeCodeLoader: Loaded the native-hadoop
library
12/06/28 15:52:52 WARN snappy.LoadSnappy: Snappy native library not loaded
12/06/28 15:52:52 INFO mapred.JobClient: Running job: job_201206281512_0001
12/06/28 15:52:53 INFO mapred.JobClient: map 0% reduce 0%
12/06/28 15:53:30 INFO mapred.JobClient: Task Id :
attempt_201206281512_0001_m_000000_0
java.lang.ArrayIndexOutOfBoundsException: 1
at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp
at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:416)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
at org.apache.hadoop.mapred.Child.main(Child.java:249)
12/06/28 15:53:33 INFO mapred.JobClient: Task Id :
attempt_201206281512_0001_m_000001_0
java.lang.ArrayIndexOutOfBoundsException: 1
at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp
at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:416)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
at org.apache.hadoop.mapred.Child.main(Child.java:249)
12/06/28 15:53:51 INFO mapred.JobClient: Task Id :
attempt_201206281512_0001_m_000000_1
java.lang.ArrayIndexOutOfBoundsException: 1
at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp
at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:416)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
at org.apache.hadoop.mapred.Child.main(Child.java:249)
12/06/28 15:53:52 INFO mapred.JobClient: Task Id :
attempt_201206281512_0001_m_000001_1
java.lang.ArrayIndexOutOfBoundsException: 1
at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp
at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:416)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
at org.apache.hadoop.mapred.Child.main(Child.java:249)
12/06/28 15:54:09 INFO mapred.JobClient: Task Id :
attempt_201206281512_0001_m_000000_2
java.lang.ArrayIndexOutOfBoundsException: 1
at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp
at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:416)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
at org.apache.hadoop.mapred.Child.main(Child.java:249)
12/06/28 15:54:13 INFO mapred.JobClient: Task Id :
attempt_201206281512_0001_m_000001_2
java.lang.ArrayIndexOutOfBoundsException: 1
at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp
at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:416)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
at org.apache.hadoop.mapred.Child.main(Child.java:249)
12/06/28 15:54:34 INFO mapred.JobClient: Job complete: job_201206281512_0001
12/06/28 15:54:34 INFO mapred.JobClient: Counters: 7
12/06/28 15:54:34 INFO mapred.JobClient: Job Counters
12/06/28 15:54:34 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=157177
12/06/28 15:54:34 INFO mapred.JobClient: Total time spent by all
reduces waiting af
12/06/28 15:54:34 INFO mapred.JobClient: Total time spent by all maps
waiting after
12/06/28 15:54:34 INFO mapred.JobClient: Launched map tasks=8
12/06/28 15:54:34 INFO mapred.JobClient: Data-local map tasks=8
12/06/28 15:54:34 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=0
12/06/28 15:54:34 INFO mapred.JobClient: Failed map tasks=1
Exception in thread "main" java.io.FileNotFoundException: File does not
exist: /user/ec
at
org.apache.hadoop.hdfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:1843
at
org.apache.hadoop.hdfs.DFSClient$DFSInputStream.<init>(DFSClient.java:1834)
at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:578)
at
org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:427)
at org.apache.mahout.common.HadoopUtil.readInt(HadoopUtil.java:284)
at
org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.jav
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at
org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.ja
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
at java.lang.reflect.Method.invoke(Method.java:616)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
