[
https://issues.apache.org/jira/browse/MAHOUT-477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Schelter updated MAHOUT-477:
--------------------------------------
Status: Patch Available (was: Open)
I had used a stupid custom Partitioner, simply switching to HashPartitioner did
the trick.
> SimilarityMatrixEntryKeyPartitioner sometimes produces illegal partition
> numbers
> --------------------------------------------------------------------------------
>
> Key: MAHOUT-477
> URL: https://issues.apache.org/jira/browse/MAHOUT-477
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Reporter: Sebastian Schelter
> Priority: Minor
> Attachments: MAHOUT-477.patch
>
>
> My job failed on EMR today with the exception below. I think this happens
> only when when there are negative row/column indices in a matrix given to
> RowSimilarityJob, still have to figure out the details.
> java.io.IOException: Illegal partition for
> org.apache.mahout.math.hadoop.similarity.similaritymatrixentry...@3532b21 (-3)
> at
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:921)
> at
> org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:549)
> at
> org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
> at org.apache.hadoop.mapreduce.Mapper.map(Mapper.java:124)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:629)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:310)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
