[ 
https://issues.apache.org/jira/browse/MAHOUT-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13101274#comment-13101274
 ] 

Hudson commented on MAHOUT-767:
-------------------------------

Integrated in Mahout-Quality #1027 (See 
[https://builds.apache.org/job/Mahout-Quality/1027/])
    MAHOUT-767 Improve RowSimilarityJob performance, threshold integration

ssc : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1167115
Files : 
* 
/mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/item/RecommenderJob.java
* 
/mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/similarity/item/ItemSimilarityJob.java
* 
/mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/similarity/item/MostSimilarItemPairsMapper.java
* 
/mahout/trunk/core/src/main/java/org/apache/mahout/cf/taste/hadoop/similarity/item/MostSimilarItemPairsReducer.java
* 
/mahout/trunk/core/src/main/java/org/apache/mahout/math/hadoop/similarity/cooccurrence/RowSimilarityJob.java
* 
/mahout/trunk/core/src/test/java/org/apache/mahout/cf/taste/hadoop/similarity/item/ItemSimilarityJobTest.java


> Improve RowSimilarityJob performance
> ------------------------------------
>
>                 Key: MAHOUT-767
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-767
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Collaborative Filtering
>    Affects Versions: 0.5
>            Reporter: Grant Ingersoll
>            Assignee: Sebastian Schelter
>             Fix For: 0.6
>
>         Attachments: MAHOUT-767-2.patch, MAHOUT-767.patch
>
>
> (See 
> http://www.lucidimagination.com/search/document/40c4f124795c6b5/rowsimilarity_s#42ab816c27c6a9e7
>  for background)
> Currently, the RowSimilarityJob defers the calculation of the similarity 
> metric until the reduce phase, while emitting many Cooccurrence objects.  For 
> similarity metrics that are algebraic 
> (http://pig.apache.org/docs/r0.8.1/udf.html#Aggregate+Functions) we should be 
> able to do much of the computation during the Mapper part of this phase and 
> also take advantage of a Combiner.  
> We should use a marker interface to know whether a similarity metric is 
> algebraic and then make use of an appropriate Mapper implementation, 
> otherwise we can fall back on our existing implementation.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to