Compare Recommender output by order of recommendations.
-------------------------------------------------------
Key: MAHOUT-559
URL: https://issues.apache.org/jira/browse/MAHOUT-559
Project: Mahout
Issue Type: New Feature
Components: Collaborative Filtering
Reporter: Lance Norskog
OrderBasedRecommenderEvaluator compares the output of two recommenders. It only
checks the order of the recommended items, ignoring the returned preferences.
Purpose: the existing RecommenderEvaluator has a very limited use model. It
does not allow comparing the outputs of different recommenders against the same
data model. Also, I could not figure out how its comparison criteria.
OrderBasedRecommenderEvaluator gets a recommendation of N samples for each user
available from the datamodel, from both recommenders. It finds the common items
in the two recommendations, and performs various statistical tests comparing
the order of these common items. It does not evaluate the items unique to one
recommendation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
