Repository: mahout Updated Branches: refs/heads/master eec16428d -> a6db60ddd
NO-JIRA change layout for recommender docs Project: http://git-wip-us.apache.org/repos/asf/mahout/repo Commit: http://git-wip-us.apache.org/repos/asf/mahout/commit/a6db60dd Tree: http://git-wip-us.apache.org/repos/asf/mahout/tree/a6db60dd Diff: http://git-wip-us.apache.org/repos/asf/mahout/diff/a6db60dd Branch: refs/heads/master Commit: a6db60ddd0a02d1f16bd4b95ac1d243a4d3c7102 Parents: eec1642 Author: pferrel <[email protected]> Authored: Tue Jun 26 17:02:44 2018 -0700 Committer: pferrel <[email protected]> Committed: Tue Jun 26 17:02:44 2018 -0700 ---------------------------------------------------------------------- .../docs/latest/algorithms/recommenders/cco.md | 2 +- .../latest/algorithms/recommenders/index.md | 2 +- .../algorithms/intro-cooccurrence-spark.md | 2 +- .../users/algorithms/recommender-overview.md | 4 ++-- .../recommender/intro-cooccurrence-spark.md | 2 +- website/users/recommender/quickstart.md | 25 +++++++++++++------- 6 files changed, 23 insertions(+), 14 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/mahout/blob/a6db60dd/website/docs/latest/algorithms/recommenders/cco.md ---------------------------------------------------------------------- diff --git a/website/docs/latest/algorithms/recommenders/cco.md b/website/docs/latest/algorithms/recommenders/cco.md index f096ebb..365113a 100644 --- a/website/docs/latest/algorithms/recommenders/cco.md +++ b/website/docs/latest/algorithms/recommenders/cco.md @@ -1,5 +1,5 @@ --- -layout: default +layout: doc-page title: Building a Mahout Recommender http://git-wip-us.apache.org/repos/asf/mahout/blob/a6db60dd/website/docs/latest/algorithms/recommenders/index.md ---------------------------------------------------------------------- diff --git a/website/docs/latest/algorithms/recommenders/index.md b/website/docs/latest/algorithms/recommenders/index.md index adf9146..dbc117a 100644 --- a/website/docs/latest/algorithms/recommenders/index.md +++ b/website/docs/latest/algorithms/recommenders/index.md @@ -1,5 +1,5 @@ --- -layout: default +layout: doc-page title: Recommender Overview http://git-wip-us.apache.org/repos/asf/mahout/blob/a6db60dd/website/users/algorithms/intro-cooccurrence-spark.md ---------------------------------------------------------------------- diff --git a/website/users/algorithms/intro-cooccurrence-spark.md b/website/users/algorithms/intro-cooccurrence-spark.md index f096ebb..365113a 100644 --- a/website/users/algorithms/intro-cooccurrence-spark.md +++ b/website/users/algorithms/intro-cooccurrence-spark.md @@ -1,5 +1,5 @@ --- -layout: default +layout: doc-page title: Building a Mahout Recommender http://git-wip-us.apache.org/repos/asf/mahout/blob/a6db60dd/website/users/algorithms/recommender-overview.md ---------------------------------------------------------------------- diff --git a/website/users/algorithms/recommender-overview.md b/website/users/algorithms/recommender-overview.md index adf9146..28e6498 100644 --- a/website/users/algorithms/recommender-overview.md +++ b/website/users/algorithms/recommender-overview.md @@ -1,5 +1,5 @@ --- -layout: default +layout: doc-page title: Recommender Overview @@ -38,4 +38,4 @@ and [What's New in Recommenders: part #2](http://occamsmachete.com/ml/2014/09/0 ## Mahout Model Creation -See the page describing [*spark-itemsimilarity*](http://mahout.apache.org/users/recommender/intro-cooccurrence-spark.html) for more details. \ No newline at end of file +See the page describing [*spark-itemsimilarity*](http://mahout.apache.org/users/recommender/intro-cooccurrence-spark.html) for more details. http://git-wip-us.apache.org/repos/asf/mahout/blob/a6db60dd/website/users/recommender/intro-cooccurrence-spark.md ---------------------------------------------------------------------- diff --git a/website/users/recommender/intro-cooccurrence-spark.md b/website/users/recommender/intro-cooccurrence-spark.md index f096ebb..365113a 100644 --- a/website/users/recommender/intro-cooccurrence-spark.md +++ b/website/users/recommender/intro-cooccurrence-spark.md @@ -1,5 +1,5 @@ --- -layout: default +layout: doc-page title: Building a Mahout Recommender http://git-wip-us.apache.org/repos/asf/mahout/blob/a6db60dd/website/users/recommender/quickstart.md ---------------------------------------------------------------------- diff --git a/website/users/recommender/quickstart.md b/website/users/recommender/quickstart.md index 41e643b..30ff938 100644 --- a/website/users/recommender/quickstart.md +++ b/website/users/recommender/quickstart.md @@ -1,25 +1,34 @@ --- -layout: default -title: Recommender Quickstart +layout: doc-page +title: Recommender Overview + - --- + # Recommender Overview -Recommenders have changed over the years. Mahout contains a long list of them, which you can still use. But to get the best out of our more modern aproach we'll need to think of the Recommender as a "model creation" component—supplied by Mahout's new spark-itemsimilarity job, and a "serving" component—supplied by a modern scalable search engine, like Solr. +Recommenders have changed over the years. Mahout contains a long list of them, which you can still use. However in about 2013 there was a revolution in recommenders, which favored what we might call "Multimodal", meaning they could take in data of all sorts—basically anything we might think was an indicator of user taste. The new Samsara algorithm, called Correlated Cross-Occurrence (CCO) is just such a next gen recommender algorithm but Mahout-Samsara only implements the model building part. This can be integrated as the user see fit and the rest of this doc will explain how. + +## Turnkey Implementation + +If you are looking for an end-to-end OSS recommender based on the Mahout CCO algorithm have a look at [The Universal Recommender](https://github.com/actionml/universal-recommender), which is implemented using [Apache PredictionIO](http://predictionio.apache.org/). See instructions for [installation here](http://actionml.com/docs/pio_by_actionml). There is even an AWS AMI for convenience (this is a for-pay option) + +## Build Your Own Integration + +To get the most out of our more modern CCO algorithm we'll need to think of the Recommender as a "model creation" component—supplied by Mahout's new spark-itemsimilarity job, and a "serving" component—supplied by a modern scalable search engine, like Solr or Elasticsearch. Here we describe a loose integration that does not require using Mahout as a library, it uses Mahout's command line interface. This is clearly not the best but allows one to experiments and get a real recommender running easily.  To integrate with your application you will collect user interactions storing them in a DB and also in a from usable by Mahout. The simplest way to do this is to log user interactions to csv files (user-id, item-id). The DB should be setup to contain the last n user interactions, which will form part of the query for recommendations. -Mahout's spark-itemsimilarity will create a table of (item-id, list-of-similar-items) in csv form. Think of this as an item collection with one field containing the item-ids of similar items. Index this with your search engine. +Mahout's spark-itemsimilarity will create a table of (item-id, list-of-similar-items) in csv form. Think of this as an item collection with one field containing the item-ids of similar items. Index this with your search engine. When your application needs recommendations for a specific person, get the latest user history of interactions from the DB and query the indicator collection with this history. You will get back an ordered list of item-ids. These are your recommendations. You may wish to filter out any that the user has already seen but that will depend on your use case. All ids for users and items are preserved as string tokens and so work as an external key in DBs or as doc ids for search engines, they also work as tokens for search queries. -##References +## References 1. A free ebook, which talks about the general idea: [Practical Machine Learning](https://www.mapr.com/practical-machine-learning) 2. A slide deck, which talks about mixing actions or other indicators: [Creating a Multimodal Recommender with Mahout and a Search Engine](http://occamsmachete.com/ml/2014/10/07/creating-a-unified-recommender-with-mahout-and-a-search-engine/) @@ -27,6 +36,6 @@ All ids for users and items are preserved as string tokens and so work as an ext and [What's New in Recommenders: part #2](http://occamsmachete.com/ml/2014/09/09/mahout-on-spark-whats-new-in-recommenders-part-2/) 3. A post describing the loglikelihood ratio: [Surprise and Coinsidense](http://tdunning.blogspot.com/2008/03/surprise-and-coincidence.html) LLR is used to reduce noise in the data while keeping the calculations O(n) complexity. -##Mahout Model Creation +## Mahout Model Creation -See the page describing [*spark-itemsimilarity*](http://mahout.apache.org/users/recommender/intro-cooccurrence-spark.html) for more details. \ No newline at end of file +See the page describing [*spark-itemsimilarity*](http://mahout.apache.org/users/recommender/intro-cooccurrence-spark.html) for more details.
