[
https://issues.apache.org/jira/browse/BIGTOP-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14067616#comment-14067616
]
jay vyas commented on BIGTOP-1272:
----------------------------------
Okay. I got it to run. Now here is a review:
1) There is a *bug in the BPS_ANALYTICS.pig* output. It appears we now have
alot of entry records.
{noformat}
bash-4.1$ hadoop fs -cat pig_ad_hoc_script0/part*
[172/1845]
28
...
72
68
AK filter 3
AK air_pump 2
AK cat_food 3
AK dog_food 3
{noformat}
2) There needs to be doc in *README for running the Mahout Recommender job*.
At this point I see no main() method in ItemRecommender, so running {{hadoop
jar /home/bp/code/bigtop/bigtop-bigpetstore/BigPetStore.jar
org.apache.bigtop.bigpetstore.recommend.ItemRecommender ....}} definetly is not
an option.
3) Also, *gradle tooling for fat jar*.
Then we will be able to try to run it again.
> BigPetStore: Productionize the Mahout recommender
> -------------------------------------------------
>
> Key: BIGTOP-1272
> URL: https://issues.apache.org/jira/browse/BIGTOP-1272
> Project: Bigtop
> Issue Type: New Feature
> Components: Blueprints
> Affects Versions: backlog
> Reporter: jay vyas
> Attachments: BIGTOP-1272.patch, BIGTOP-1272.patch, BIGTOP-1272.patch,
> arch.jpeg, build.gradle
>
>
> BIGTOP-1271 adds patterns into the data that gaurantee that a meaningfull
> type of product recommendation can be given for at least *some* customers,
> since we know that there are going to be many customers who only bought 1
> product, and also customers that bought 2 or more products -- even in a
> dataset size of 10. due to the gaussian distribution of purchases that is
> also in the dataset generator.
> The current mahout recommender code is statically valid: It runs to
> completion in local unit tests if a hadoop 1x tarball is present but
> otherwise it hasn't been tested at scale. So, lets get it working. this
> JIRA also will comprise:
> - deciding wether to use mahout 2x for unit tests (default on mahout maven
> repo is the 1x impl) and wether or not bigtop should host a mahout 2x jar?
> After all, bigtop builds a mahout 2x jar as part of its packaging process,
> and BigPetStore might thus need a mahout 2x jar in order to test against the
> right same of bigtop releases.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
