[ 
https://issues.apache.org/jira/browse/BIGTOP-1272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14068665#comment-14068665
 ] 

bhashit parikh commented on BIGTOP-1272:
----------------------------------------

# The number of entries are probably higher because I set the default number of 
records to be generated to 100. Let me know if I should reduce that number 
and/or if my guess in incorrect.
# The {{ItemRecommender.scala}} does have a {{main}} method. It is right at the 
end of the file, inside {{object ItemRecommender}}. Scala doesn't have statics, 
so the main method has to reside within the companion object.
# I have spent a few hours on getting a satisfying fat-jar. I can create the 
fat-jars with the necessary configurations. However, it seems like those 
{{pig-withouthadoop.jar}} and the similar jar for mahout would need to be 
specified manually. I looked into some of the pig code that deals with this. It 
seems that pig, when run as a hadoop job, creates a few jars and provides them 
to hadoop. I am still looking into that. 

I'll post more updates soon.

> BigPetStore: Productionize the Mahout recommender
> -------------------------------------------------
>
>                 Key: BIGTOP-1272
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-1272
>             Project: Bigtop
>          Issue Type: New Feature
>          Components: Blueprints
>    Affects Versions: backlog
>            Reporter: jay vyas
>         Attachments: BIGTOP-1272.patch, BIGTOP-1272.patch, BIGTOP-1272.patch, 
> arch.jpeg, build.gradle
>
>
> BIGTOP-1271 adds patterns into the data that gaurantee that a meaningfull 
> type of product recommendation can be given for at least *some* customers, 
> since we know that there are going to be many customers who only bought 1 
> product, and also customers that bought 2 or more products -- even in a 
> dataset size of 10. due to the gaussian distribution of purchases that is 
> also in the dataset generator. 
> The current mahout recommender code is statically valid: It runs to 
> completion in local unit tests if a hadoop 1x tarball is present but 
> otherwise it hasn't been tested at scale.  So, lets get it working.  this 
> JIRA also will comprise:
> - deciding wether to use mahout 2x for unit tests (default on mahout maven 
> repo is the 1x impl) and wether or not bigtop should host a mahout 2x jar?  
> After all, bigtop builds a mahout 2x jar as part of its packaging process, 
> and BigPetStore might thus need a mahout 2x jar in order to test against the 
> right same of bigtop releases.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to