Precision and Recall for User Based Recommender System using Binary Data

2015-12-09 Thread Shady Hanna
Hi everyone , I am trying to develop a user based recommender system using binary data. The data has the user ID and product id which the user has bought and the preference is always 1 since I don't have ratings in my dataset. If the user did not buy an item, it is not included in the dataset. I

Re: User based recommender

2014-12-09 Thread Pat Ferrel
BTW you may be able to just run the same csv through multiple times and pick a different item-ID column for each “action”. BTW here “csv” means a text file with some delimeter, not the full spec csv with headers, quoted values, and escaped characters. On Dec 8, 2014, at 4:11 PM, Pat Ferrel

Re: User based recommender

2014-12-08 Thread Yash Patel
most columns have different values,when you say preprocess do you mean using classifiers ? my dataset is highly structured in nature so i dont understand how a classifier will work. On Dec 8, 2014 2:20 AM, Pat Ferrel p...@occamsmachete.com wrote: If there is some “filter” column that flags one

Re: User based recommender

2014-12-08 Thread Pat Ferrel
No classifier, just turn the one csv into several, each being a collection for one action. user ID,item ID Where the item ID is whatever the action corresponds too. For instance a user ID,location ID for being at a location or user ID,item ID for a purchase etc. These can go directly into the

Re: User based recommender

2014-12-07 Thread Pat Ferrel
To use cross-recommendations with multiple actions you may be able to get away with using the pre-packaged command line job “spark-itemsimilarity. At one point you said you were more interested in the Mahout Hadoop Mapreduce recommender, which cannot create these cross-recommendations. I don’t

Re: User based recommender

2014-12-07 Thread Yash Patel
Will cross recommendation still work considering item similarity checks multiple columns for items and my dataset has only one column for items;it contains different item ids. On Sun, Dec 7, 2014 at 5:26 PM, Pat Ferrel p...@occamsmachete.com wrote: To use cross-recommendations with multiple

Re: User based recommender

2014-12-07 Thread Pat Ferrel
If there is some “filter” column that flags one type of item or another then yes. Otherwise you’ll have to preprocess your data for input. On Dec 7, 2014, at 2:27 PM, Yash Patel yashpatel1...@gmail.com wrote: Will cross recommendation still work considering item similarity checks multiple

Re: User based recommender

2014-12-06 Thread Pat Ferrel
You can often think of or re-phase a piece of data (a column in your interaction data) as an action, like “being at a location”. Then use cross-cooccurrence to calculate a cross-indicator. So the location can be used to recommend purchases. If you do this, the location should be something that

Re: User based recommender

2014-12-06 Thread Yash Patel
i have something that shows the user locations,however is it possible to implement this without using apache spark shell as i found it quite confusing to use without no examples. I have a windows environment and i am using java in eclipse luna to code the recommender. On Dec 6, 2014 9:09 PM, Pat

Re: User based recommender

2014-12-05 Thread Ted Dunning
Cross recommendation can apply if you use the multiple kinds of columns to impute actions relative to characteristics. That is, people at this location buy this item. Then when you do the actual query, the query contains detailed history of the person, but also recent location history. On

Re: User based recommender

2014-12-04 Thread Ted Dunning
On Wed, Dec 3, 2014 at 6:22 AM, Yash Patel yashpatel1...@gmail.com wrote: I have multiple different columns such as category,shipping location,item price,online user, etc. How can i use all these different columns and improve recommendation quality(ie.calculate more precise similarity

Re: User based recommender

2014-12-04 Thread Yash Patel
Calculating similarity using multiple column values is what i thought,I looked throught the example but there is just some mention of use of content filtering implemented but not explicitly. Can you guide me to a working example or do i need to use algorithms for classifiers or clustering? Also

Re: User based recommender

2014-12-04 Thread Yash Patel
Cross Recommendors dont seem applicable because this dataset doesn't represent different actions by a user,it just contains transaction history.(ie.customer id,item id,shipping location,sales amount of that item,item category etc) Maybe location,sales per item(similarity might lead to knowledge

Re: User based recommender

2014-12-04 Thread Pat Ferrel
User1 purchases = infant car seat, infant stroller User2 purchases = infant car seat, infant stroller, infant crib mobile The obvious recommendation for User1 is an infant crib mobile. From the purchase history the users look similar. Here similarity is in “taste”. User or item information that

Re: User based recommender

2014-12-03 Thread Yash Patel
, Yash Patel yashpatel1...@gmail.com wrote: Dear Mahout Team, I am a student new to machine learning and i am trying to build a user based recommender using mahout. My dataset is a csv file as an input but it has many fields as text and i understand mahout needs numeric

Re: User based recommender

2014-12-03 Thread parnab kumar
1. why not use the other columns as evidences and come up with a preference score UID ITEMID PREF_SCORE and see if results improve.. May be you use other machine learning algorithms to generate such preference scores... 2. one other way may be to implement a custom similarity Score and not the

Re: User based recommender

2014-11-29 Thread Yash Patel
from your side will help us to give your the right pointers. On Wed, Nov 26, 2014 at 7:16 PM, Yash Patel yashpatel1...@gmail.com wrote: Dear Mahout Team, I am a student new to machine learning and i am trying to build a user based recommender using mahout. My dataset is a csv file

Re: User based recommender

2014-11-29 Thread Pat Ferrel
, I am a student new to machine learning and i am trying to build a user based recommender using mahout. My dataset is a csv file as an input but it has many fields as text and i understand mahout needs numeric values. Can you give me a headstart as to where i should start and what kind

Re: User based recommender

2014-11-29 Thread Yash Patel
...@gmail.com wrote: Dear Mahout Team, I am a student new to machine learning and i am trying to build a user based recommender using mahout. My dataset is a csv file as an input but it has many fields as text and i understand mahout needs numeric values. Can you give me

Re: User based recommender

2014-11-28 Thread Yash Patel
to build a user based recommender using mahout. My dataset is a csv file as an input but it has many fields as text and i understand mahout needs numeric values. Can you give me a headstart as to where i should start and what kind of tools i need to parse the text colummns, Also

Re: User based recommender

2014-11-28 Thread Pat Ferrel
your side will help us to give your the right pointers. On Wed, Nov 26, 2014 at 7:16 PM, Yash Patel yashpatel1...@gmail.com wrote: Dear Mahout Team, I am a student new to machine learning and i am trying to build a user based recommender using mahout. My dataset is a csv file

Re: User based recommender

2014-11-28 Thread Yash Patel
more info from your side will help us to give your the right pointers. On Wed, Nov 26, 2014 at 7:16 PM, Yash Patel yashpatel1...@gmail.com wrote: Dear Mahout Team, I am a student new to machine learning and i am trying to build a user based recommender using mahout. My dataset

Re: User based recommender

2014-11-28 Thread Pat Ferrel
will help us to give your the right pointers. On Wed, Nov 26, 2014 at 7:16 PM, Yash Patel yashpatel1...@gmail.com wrote: Dear Mahout Team, I am a student new to machine learning and i am trying to build a user based recommender using mahout. My dataset is a csv file as an input but it has

Re: User based recommender

2014-11-27 Thread Pat Ferrel
trying to build a user based recommender using mahout. My dataset is a csv file as an input but it has many fields as text and i understand mahout needs numeric values. Can you give me a headstart as to where i should start and what kind of tools i need to parse the text colummns, Also

User based recommender

2014-11-26 Thread Yash Patel
Dear Mahout Team, I am a student new to machine learning and i am trying to build a user based recommender using mahout. My dataset is a csv file as an input but it has many fields as text and i understand mahout needs numeric values. Can you give me a headstart as to where i should start

AW: User based recommender

2014-11-26 Thread Manuel Blechschmidt
) /divdivAn: user@mahout.apache.org /divdivBetreff: User based recommender /divdiv /divDear Mahout Team, I am a student new to machine learning and i am trying to build a user based recommender using mahout. My dataset is a csv file as an input but it has many fields as text and i understand mahout

Re: User based recommender

2014-11-26 Thread parnab kumar
use directly the algorithms in Mahout. A little more info from your side will help us to give your the right pointers. On Wed, Nov 26, 2014 at 7:16 PM, Yash Patel yashpatel1...@gmail.com wrote: Dear Mahout Team, I am a student new to machine learning and i am trying to build a user based

Re: User based recommender

2014-11-26 Thread Pat Ferrel
Hi Yash, What exactly do you mean by “user-based” recommender? What does your data look like? What are the columns in the CSV? For collaborative filtering you will need a user-ID and an item-ID for each preference the user has expressed. Mahout has several recommenders so building one should

Re: User based recommender

2014-11-26 Thread Pat Ferrel
us to give your the right pointers. On Wed, Nov 26, 2014 at 7:16 PM, Yash Patel yashpatel1...@gmail.com wrote: Dear Mahout Team, I am a student new to machine learning and i am trying to build a user based recommender using mahout. My dataset is a csv file as an input but it has many fields

Re: User based recommender

2014-11-26 Thread Yash Patel
directly the algorithms in Mahout. A little more info from your side will help us to give your the right pointers. On Wed, Nov 26, 2014 at 7:16 PM, Yash Patel yashpatel1...@gmail.com wrote: Dear Mahout Team, I am a student new to machine learning and i am trying to build a user based

User Based recommender - strange behaviour of Pearson

2013-04-09 Thread yamo93
Hi, I use a user based recommender. I've just discovered a strange behaviour of Pearson when a user has the same ratings for all rated items. The system don't recommend anything in this case for this user. I try an explanation : it is due to centered data (centeredSumX2 equals 0

Re: User Based recommender - strange behaviour of Pearson

2013-04-09 Thread Tevfik Aytekin
and it will not be undefined when a user has the same ratings for all items. On Tue, Apr 9, 2013 at 6:19 PM, yamo93 yam...@gmail.com wrote: Hi, I use a user based recommender. I've just discovered a strange behaviour of Pearson when a user has the same ratings for all rated items. The system don't recommend

From Item-based Recommender to User-based Recommender

2012-05-09 Thread 冯伟
I found that only item-based recommender is implemented in version-0.6. When I want to use the user-based recommender, all I need to do is to transpose the input, i.e., uid, itemid, rating --- itemid, uid, rating,right? Is there any other differences between item-based and user-based approach

Re: From Item-based Recommender to User-based Recommender

2012-05-09 Thread Sean Owen
Both of these have been implemented since before Mahout. Can you clarify? Don't understand at the moment. On May 9, 2012 3:42 PM, 冯伟 whitepapers...@gmail.com wrote: I found that only item-based recommender is implemented in version-0.6. When I want to use the user-based recommender, all I need

Re: From Item-based Recommender to User-based Recommender

2012-05-09 Thread 冯伟
want to use the user-based recommender, all I need to do is to transpose the input, i.e., uid, itemid, rating --- itemid, uid, rating,right? Is there any other differences between item-based and user-based approach, which is not noticed by me? -- Wei Feng -- Wei Feng

Re: From Item-based Recommender to User-based Recommender

2012-05-09 Thread Sean Owen
since before Mahout. Can you clarify? Don't understand at the moment. On May 9, 2012 3:42 PM, 冯伟 whitepapers...@gmail.com wrote: I found that only item-based recommender is implemented in version-0.6. When I want to use the user-based recommender, all I need to do is to transpose

Re: From Item-based Recommender to User-based Recommender

2012-05-09 Thread Sebastian Schelter
If you transpose the input, you would recommend users to items, not items to users, thats the problem. --sebastian On 09.05.2012 16:41, 冯伟 wrote: I found that only item-based recommender is implemented in version-0.6. When I want to use the user-based recommender, all I need to do

Re: From Item-based Recommender to User-based Recommender

2012-05-09 Thread 冯伟
found that only item-based recommender is implemented in version-0.6. When I want to use the user-based recommender, all I need to do is to transpose the input, i.e., uid, itemid, rating --- itemid, uid, rating,right? Is there any other differences between item-based and user-based approach

Theory question about Pearson Correlation and user based recommender

2012-05-09 Thread Daniel Quach
I am running average absolute difference evaluations of a generic user based recommender that uses a threshold based neighborhood and pearson correlation to determine similarity. I evaluated several recommenders for varying minimum thresholds for the neighborhood (0.9, 0.8, 0.7, 0.6, 0.5) I

Re: Theory question about Pearson Correlation and user based recommender

2012-05-09 Thread Sean Owen
, Daniel Quach danqu...@cs.ucla.edu wrote: I am running average absolute difference evaluations of a generic user based recommender that uses a threshold based neighborhood and pearson correlation to determine similarity. I evaluated several recommenders for varying minimum thresholds