There are quite a few changes to Mahout around the RecommenderJob and the various m/r jobs. These have several protected variable that my code can't access. The solution before was to clone the code into a separate project, which worked ok because it was just two classes RecommenderJob and ToItemsVectorReducer. Now it looks like more will need to be cloned.
These protected statics are sort of a pain. It requires me to either move the code into Mahout (scary) or clone and maintain a bunch of classes. For now I took out the downsampling. To do a deeper reintegration with the new 0.9 snapshot stuff will require a bit of work and is probably best done after the cross-RSJ is created. Then the easiest integration would be to take the XRecommenderJob (with new cross RSJ integrated), the new PrepareActionMatrixesJob and move them into Mahout. The other classes in the Solr recommender can probably be left in a separate project--I don't think they need the protected constants. Anyway it should run again but is not ideal. Let me know if there's a problem. On Aug 5, 2013, at 7:14 AM, Pat Ferrel <[email protected]> wrote: OK, iI see it in my build now. Also not sufficient repos in the pom. Looks like some major refactoring of RowSimilarity is in progress. Sebastian, are you sure downsampling belongs in RowSimilairty? It won't be applied to [B'A]? If so I'll update to the lastest Mahout trunk. On Aug 4, 2013, at 8:57 PM, B Lyon <[email protected]> wrote: Hi Pat Below is the compilation error - it's what led me to look at the SAMPLE_SIZE stuff in the first place, where I confirmed via javap that the downloaded mahout jar did not have it any more and then I started looking at the svn source. Mebbe I've got something else misconfigured somehow, although I don't see how it would compile if it's looking for that static field that's removed. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:compile (default-compile) on project solr-recommender: Compilation failure: Compilation failure: [ERROR] /Users/bradflyon/Documents/solr-recommender/src/main/java/finderbots/recommenders/hadoop/PrepareActionMatrixesJob.java:[120,71] cannot find symbol [ERROR] symbol : variable SAMPLE_SIZE [ERROR] location: class org.apache.mahout.cf.taste.hadoop.preparation.ToItemVectorsMapper [ERROR] /Users/bradflyon/Documents/solr-recommender/src/main/java/finderbots/recommenders/hadoop/PrepareActionMatrixesJob.java:[168,71] cannot find symbol [ERROR] symbol : variable SAMPLE_SIZE [ERROR] location: class org.apache.mahout.cf.taste.hadoop.preparation.ToItemVectorsMapper [ On Sun, Aug 4, 2013 at 8:57 PM, Pat Ferrel <[email protected]> wrote: Just updated to today's Mahout trunk and everything works for me. Can you send me the error? Sebastian, do we really want this limit in RowSimilairty? It will not be applied to [B'A] unless you also do a mod to give us RowSimilairty on two matrices. Now that would be very nice indeed… On Aug 3, 2013, at 9:48 PM, B Lyon <[email protected]> wrote: Hi Pat I was going to just play with building the sold-recommender stuff in its current wip state and noticed a compile error (running mvn install) I think because the 0.9 snapshot has some changes on July 30th http://svn.apache.org/viewvc?view=revision&revision=1508302 Basically, back on June 18, Ted noticed that the downsampling might not be being done at the right place to actually avoid overwork due to "perversely prolific users" (thread is here: http://web.archiveorange.com/archive/v/z6zxQatCzHoFxbdLF0of), and someone else (Sebastian Schelter) has already acted on this (July 30) to move the downsampling to somewhere else (Mahout-1289 - https://issues.apache.org/jira/browse/MAHOUT-1289), which (among other things) removes the SAMPLE_SIZE static variable from ToItemVectorsMapper. I don't know how the general changes affect what you were setting up/playing with. Let me know if I've missed something here. -- BF Lyon http://www.nowherenearithaca.com -- BF Lyon http://www.nowherenearithaca.com
