Re: Code Freeze

[Jeff Eastman]

I have a Dirichlet Job that runs, but it produces very odd results that I have not been able to debug, not yet at least. Basically the challenge is needing to produce a ModelDistribution and Model implementation that is suitable for a 60-d sample vector (what's the prior? pdf?). I've adapted the code from the 2-d Normal, but it suffers from underflow in the pdf() calculation which may be the source of the problem.

Jeff

Grant Ingersoll wrote:

Also, using the SequenceFile format for the clusters which have 60-d centers is obfuscating. Finally, Dirichlet does not assign points to a single model so the final OutputDriver step would have to output the pdf of each point to each cluster. I will add an output tool to help with the interpretation. I can commit what I have if anybody (Ted?) wants to go spelunking with me. I can work on this up to the 4pm EDT deadline.

OK, this time I really mean I think we are finally there! Please review http://people.apache.org/~gsingers/staging-repo/mahout/org/apache/mahout/

I believe we have:

Individual artifacts all published to Maven repo
Prebuilt Hadoop Job jars for both core and example
Taste war and easy demo setup



All in all, I think it is a pretty good 0.1.



How does that sound to everyone?

Cheers,
Grant

project tarball that contains the project source and is easily compilable (we don't have a pure "binary" distribution yet, but I can live with it) I've downloaded the tarballs and checked signatures and run the examples Job for both k-means and canopy I would like to cut a release candidate today at 4 PM EDT and call a vote. I believe all the pieces are in place w/ the possible exception of the Dirichlet Job code. Thus, can we agree no I will use what is on trunk at 4 PM EDT as the source for the RC?

PGP.sig
Description: PGP signature