I haven't tried pig for 2 months or so, but last time I did try it, I found it too sensitive to really minor for my taste.
I currently use hand-written scripts in grool, a system of my own device that allows simple MR programs to be written simply. I would say that it would be easier to use a system that has a full extension language such as grool or JAQL than pig. Resampling and discretization are really pretty straightforward applications of map reduce and should normally be collected as components into a larger composite mapper. On 4/4/08 10:28 AM, "Karl Wettin" <[EMAIL PROTECTED]> wrote: > I sent this RTFM-level question to the Pig list the other day but never > got any response. Anyone in here that could tell me if it makes sense? > > http://www.mail-archive.com/[EMAIL PROTECTED]/msg00137.html > >> <http://lucene.apache.org/mahout/> need some formula 1A pre > processing > filters such as resampling, discretization and what not. >> >> Would you agree it sounds about right to do that with Pig? >> >> People tell me there are a constant changes to the API of Pig. If this >> is true, how probable is it that features as them listed above would >> require a lot of tinkering every time one wants some new juicy feature >> from your trunk? >> >> I don't know, perhaps Pig already can do some of this? > > > karl
