Yes, an M/R job series that would take a DataModel (in some format) and output a trimmed DataModel.
On Wed, Oct 5, 2011 at 4:46 AM, Ted Dunning <[email protected]> wrote: > Is that the question? > > I thought Lance was asking for a process for LLR trimming rather than a > single map-reduce step to do all of it. Isn't there a job for doing > cooccurrence counting and then trimming that based on LLR? > > On Wed, Oct 5, 2011 at 1:16 AM, Sean Owen <[email protected]> wrote: > > > Job? no, but this is code in non-distributed land. The point of this > > particular bit of code is being very fast and simplistic. I am not > > sure you could update all LLRs on the fly efficiently. > > > > On Wed, Oct 5, 2011 at 4:35 AM, Lance Norskog <[email protected]> wrote: > > > Is there a job that can do LLR-based trimming? > > > > > > -- Lance Norskog [email protected]
