Well actually elephant-bird has a generic com.twitter.elephantbird.pig.store.SequenceFileStorage which lets you use generic WritableConverters (com.twitter.elephantbird.pig.util.TextConverter, com.twitter.elephantbird.pig.util.IntWritableConverter, etc) to produce *Writable types as keys and values, given input Pig tuple types. One of these is yes, VectorWritableConverter.
On Fri, May 11, 2012 at 2:59 PM, Ted Dunning <[email protected]> wrote: > PigModelStorage stores SGD models. > > The elephant bird stuff stores data in the form of vectors. > > On Fri, May 11, 2012 at 11:38 AM, Timothy Potter <[email protected] > >wrote: > > > So my main question is what does the elephant-bird model storage stuff do > > that PigModelStorage doesn't? > > > -- -jake
