I have checked the SequenceFileLoader from elephantbird and it seems to use a different SequenceFileLoader as oppose to the one there is in piggybank Is there any reason for that?
On Mon, Oct 24, 2011 at 5:57 PM, Gayatri Rao <[email protected]> wrote: > Thank Dmitriy. Are the jars available in maven repository? > > Thanks, > Gayatri > > > On Mon, Oct 24, 2011 at 11:55 AM, Dmitriy Ryaboy <[email protected]>wrote: > >> We have a massively improved (well, rewritten from scratch) SequenceLoader >> in elephantbird. Take a look here: >> >> https://github.com/kevinweil/elephant-bird/blob/master/src/java/com/twitter/elephantbird/pig/load/SequenceFileLoader.java >> >> No separate readme on usage, but all the related classes are >> well-documented >> in Javadocs. >> >> D >> >> On Mon, Oct 24, 2011 at 12:55 AM, Daniel Dai <[email protected]> >> wrote: >> >> > I think it is the SequenceFileLoader.translateWritableToPigDataType >> which >> > does not support custom writable. Try to enhance >> > translateWritableToPigDataType. >> > >> > Daniel >> > >> > On Mon, Oct 24, 2011 at 12:21 AM, Gayatri Rao <[email protected]> >> wrote: >> > >> > > Hi All, >> > > >> > > I am trying to use the sequence file loader in piggybank for my custom >> > > writable object. I am working with pig 0.8, It looks like it does not >> > work >> > > for user defined custom writables? >> > > Any pointers on how I can write a loader for my own custom writable? >> > > >> > > Thanks, >> > > Gayatri >> > > >> > >> > >
